Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 925816 Details for
Bug 1128807
Second suspend of a vm doesn't work
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm.log
vdsm.log (text/x-log), 13.04 MB, created by
Vered Volansky
on 2014-08-11 15:26:49 UTC
(
hide
)
Description:
vdsm.log
Filename:
MIME Type:
Creator:
Vered Volansky
Created:
2014-08-11 15:26:49 UTC
Size:
13.04 MB
patch
obsolete
>Thread-10205::DEBUG::2014-08-11 17:01:02,820::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:01:02,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fa7c207-ff85-42d6-923a-59f818e45783`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:02,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:01:02,877::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:02,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`9fa7c207-ff85-42d6-923a-59f818e45783`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:02,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`9fa7c207-ff85-42d6-923a-59f818e45783`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:02,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:02,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:02,877::task::993::Storage.TaskManager.Task::(_decref) Task=`9fa7c207-ff85-42d6-923a-59f818e45783`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:01:02,885::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:01:02,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ed6f2f9-ba15-43dd-b2b9-3aba6f5cd108`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:01:02,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:01:02,886::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`336431a9-b079-45b5-911f-e24bafd86b13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:01:02,886::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:01:02,886::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:01:02,886::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`336431a9-b079-45b5-911f-e24bafd86b13`::Granted request >Thread-10197::DEBUG::2014-08-11 17:01:02,887::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1ed6f2f9-ba15-43dd-b2b9-3aba6f5cd108`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:01:02,887::task::993::Storage.TaskManager.Task::(_decref) Task=`1ed6f2f9-ba15-43dd-b2b9-3aba6f5cd108`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:01:02,906::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:02,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ed6f2f9-ba15-43dd-b2b9-3aba6f5cd108`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:02,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ed6f2f9-ba15-43dd-b2b9-3aba6f5cd108`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:01:02,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:01:02,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:01:02,906::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:01:02,907::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:01:02,907::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:01:02,907::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:01:02,907::task::993::Storage.TaskManager.Task::(_decref) Task=`1ed6f2f9-ba15-43dd-b2b9-3aba6f5cd108`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:01:03,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:03,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137833 s, 74.3 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:01:04,920::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:01:05,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:05,357::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0367984 s, 27.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:05,514::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:05,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:05,514::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:05,514::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:05,514::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:05,515::__init__::225::IOProcess::(_processLogs) (539914) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:05,515::__init__::225::IOProcess::(_processLogs) (539914) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:05,518::__init__::225::IOProcess::(_processLogs) (539914) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:05,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:01:05,519::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:01:05,578::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00037507 s, 976 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:05,578::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) (539915) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) (539915) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:05,579::__init__::225::IOProcess::(_processLogs) (539915) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:05,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:05,580::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:05,703::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:05,704::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:05,704::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:05,744::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:05,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:05,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:06,671::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) (539916) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) (539916) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:06,672::__init__::225::IOProcess::(_processLogs) (539916) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:06,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:01:06,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:06,674::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:01:06,735::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00142303 s, 348 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:06,736::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:06,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:06,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:06,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:06,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:06,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:06,740::__init__::225::IOProcess::(_processLogs) (539917) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:06,741::__init__::225::IOProcess::(_processLogs) (539917) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:06,741::__init__::225::IOProcess::(_processLogs) (539917) Building response >Thread-19::DEBUG::2014-08-11 17:01:06,742::__init__::225::IOProcess::(_processLogs) (539917) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:06,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:06,743::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:06,744::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:06,744::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:01:06,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:06,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:06,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:06,746::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:06,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:06,748::__init__::225::IOProcess::(_processLogs) (539918) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:06,748::__init__::225::IOProcess::(_processLogs) (539918) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:06,749::__init__::225::IOProcess::(_processLogs) (539918) Building response >Thread-19::DEBUG::2014-08-11 17:01:06,749::__init__::225::IOProcess::(_processLogs) (539918) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:06,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:06,750::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:06,751::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:06,751::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:01:06,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:06,752::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:06,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:06,754::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:06,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:06,755::__init__::225::IOProcess::(_processLogs) (539919) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:06,756::__init__::225::IOProcess::(_processLogs) (539919) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:06,756::__init__::225::IOProcess::(_processLogs) (539919) Building response >Thread-19::DEBUG::2014-08-11 17:01:06,756::__init__::225::IOProcess::(_processLogs) (539919) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:06,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:06,757::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:06,758::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:06,759::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:01:06,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:06,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:06,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:06,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:06,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:06,762::__init__::225::IOProcess::(_processLogs) (539920) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:06,763::__init__::225::IOProcess::(_processLogs) (539920) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:06,764::__init__::225::IOProcess::(_processLogs) (539920) Building response >Thread-19::DEBUG::2014-08-11 17:01:06,764::__init__::225::IOProcess::(_processLogs) (539920) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:06,765::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:06,765::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:01:07,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:07,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0718005 s, 14.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:01:09,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:09,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538172 s, 19.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:01:10,567::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:01:10,710::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:10,710::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:10,710::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:10,750::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:10,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:10,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:11,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:11,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250164 s, 40.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:01:12,929::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:01:12,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cec6e07-e0c5-434d-9885-0674535aa5e7`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:12,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:01:12,955::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:12,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`1cec6e07-e0c5-434d-9885-0674535aa5e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:12,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cec6e07-e0c5-434d-9885-0674535aa5e7`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:12,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:12,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:12,956::task::993::Storage.TaskManager.Task::(_decref) Task=`1cec6e07-e0c5-434d-9885-0674535aa5e7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:01:12,963::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:01:12,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`72403e62-7061-4d7c-a06c-9bdd3ae8d9a0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:01:12,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:01:12,964::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6b9e30d1-b56d-435f-9756-ac555fdd89cd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:01:12,964::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:01:12,964::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:01:12,964::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6b9e30d1-b56d-435f-9756-ac555fdd89cd`::Granted request >Thread-10197::DEBUG::2014-08-11 17:01:12,964::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`72403e62-7061-4d7c-a06c-9bdd3ae8d9a0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:01:12,964::task::993::Storage.TaskManager.Task::(_decref) Task=`72403e62-7061-4d7c-a06c-9bdd3ae8d9a0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:01:12,981::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:12,981::task::1191::Storage.TaskManager.Task::(prepare) Task=`72403e62-7061-4d7c-a06c-9bdd3ae8d9a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:12,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`72403e62-7061-4d7c-a06c-9bdd3ae8d9a0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:01:12,981::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:01:12,981::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:01:12,981::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:01:12,982::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:01:12,982::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:01:12,982::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:01:12,982::task::993::Storage.TaskManager.Task::(_decref) Task=`72403e62-7061-4d7c-a06c-9bdd3ae8d9a0`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:01:13,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:13,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0587812 s, 17.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:01:15,057::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:01:15,580::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) (539921) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:15,581::__init__::225::IOProcess::(_processLogs) (539921) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:15,582::__init__::225::IOProcess::(_processLogs) DEBUG|(539921) Building response >Thread-19::DEBUG::2014-08-11 17:01:15,582::__init__::225::IOProcess::(_processLogs) (539921) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:15,582::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:15,583::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:01:15,583::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:01:15,642::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000392334 s, 933 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:15,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:15,643::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:15,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:15,643::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:15,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:15,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:15,644::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:15,644::__init__::225::IOProcess::(_processLogs) (539922) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:15,644::__init__::225::IOProcess::(_processLogs) (539922) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:15,645::__init__::225::IOProcess::(_processLogs) (539922) Building response >Thread-19::DEBUG::2014-08-11 17:01:15,645::__init__::225::IOProcess::(_processLogs) (539922) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:15,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:15,645::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:15,716::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:15,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:15,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:15,755::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:15,756::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:15,756::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:15,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:15,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130051 s, 78.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:01:16,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`451399e1-c8c2-4929-9829-f84fee19cf3b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:16,231::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:01:16,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392334', 'lastCheck': '0.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142303', 'lastCheck': '9.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:01:16,231::task::1191::Storage.TaskManager.Task::(prepare) Task=`451399e1-c8c2-4929-9829-f84fee19cf3b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392334', 'lastCheck': '0.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142303', 'lastCheck': '9.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:01:16,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`451399e1-c8c2-4929-9829-f84fee19cf3b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:16,232::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:16,232::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:16,232::task::993::Storage.TaskManager.Task::(_decref) Task=`451399e1-c8c2-4929-9829-f84fee19cf3b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:01:16,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:01:16,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:16,764::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:16,764::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:16,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:16,765::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:16,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-28::DEBUG::2014-08-11 17:01:16,765::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:16,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:16,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:16,826::__init__::225::IOProcess::(_processLogs) (539923) Finding callback 'statvfs'... >Thread-28::DEBUG::2014-08-11 17:01:16,826::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00114855 s, 431 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:16,827::__init__::225::IOProcess::(_processLogs) (539923) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:16,828::__init__::225::IOProcess::(_processLogs) (539923) Building response >Thread-19::DEBUG::2014-08-11 17:01:16,829::__init__::225::IOProcess::(_processLogs) (539923) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:16,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:16,830::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:16,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:16,831::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:16,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:16,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:16,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:16,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:16,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:16,835::__init__::225::IOProcess::(_processLogs) (539924) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:16,835::__init__::225::IOProcess::(_processLogs) (539924) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:16,836::__init__::225::IOProcess::(_processLogs) DEBUG|(539924) Building response >Thread-19::DEBUG::2014-08-11 17:01:16,837::__init__::225::IOProcess::(_processLogs) (539924) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:16,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:16,838::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:16,839::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:16,840::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:01:16,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:16,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:16,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:16,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:16,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:16,843::__init__::225::IOProcess::(_processLogs) (539925) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:16,844::__init__::225::IOProcess::(_processLogs) (539925) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:16,844::__init__::225::IOProcess::(_processLogs) (539925) Building response >Thread-19::DEBUG::2014-08-11 17:01:16,845::__init__::225::IOProcess::(_processLogs) (539925) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:16,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:16,846::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:16,848::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:16,848::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:01:16,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:16,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:16,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:16,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:16,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:16,852::__init__::225::IOProcess::(_processLogs) (539926) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:16,853::__init__::225::IOProcess::(_processLogs) (539926) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:16,853::__init__::225::IOProcess::(_processLogs) (539926) Building response >Thread-19::DEBUG::2014-08-11 17:01:16,854::__init__::225::IOProcess::(_processLogs) (539926) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:16,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:16,855::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:16,856::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:16,857::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:01:16,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:16,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:16,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:16,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:16,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:16,861::__init__::225::IOProcess::(_processLogs) (539927) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:16,861::__init__::225::IOProcess::(_processLogs) (539927) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:16,862::__init__::225::IOProcess::(_processLogs) (539927) Building response >Thread-19::DEBUG::2014-08-11 17:01:16,862::__init__::225::IOProcess::(_processLogs) (539927) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:16,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:16,863::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:01:17,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:18,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0287445 s, 35.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:01:19,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`370ef745-b044-4fef-b7b3-03b4a074db0b`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:01:19,922::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:01:19,923::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:19,923::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:01:19,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:19,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:19,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:19,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:19,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:19,927::__init__::225::IOProcess::(_processLogs) (539928) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:01:19,927::__init__::225::IOProcess::(_processLogs) (539928) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:01:19,928::__init__::225::IOProcess::(_processLogs) (539928) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:19,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:19,929::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:01:19,930::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:01:19,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:19,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:19,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:19,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:19,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:19,933::__init__::225::IOProcess::(_processLogs) (539929) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:01:19,933::__init__::225::IOProcess::(_processLogs) (539929) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:01:19,933::__init__::225::IOProcess::(_processLogs) (539929) Building response >Thread-19::DEBUG::2014-08-11 17:01:19,933::__init__::225::IOProcess::(_processLogs) (539929) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:19,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:19,934::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::INFO::2014-08-11 17:01:19,934::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:01:19,934::task::1191::Storage.TaskManager.Task::(prepare) Task=`370ef745-b044-4fef-b7b3-03b4a074db0b`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:01:19,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`370ef745-b044-4fef-b7b3-03b4a074db0b`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:01:19,934::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:01:19,934::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10017::DEBUG::2014-08-11 17:01:19,934::task::993::Storage.TaskManager.Task::(_decref) Task=`370ef745-b044-4fef-b7b3-03b4a074db0b`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:01:19,955::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:01:20,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:20,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461308 s, 22.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:20,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:20,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:20,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:20,760::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:20,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:20,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:22,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:22,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0713835 s, 14.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:01:23,084::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:01:23,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`662cddf8-5409-4d3e-8d9f-8bcda7610f7e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:23,084::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:01:23,127::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:23,128::task::1191::Storage.TaskManager.Task::(prepare) Task=`662cddf8-5409-4d3e-8d9f-8bcda7610f7e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:23,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`662cddf8-5409-4d3e-8d9f-8bcda7610f7e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:23,128::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:23,128::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:23,128::task::993::Storage.TaskManager.Task::(_decref) Task=`662cddf8-5409-4d3e-8d9f-8bcda7610f7e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:01:23,134::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:01:23,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`530843fb-df4c-4f48-b1fc-c11e945da15e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:01:23,135::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:01:23,163::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`77b1f1da-7152-4652-8d91-d5d44403c23a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:01:23,163::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:01:23,164::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:01:23,164::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`77b1f1da-7152-4652-8d91-d5d44403c23a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:01:23,164::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`530843fb-df4c-4f48-b1fc-c11e945da15e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:01:23,164::task::993::Storage.TaskManager.Task::(_decref) Task=`530843fb-df4c-4f48-b1fc-c11e945da15e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:01:23,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:23,182::task::1191::Storage.TaskManager.Task::(prepare) Task=`530843fb-df4c-4f48-b1fc-c11e945da15e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:23,182::task::595::Storage.TaskManager.Task::(_updateState) Task=`530843fb-df4c-4f48-b1fc-c11e945da15e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:01:23,182::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:01:23,182::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:01:23,182::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:01:23,182::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:01:23,182::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:01:23,182::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:01:23,182::task::993::Storage.TaskManager.Task::(_decref) Task=`530843fb-df4c-4f48-b1fc-c11e945da15e`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:01:24,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:24,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0167836 s, 61.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:01:25,574::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) (539930) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) (539930) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:25,645::__init__::225::IOProcess::(_processLogs) (539930) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:25,646::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:01:25,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:01:25,705::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00102996 s, 355 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:25,706::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:25,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:25,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:25,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:25,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:25,707::__init__::225::IOProcess::(_processLogs) (539931) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:25,707::__init__::225::IOProcess::(_processLogs) (539931) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:25,707::__init__::225::IOProcess::(_processLogs) (539931) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:25,707::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:25,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:25,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:25,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:25,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:25,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:25,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:26,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:26,442::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014051 s, 72.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:26,865::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:26,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:26,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:26,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:26,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:26,866::__init__::225::IOProcess::(_processLogs) (539932) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:26,866::__init__::225::IOProcess::(_processLogs) (539932) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:26,866::__init__::225::IOProcess::(_processLogs) (539932) Queuing response >Thread-28::DEBUG::2014-08-11 17:01:26,866::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:26,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:26,925::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:01:26,930::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00413845 s, 120 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:26,932::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:26,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:26,933::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:26,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:26,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:26,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:26,935::__init__::225::IOProcess::(_processLogs) (539933) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:26,936::__init__::225::IOProcess::(_processLogs) (539933) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:26,937::__init__::225::IOProcess::(_processLogs) (539933) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:26,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:26,938::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:26,939::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:01:26,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:26,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:26,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:26,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:26,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:26,943::__init__::225::IOProcess::(_processLogs) (539934) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:26,943::__init__::225::IOProcess::(_processLogs) (539934) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:26,944::__init__::225::IOProcess::(_processLogs) (539934) Building response >Thread-19::DEBUG::2014-08-11 17:01:26,945::__init__::225::IOProcess::(_processLogs) (539934) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:26,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:26,946::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:26,947::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:01:26,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:26,948::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:26,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:26,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:26,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:26,950::__init__::225::IOProcess::(_processLogs) (539935) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:26,951::__init__::225::IOProcess::(_processLogs) (539935) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:26,951::__init__::225::IOProcess::(_processLogs) (539935) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:26,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:26,953::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:26,953::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:01:26,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:26,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:26,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:26,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:26,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:26,956::__init__::225::IOProcess::(_processLogs) (539936) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:26,957::__init__::225::IOProcess::(_processLogs) (539936) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:26,958::__init__::225::IOProcess::(_processLogs) (539936) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:26,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:26,959::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:01:27,100::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:01:28,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:28,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160461 s, 63.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:01:30,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:30,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564963 s, 18.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:30,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:30,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:30,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:30,770::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:30,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:30,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:01:31,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`deaf76c2-9136-49ff-8c74-079e2460efb4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:31,405::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:01:31,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102996', 'lastCheck': '5.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00413845', 'lastCheck': '4.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:01:31,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`deaf76c2-9136-49ff-8c74-079e2460efb4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102996', 'lastCheck': '5.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00413845', 'lastCheck': '4.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:01:31,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`deaf76c2-9136-49ff-8c74-079e2460efb4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:31,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:31,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:31,406::task::993::Storage.TaskManager.Task::(_decref) Task=`deaf76c2-9136-49ff-8c74-079e2460efb4`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:01:31,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:01:31,421::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:32,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:32,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0591258 s, 17.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:01:33,239::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:01:33,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`f658bcb0-520b-453a-b805-ee4724f527de`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:33,239::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:01:33,270::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:33,270::task::1191::Storage.TaskManager.Task::(prepare) Task=`f658bcb0-520b-453a-b805-ee4724f527de`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:33,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`f658bcb0-520b-453a-b805-ee4724f527de`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:33,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:33,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:33,270::task::993::Storage.TaskManager.Task::(_decref) Task=`f658bcb0-520b-453a-b805-ee4724f527de`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:01:33,278::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:01:33,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2cb5e2a-5e27-4fa0-bae4-0e762974f550`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:01:33,278::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:01:33,278::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`671ecba5-0269-41b7-8bad-0ff0c5292097`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:01:33,278::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:01:33,278::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:01:33,278::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`671ecba5-0269-41b7-8bad-0ff0c5292097`::Granted request >Thread-10197::DEBUG::2014-08-11 17:01:33,279::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c2cb5e2a-5e27-4fa0-bae4-0e762974f550`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:01:33,279::task::993::Storage.TaskManager.Task::(_decref) Task=`c2cb5e2a-5e27-4fa0-bae4-0e762974f550`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:01:33,297::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:33,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2cb5e2a-5e27-4fa0-bae4-0e762974f550`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:33,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2cb5e2a-5e27-4fa0-bae4-0e762974f550`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:01:33,298::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:01:33,298::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:01:33,298::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:01:33,298::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:01:33,298::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:01:33,298::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:01:33,298::task::993::Storage.TaskManager.Task::(_decref) Task=`c2cb5e2a-5e27-4fa0-bae4-0e762974f550`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:01:34,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:34,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0659719 s, 15.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:01:34,963::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:01:35,708::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:35,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:35,708::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:35,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:35,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:35,709::__init__::225::IOProcess::(_processLogs) (539937) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:35,709::__init__::225::IOProcess::(_processLogs) (539937) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:35,710::__init__::225::IOProcess::(_processLogs) (539937) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:35,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:01:35,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:01:35,770::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:01:35,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000414615 s, 883 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:35,771::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:35,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:01:35,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:35,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:35,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:35,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:35,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:01:35,775::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:35,775::__init__::225::IOProcess::(_processLogs) (539938) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:35,776::__init__::225::IOProcess::(_processLogs) (539938) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:35,778::__init__::225::IOProcess::(_processLogs) (539938) Queuing response >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:35,778::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:35,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:35,779::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:35,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:35,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:36,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:36,984::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:36,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:36,985::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:36,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:36,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:36,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:36,987::__init__::225::IOProcess::(_processLogs) (539939) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:36,988::__init__::225::IOProcess::(_processLogs) (539939) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:36,989::__init__::225::IOProcess::(_processLogs) (539939) Queuing response >Thread-28::DEBUG::2014-08-11 17:01:36,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:36,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:37,049::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:01:37,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0035228 s, 141 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:37,070::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:37,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:37,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:37,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:37,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:37,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-51::DEBUG::2014-08-11 17:01:37,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.089323 s, 11.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:37,078::__init__::225::IOProcess::(_processLogs) (539940) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:37,079::__init__::225::IOProcess::(_processLogs) (539940) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:37,081::__init__::225::IOProcess::(_processLogs) (539940) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:37,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:37,084::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:37,085::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:01:37,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:37,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:37,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:37,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:37,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:37,092::__init__::225::IOProcess::(_processLogs) (539941) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:37,093::__init__::225::IOProcess::(_processLogs) (539941) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:37,094::__init__::225::IOProcess::(_processLogs) (539941) Building response >Thread-19::DEBUG::2014-08-11 17:01:37,095::__init__::225::IOProcess::(_processLogs) (539941) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:37,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:37,097::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:37,100::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:01:37,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:37,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:37,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:37,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:37,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:37,107::__init__::225::IOProcess::(_processLogs) (539942) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:37,108::__init__::225::IOProcess::(_processLogs) (539942) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:37,109::__init__::225::IOProcess::(_processLogs) (539942) Building response >Thread-19::DEBUG::2014-08-11 17:01:37,110::__init__::225::IOProcess::(_processLogs) (539942) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:37,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:37,113::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:37,115::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:01:37,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:37,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:37,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:37,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:37,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:37,120::__init__::225::IOProcess::(_processLogs) (539943) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:37,121::__init__::225::IOProcess::(_processLogs) (539943) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:37,122::__init__::225::IOProcess::(_processLogs) (539943) Building response >Thread-19::DEBUG::2014-08-11 17:01:37,122::__init__::225::IOProcess::(_processLogs) (539943) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:37,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:37,123::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:01:39,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:39,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0210652 s, 48.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:01:40,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`86be5442-a2be-4015-a9c8-e38bb86c5a40`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:01:40,593::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:01:40,593::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:01:40,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) (539944) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) (539944) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) (539944) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:40,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:40,595::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:01:40,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:40,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:01:40,595::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:01:40,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:01:40,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`86be5442-a2be-4015-a9c8-e38bb86c5a40`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:01:40,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:01:40,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`86be5442-a2be-4015-a9c8-e38bb86c5a40`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:01:40,597::__init__::225::IOProcess::(_processLogs) (539945) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:01:40,597::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:01:40,597::__init__::225::IOProcess::(_processLogs) (539945) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:01:40,597::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:01:40,598::__init__::225::IOProcess::(_processLogs) (539945) Building response >Thread-10102::DEBUG::2014-08-11 17:01:40,598::task::993::Storage.TaskManager.Task::(_decref) Task=`86be5442-a2be-4015-a9c8-e38bb86c5a40`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:01:40,598::__init__::225::IOProcess::(_processLogs) (539945) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:40,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:40,599::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:01:40,620::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:01:40,779::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:40,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:40,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:40,785::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:40,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:40,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:41,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:41,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142771 s, 71.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:01:43,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:01:43,368::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:01:43,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a7fc341-4744-4b5b-866b-b3335137b6fd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:43,369::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:01:43,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0668401 s, 15.3 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:01:43,450::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:43,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a7fc341-4744-4b5b-866b-b3335137b6fd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:43,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a7fc341-4744-4b5b-866b-b3335137b6fd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:43,450::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:43,450::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:43,450::task::993::Storage.TaskManager.Task::(_decref) Task=`2a7fc341-4744-4b5b-866b-b3335137b6fd`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:01:43,457::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:01:43,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`414e4999-da97-4456-8aaf-c81c86512433`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:01:43,457::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:01:43,458::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ffae832f-d883-49d0-821a-50636d923701`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:01:43,458::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:01:43,458::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:01:43,458::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ffae832f-d883-49d0-821a-50636d923701`::Granted request >Thread-10197::DEBUG::2014-08-11 17:01:43,458::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`414e4999-da97-4456-8aaf-c81c86512433`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:01:43,458::task::993::Storage.TaskManager.Task::(_decref) Task=`414e4999-da97-4456-8aaf-c81c86512433`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:01:43,475::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:43,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`414e4999-da97-4456-8aaf-c81c86512433`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:43,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`414e4999-da97-4456-8aaf-c81c86512433`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:01:43,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:01:43,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:01:43,475::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:01:43,475::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:01:43,475::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:01:43,476::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:01:43,476::task::993::Storage.TaskManager.Task::(_decref) Task=`414e4999-da97-4456-8aaf-c81c86512433`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:01:45,120::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:01:45,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:45,588::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0785128 s, 13.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:45,779::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:45,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:45,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:45,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:45,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:45,780::__init__::225::IOProcess::(_processLogs) (539946) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:45,780::__init__::225::IOProcess::(_processLogs) (539946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:45,780::__init__::225::IOProcess::(_processLogs) (539946) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:45,781::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:01:45,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:45,781::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:45,842::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:45,842::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:45,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:45,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:01:45,845::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00298971 s, 122 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:45,848::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:45,848::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:45,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:45,850::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm::DEBUG::2014-08-11 17:01:45,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:45,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:45,851::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:45,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:45,852::__init__::225::IOProcess::(_processLogs) (539947) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:45,852::__init__::225::IOProcess::(_processLogs) (539947) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:45,852::__init__::225::IOProcess::(_processLogs) (539947) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:45,853::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:45,853::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:01:46,644::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2721765-8363-4b11-a521-247b4888efa4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:46,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:01:46,645::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00298971', 'lastCheck': '0.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0035228', 'lastCheck': '9.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:01:46,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2721765-8363-4b11-a521-247b4888efa4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00298971', 'lastCheck': '0.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0035228', 'lastCheck': '9.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:01:46,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2721765-8363-4b11-a521-247b4888efa4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:46,645::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:46,645::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:46,645::task::993::Storage.TaskManager.Task::(_decref) Task=`b2721765-8363-4b11-a521-247b4888efa4`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:01:46,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:01:46,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) (539948) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:47,125::__init__::225::IOProcess::(_processLogs) (539948) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:47,126::__init__::225::IOProcess::(_processLogs) DEBUG|(539948) Building response >Thread-19::DEBUG::2014-08-11 17:01:47,126::__init__::225::IOProcess::(_processLogs) (539948) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:47,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:47,126::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:01:47,127::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:01:47,206::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00384267 s, 129 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) (539949) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:47,207::__init__::225::IOProcess::(_processLogs) (539949) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:47,208::__init__::225::IOProcess::(_processLogs) DEBUG|(539949) Building response >Thread-19::DEBUG::2014-08-11 17:01:47,208::__init__::225::IOProcess::(_processLogs) (539949) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:47,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:47,208::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) (539950) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:47,209::__init__::225::IOProcess::(_processLogs) (539950) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:47,210::__init__::225::IOProcess::(_processLogs) DEBUG|(539950) Building response >Thread-19::DEBUG::2014-08-11 17:01:47,210::__init__::225::IOProcess::(_processLogs) (539950) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:47,210::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:01:47,210::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) (539951) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:47,211::__init__::225::IOProcess::(_processLogs) (539951) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:47,212::__init__::225::IOProcess::(_processLogs) DEBUG|(539951) Building response >Thread-19::DEBUG::2014-08-11 17:01:47,212::__init__::225::IOProcess::(_processLogs) (539951) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:47,212::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:01:47,212::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:47,212::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:47,212::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) (539952) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) (539952) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:47,213::__init__::225::IOProcess::(_processLogs) (539952) Building response >Thread-19::DEBUG::2014-08-11 17:01:47,214::__init__::225::IOProcess::(_processLogs) (539952) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:47,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:47,214::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:01:47,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:47,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0618193 s, 16.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:01:49,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:49,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0785743 s, 13.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:01:49,970::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:01:50,854::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:50,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:01:50,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:50,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:50,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:50,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:01:51,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:51,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162062 s, 63.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:01:53,557::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:01:53,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`018cbd1c-ef95-44f0-8e73-56ad68375070`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:01:53,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:01:53,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:53,585::task::1191::Storage.TaskManager.Task::(prepare) Task=`018cbd1c-ef95-44f0-8e73-56ad68375070`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:01:53,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`018cbd1c-ef95-44f0-8e73-56ad68375070`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:01:53,586::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:01:53,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:01:53,586::task::993::Storage.TaskManager.Task::(_decref) Task=`018cbd1c-ef95-44f0-8e73-56ad68375070`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:01:53,593::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:01:53,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b718add-1db5-4df6-8fb9-9acdd07d7cbd`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:01:53,593::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:01:53,593::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`600efe40-4ec5-447d-b638-626f0af5c822`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:01:53,593::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:01:53,594::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:01:53,594::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`600efe40-4ec5-447d-b638-626f0af5c822`::Granted request >Thread-10197::DEBUG::2014-08-11 17:01:53,594::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b718add-1db5-4df6-8fb9-9acdd07d7cbd`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:01:53,594::task::993::Storage.TaskManager.Task::(_decref) Task=`4b718add-1db5-4df6-8fb9-9acdd07d7cbd`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:01:53,616::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:53,616::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b718add-1db5-4df6-8fb9-9acdd07d7cbd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:01:53,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b718add-1db5-4df6-8fb9-9acdd07d7cbd`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:01:53,616::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:01:53,616::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:01:53,617::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:01:53,617::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:01:53,617::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:01:53,617::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:01:53,617::task::993::Storage.TaskManager.Task::(_decref) Task=`4b718add-1db5-4df6-8fb9-9acdd07d7cbd`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:01:53,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:54,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556489 s, 18.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:01:55,627::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:01:55,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:55,853::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:55,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) (539953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) (539953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) DEBUG|(539953) Building response >Thread-19::DEBUG::2014-08-11 17:01:55,854::__init__::225::IOProcess::(_processLogs) (539953) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:55,855::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:01:55,855::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:55,856::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:55,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:55,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:01:55,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00085742 s, 427 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:55,920::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:55,921::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm::DEBUG::2014-08-11 17:01:55,922::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:55,922::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:55,922::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:55,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:55,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:55,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm::DEBUG::2014-08-11 17:01:55,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:01:55,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:01:55,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:55,927::__init__::225::IOProcess::(_processLogs) (539954) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:55,928::__init__::225::IOProcess::(_processLogs) (539954) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:55,929::__init__::225::IOProcess::(_processLogs) DEBUG|(539954) Building response >Thread-19::DEBUG::2014-08-11 17:01:55,929::__init__::225::IOProcess::(_processLogs) (539954) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:55,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:55,929::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:01:56,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:56,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0820673 s, 12.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:01:57,152::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:01:57,214::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:57,215::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:57,216::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:57,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:57,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:57,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:57,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:57,218::__init__::225::IOProcess::(_processLogs) (539955) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:57,219::__init__::225::IOProcess::(_processLogs) (539955) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:57,220::__init__::225::IOProcess::(_processLogs) DEBUG|(539955) Building response >Thread-28::DEBUG::2014-08-11 17:01:57,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:01:57,221::__init__::225::IOProcess::(_processLogs) (539955) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:57,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:57,281::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:01:57,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00126999 s, 390 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:01:57,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:57,285::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:01:57,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:57,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:57,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:57,287::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:57,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:57,289::__init__::225::IOProcess::(_processLogs) (539956) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:01:57,289::__init__::225::IOProcess::(_processLogs) (539956) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:01:57,290::__init__::225::IOProcess::(_processLogs) (539956) Building response >Thread-19::DEBUG::2014-08-11 17:01:57,291::__init__::225::IOProcess::(_processLogs) (539956) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:57,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:57,291::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:01:57,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:57,293::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:01:57,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:57,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:57,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:57,295::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:57,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:57,296::__init__::225::IOProcess::(_processLogs) (539957) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:57,297::__init__::225::IOProcess::(_processLogs) (539957) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:57,297::__init__::225::IOProcess::(_processLogs) (539957) Building response >Thread-19::DEBUG::2014-08-11 17:01:57,298::__init__::225::IOProcess::(_processLogs) (539957) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:57,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:57,299::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:57,300::__init__::225::IOProcess::(_processLogs) (539957) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:57,300::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:01:57,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:57,301::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:57,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:57,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:57,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:57,303::__init__::225::IOProcess::(_processLogs) (539958) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:57,304::__init__::225::IOProcess::(_processLogs) (539958) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:57,304::__init__::225::IOProcess::(_processLogs) (539958) Building response >Thread-19::DEBUG::2014-08-11 17:01:57,305::__init__::225::IOProcess::(_processLogs) (539957) Got request for method 'access'DEBUG|(539958) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:57,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:57,306::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:01:57,307::__init__::225::IOProcess::(_processLogs) (539957) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:01:57,308::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:01:57,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:01:57,309::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:01:57,309::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:01:57,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:01:57,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:01:57,311::__init__::225::IOProcess::(_processLogs) (539959) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:01:57,312::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:01:57,313::__init__::225::IOProcess::(_processLogs) (539959) Building response >Thread-19::DEBUG::2014-08-11 17:01:57,313::__init__::225::IOProcess::(_processLogs) (539959) Queuing response >Thread-19::DEBUG::2014-08-11 17:01:57,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:01:57,314::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:01:58,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:01:58,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200347 s, 51.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:02:00,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:00,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0596309 s, 17.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:00,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:00,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:00,931::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:00,931::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:00,932::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:00,932::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:02:01,845::task::595::Storage.TaskManager.Task::(_updateState) Task=`468ec804-d031-46bd-9164-c1b2c1aead62`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:01,846::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:02:01,846::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00085742', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00126999', 'lastCheck': '4.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:01,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`468ec804-d031-46bd-9164-c1b2c1aead62`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00085742', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00126999', 'lastCheck': '4.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:01,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`468ec804-d031-46bd-9164-c1b2c1aead62`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:01,848::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:01,848::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:01,849::task::993::Storage.TaskManager.Task::(_decref) Task=`468ec804-d031-46bd-9164-c1b2c1aead62`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:02:01,874::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:02:01,876::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:02,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:02,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0940987 s, 10.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:02:03,692::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:02:03,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`3206c7c7-f75d-43f4-9c7d-cbee2fd805cd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:03,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:02:03,715::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:03,716::task::1191::Storage.TaskManager.Task::(prepare) Task=`3206c7c7-f75d-43f4-9c7d-cbee2fd805cd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:03,716::task::595::Storage.TaskManager.Task::(_updateState) Task=`3206c7c7-f75d-43f4-9c7d-cbee2fd805cd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:03,716::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:03,716::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:03,716::task::993::Storage.TaskManager.Task::(_decref) Task=`3206c7c7-f75d-43f4-9c7d-cbee2fd805cd`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:02:03,722::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:02:03,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`faebda12-1e47-43c2-a31a-e51d57f188ab`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:02:03,723::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:02:03,723::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2bc8421f-1bb6-447e-a167-9ac3693f0b62`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:02:03,723::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:02:03,723::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:02:03,723::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2bc8421f-1bb6-447e-a167-9ac3693f0b62`::Granted request >Thread-10197::DEBUG::2014-08-11 17:02:03,724::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`faebda12-1e47-43c2-a31a-e51d57f188ab`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:02:03,724::task::993::Storage.TaskManager.Task::(_decref) Task=`faebda12-1e47-43c2-a31a-e51d57f188ab`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:02:03,740::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:03,740::task::1191::Storage.TaskManager.Task::(prepare) Task=`faebda12-1e47-43c2-a31a-e51d57f188ab`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:03,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`faebda12-1e47-43c2-a31a-e51d57f188ab`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:02:03,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:02:03,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:02:03,741::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:02:03,741::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:02:03,741::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:02:03,741::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:02:03,741::task::993::Storage.TaskManager.Task::(_decref) Task=`faebda12-1e47-43c2-a31a-e51d57f188ab`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:02:04,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:04,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.073658 s, 13.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:02:05,062::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:02:05,930::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:05,930::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:05,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:05,930::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:05,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:05,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:05,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:05,931::__init__::225::IOProcess::(_processLogs) (539960) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:05,931::__init__::225::IOProcess::(_processLogs) (539960) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:05,931::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539960) Building response >Thread-27::DEBUG::2014-08-11 17:02:05,932::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:05,932::__init__::225::IOProcess::(_processLogs) (539960) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:05,991::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:05,992::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:02:05,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:05,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:02:05,994::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000872061 s, 420 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:05,996::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:05,997::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:05,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:05,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:05,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:05,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:06,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:06,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:06,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:06,002::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:06,002::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:06,002::__init__::225::IOProcess::(_processLogs) (539961) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:06,003::__init__::225::IOProcess::(_processLogs) (539961) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:06,005::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539961) Building response >Thread-19::DEBUG::2014-08-11 17:02:06,006::__init__::225::IOProcess::(_processLogs) (539961) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:06,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:06,006::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:02:06,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:06,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344423 s, 29.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:07,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:07,314::__init__::225::IOProcess::(_processLogs) (539962) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:07,314::__init__::225::IOProcess::(_processLogs) (539962) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:07,314::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539962) Building response >Thread-19::DEBUG::2014-08-11 17:02:07,314::__init__::225::IOProcess::(_processLogs) (539962) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:07,314::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:02:07,315::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:07,315::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:02:07,376::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00133269 s, 371 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:07,378::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:07,379::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:07,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:07,380::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:07,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:07,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:07,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:07,382::__init__::225::IOProcess::(_processLogs) (539963) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:07,383::__init__::225::IOProcess::(_processLogs) (539963) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:07,384::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539963) Building response >Thread-19::DEBUG::2014-08-11 17:02:07,385::__init__::225::IOProcess::(_processLogs) (539963) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:07,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:07,386::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:02:07,387::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:07,387::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:02:07,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:07,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:07,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:07,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:07,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:07,391::__init__::225::IOProcess::(_processLogs) (539964) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:07,391::__init__::225::IOProcess::(_processLogs) (539964) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:07,392::__init__::225::IOProcess::(_processLogs) (539964) Building response >Thread-19::DEBUG::2014-08-11 17:02:07,393::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539964) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:07,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:07,394::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:07,394::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:07,395::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:02:07,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:07,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:07,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:07,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:07,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:07,398::__init__::225::IOProcess::(_processLogs) (539965) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:07,399::__init__::225::IOProcess::(_processLogs) (539965) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:07,400::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539965) Building response >Thread-19::DEBUG::2014-08-11 17:02:07,400::__init__::225::IOProcess::(_processLogs) (539965) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:07,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:07,401::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:07,402::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:07,403::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:02:07,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:07,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:07,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:07,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:07,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:07,406::__init__::225::IOProcess::(_processLogs) (539966) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:07,406::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539966) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:07,407::__init__::225::IOProcess::(_processLogs) (539966) Building response >Thread-19::DEBUG::2014-08-11 17:02:07,408::__init__::225::IOProcess::(_processLogs) (539966) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:07,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:07,409::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:02:08,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:08,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130713 s, 78.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:02:10,689::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:02:10,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:02:11,052::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:11,052::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:11,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:11,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:11,057::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:11,057::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:11,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012742 s, 80.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:02:13,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:13,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163142 s, 62.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:02:13,768::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10205::DEBUG::2014-08-11 17:02:13,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`48af5696-8c1d-4734-8448-28f99ba44916`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:13,769::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:02:13,782::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:13,782::task::1191::Storage.TaskManager.Task::(prepare) Task=`48af5696-8c1d-4734-8448-28f99ba44916`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:13,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`48af5696-8c1d-4734-8448-28f99ba44916`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:13,782::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:13,782::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:13,782::task::993::Storage.TaskManager.Task::(_decref) Task=`48af5696-8c1d-4734-8448-28f99ba44916`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:02:13,789::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10197::DEBUG::2014-08-11 17:02:13,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6b883ea-b731-4325-ac0c-775c2b764ef1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:02:13,789::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:02:13,790::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4bc0f7ad-f62f-41b7-9520-1e2d6bccc9d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:02:13,790::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:02:13,790::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:02:13,790::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4bc0f7ad-f62f-41b7-9520-1e2d6bccc9d9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:02:13,790::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6b883ea-b731-4325-ac0c-775c2b764ef1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:02:13,790::task::993::Storage.TaskManager.Task::(_decref) Task=`c6b883ea-b731-4325-ac0c-775c2b764ef1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:02:13,806::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:13,806::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6b883ea-b731-4325-ac0c-775c2b764ef1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:13,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6b883ea-b731-4325-ac0c-775c2b764ef1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:02:13,806::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:02:13,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:02:13,807::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:02:13,807::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:02:13,807::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:02:13,807::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:02:13,807::task::993::Storage.TaskManager.Task::(_decref) Task=`c6b883ea-b731-4325-ac0c-775c2b764ef1`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:02:15,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:02:15,215::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:02:15,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0771556 s, 13.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:16,006::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:16,006::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:16,006::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:16,006::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:16,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:16,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:16,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:16,007::__init__::225::IOProcess::(_processLogs) (539967) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:16,007::__init__::225::IOProcess::(_processLogs) (539967) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:16,007::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539967) Building response >Thread-27::DEBUG::2014-08-11 17:02:16,008::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:16,008::__init__::225::IOProcess::(_processLogs) (539967) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:16,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:02:16,070::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000348561 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:16,070::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:16,071::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:16,071::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:16,072::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:16,073::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:16,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:16,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:16,075::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:16,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:16,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:16,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:16,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:16,079::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:16,079::__init__::225::IOProcess::(_processLogs) (539968) Finding callback 'statvfs'... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:16,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:16,080::__init__::225::IOProcess::(_processLogs) (539968) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:16,082::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539968) Building response >Thread-19::DEBUG::2014-08-11 17:02:16,083::__init__::225::IOProcess::(_processLogs) (539968) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:16,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:16,083::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:02:17,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b20e7c5-581d-49df-999a-d265cc876e35`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:17,087::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:02:17,087::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348561', 'lastCheck': '1.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133269', 'lastCheck': '9.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:17,087::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b20e7c5-581d-49df-999a-d265cc876e35`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000348561', 'lastCheck': '1.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133269', 'lastCheck': '9.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:17,087::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b20e7c5-581d-49df-999a-d265cc876e35`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:17,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:17,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:17,088::task::993::Storage.TaskManager.Task::(_decref) Task=`6b20e7c5-581d-49df-999a-d265cc876e35`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:02:17,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:02:17,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:17,300::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:17,408::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:17,408::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:17,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:17,408::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:17,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:17,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:17,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:17,409::__init__::225::IOProcess::(_processLogs) (539969) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:17,409::__init__::225::IOProcess::(_processLogs) (539969) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:02:17,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562247 s, 18.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:17,416::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539969) Building response >Thread-19::DEBUG::2014-08-11 17:02:17,416::__init__::225::IOProcess::(_processLogs) (539969) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:17,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:17,418::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:02:17,419::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:02:17,483::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00283791 s, 174 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:17,485::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:17,486::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:17,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:17,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:17,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:17,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:17,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:17,491::__init__::225::IOProcess::(_processLogs) (539970) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:17,491::__init__::225::IOProcess::(_processLogs) (539970) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:17,493::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539970) Building response >Thread-19::DEBUG::2014-08-11 17:02:17,494::__init__::225::IOProcess::(_processLogs) (539970) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:17,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:17,495::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:02:17,496::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:17,497::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:02:17,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:17,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:17,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:17,500::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:17,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:17,501::__init__::225::IOProcess::(_processLogs) (539971) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:17,502::__init__::225::IOProcess::(_processLogs) (539971) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:17,503::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539971) Building response >Thread-19::DEBUG::2014-08-11 17:02:17,504::__init__::225::IOProcess::(_processLogs) (539971) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:17,505::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:17,506::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:17,507::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:17,507::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:02:17,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:17,509::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:17,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:17,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:17,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:17,512::__init__::225::IOProcess::(_processLogs) (539972) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:17,513::__init__::225::IOProcess::(_processLogs) (539972) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:17,513::__init__::225::IOProcess::(_processLogs) (539972) Building response >Thread-19::DEBUG::2014-08-11 17:02:17,515::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539972) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:17,516::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:17,517::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:17,518::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:17,519::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:02:17,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:17,520::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:17,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:17,521::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:17,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:17,523::__init__::225::IOProcess::(_processLogs) (539973) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:17,523::__init__::225::IOProcess::(_processLogs) (539973) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:17,524::__init__::225::IOProcess::(_processLogs) (539973) Building response >Thread-19::DEBUG::2014-08-11 17:02:17,525::__init__::225::IOProcess::(_processLogs) (539973) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:17,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:17,526::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:02:19,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:19,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144456 s, 70.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:02:20,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb92ac52-4073-4eac-9bdd-8740340bcc54`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:02:20,069::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:20,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:20,071::__init__::225::IOProcess::(_processLogs) (539974) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:02:20,071::__init__::225::IOProcess::(_processLogs) (539974) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:02:20,079::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539974) Building response >Thread-19::DEBUG::2014-08-11 17:02:20,079::__init__::225::IOProcess::(_processLogs) (539974) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:20,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:20,079::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:02:20,080::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:20,080::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:02:20,080::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:20,080::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:02:20,080::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:02:20,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:02:20,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb92ac52-4073-4eac-9bdd-8740340bcc54`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:02:20,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:02:20,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb92ac52-4073-4eac-9bdd-8740340bcc54`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:02:20,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:02:20,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:02:20,082::__init__::225::IOProcess::(_processLogs) (539975) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:02:20,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:02:20,083::__init__::225::IOProcess::(_processLogs) (539975) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:02:20,083::task::993::Storage.TaskManager.Task::(_decref) Task=`fb92ac52-4073-4eac-9bdd-8740340bcc54`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:02:20,083::__init__::225::IOProcess::(_processLogs) (539975) Building response >Thread-19::DEBUG::2014-08-11 17:02:20,084::__init__::225::IOProcess::(_processLogs) (539975) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:20,084::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:20,084::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:02:20,105::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:02:21,086::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:21,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:21,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:21,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:21,091::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:21,092::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:21,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:21,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136005 s, 75.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:02:23,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:02:23,858::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:02:23,859::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab6c1a6a-994f-4664-9e02-2dcdfdc66fac`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:23,859::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:02:23,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0919361 s, 11.1 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:02:23,915::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:23,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab6c1a6a-994f-4664-9e02-2dcdfdc66fac`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:23,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab6c1a6a-994f-4664-9e02-2dcdfdc66fac`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:23,915::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:23,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:23,916::task::993::Storage.TaskManager.Task::(_decref) Task=`ab6c1a6a-994f-4664-9e02-2dcdfdc66fac`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:02:23,922::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:02:23,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`5caa4526-3df3-4fde-b942-64298139f27e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:02:23,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:02:23,923::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8025c904-b829-4df6-ae80-6830a7e4e464`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:02:23,923::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:02:23,923::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:02:23,923::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8025c904-b829-4df6-ae80-6830a7e4e464`::Granted request >Thread-10197::DEBUG::2014-08-11 17:02:23,924::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5caa4526-3df3-4fde-b942-64298139f27e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:02:23,924::task::993::Storage.TaskManager.Task::(_decref) Task=`5caa4526-3df3-4fde-b942-64298139f27e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:02:23,940::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:23,940::task::1191::Storage.TaskManager.Task::(prepare) Task=`5caa4526-3df3-4fde-b942-64298139f27e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:23,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`5caa4526-3df3-4fde-b942-64298139f27e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:02:23,940::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:02:23,940::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:02:23,940::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:02:23,940::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:02:23,941::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:02:23,941::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:02:23,941::task::993::Storage.TaskManager.Task::(_decref) Task=`5caa4526-3df3-4fde-b942-64298139f27e`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:02:25,697::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:02:25,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:26,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0542262 s, 18.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) (539976) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) (539976) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539976) Building response >Thread-19::DEBUG::2014-08-11 17:02:26,084::__init__::225::IOProcess::(_processLogs) (539976) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:26,085::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:26,085::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:02:26,085::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:02:26,148::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000807879 s, 453 kB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:26,149::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:26,149::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:26,151::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:26,153::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:26,155::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:26,157::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:26,157::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:26,157::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:26,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:26,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:26,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:26,163::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:26,164::__init__::225::IOProcess::(_processLogs) (539977) Finding callback 'statvfs'... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:26,165::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:26,165::__init__::225::IOProcess::(_processLogs) (539977) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:26,167::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539977) Building response >Thread-19::DEBUG::2014-08-11 17:02:26,169::__init__::225::IOProcess::(_processLogs) (539977) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:26,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:26,169::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:02:27,227::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:02:27,528::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:27,528::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:27,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) (539978) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) (539978) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:27,529::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539978) Building response >Thread-28::DEBUG::2014-08-11 17:02:27,530::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:27,530::__init__::225::IOProcess::(_processLogs) (539978) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:27,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:27,590::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:02:27,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000395183 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:27,592::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:27,593::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:27,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:27,594::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:27,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:27,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:27,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:27,596::__init__::225::IOProcess::(_processLogs) (539979) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:27,597::__init__::225::IOProcess::(_processLogs) (539979) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:27,598::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539979) Building response >Thread-19::DEBUG::2014-08-11 17:02:27,599::__init__::225::IOProcess::(_processLogs) (539979) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:27,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:27,600::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:02:27,601::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:27,601::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:02:27,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:27,602::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:27,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:27,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:27,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:27,605::__init__::225::IOProcess::(_processLogs) (539980) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:27,605::__init__::225::IOProcess::(_processLogs) (539980) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:27,606::__init__::225::IOProcess::(_processLogs) (539980) Building response >Thread-19::DEBUG::2014-08-11 17:02:27,607::__init__::225::IOProcess::(_processLogs) (539980) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:27,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:27,608::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:27,609::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:27,609::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:02:27,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:27,610::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:27,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:27,611::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:27,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:27,612::__init__::225::IOProcess::(_processLogs) (539981) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:27,613::__init__::225::IOProcess::(_processLogs) (539981) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:27,614::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|(539981) Building response >Thread-19::DEBUG::2014-08-11 17:02:27,615::__init__::225::IOProcess::(_processLogs) (539981) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:27,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:27,616::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:27,616::__init__::225::IOProcess::(_processLogs) (539959) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:27,617::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:02:27,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:27,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:27,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:27,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:27,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:27,621::__init__::225::IOProcess::(_processLogs) (539982) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:27,622::__init__::225::IOProcess::(_processLogs) (539982) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:27,622::__init__::225::IOProcess::(_processLogs) (539982) Building response >Thread-19::DEBUG::2014-08-11 17:02:27,623::__init__::225::IOProcess::(_processLogs) (539982) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:27,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:27,624::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:02:28,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:28,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125125 s, 81.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:02:30,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:30,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0720648 s, 14.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:02:31,170::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:31,171::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:31,171::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:31,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:31,173::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:31,173::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:02:32,245::task::595::Storage.TaskManager.Task::(_updateState) Task=`04e9b6ee-d8cf-4ed4-a3c4-bca3a0d3e5a9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:32,246::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:02:32,247::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807879', 'lastCheck': '6.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395183', 'lastCheck': '4.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:32,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`04e9b6ee-d8cf-4ed4-a3c4-bca3a0d3e5a9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000807879', 'lastCheck': '6.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395183', 'lastCheck': '4.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:32,248::task::595::Storage.TaskManager.Task::(_updateState) Task=`04e9b6ee-d8cf-4ed4-a3c4-bca3a0d3e5a9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:32,248::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:32,248::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:32,249::task::993::Storage.TaskManager.Task::(_decref) Task=`04e9b6ee-d8cf-4ed4-a3c4-bca3a0d3e5a9`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:02:32,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:02:32,321::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:02:32,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:32,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241943 s, 42.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:02:33,995::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:02:33,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed6cdbba-fa2f-43da-ade5-8baa84f6b8f4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:33,995::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:02:34,041::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:34,041::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed6cdbba-fa2f-43da-ade5-8baa84f6b8f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:34,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed6cdbba-fa2f-43da-ade5-8baa84f6b8f4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:34,042::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:34,042::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:34,042::task::993::Storage.TaskManager.Task::(_decref) Task=`ed6cdbba-fa2f-43da-ade5-8baa84f6b8f4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:02:34,049::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:02:34,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb8e7550-a0cd-464b-a138-1887f8e3244c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:02:34,049::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:02:34,049::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`59dce07d-211b-47c6-b7b8-de6bf87bda6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:02:34,049::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:02:34,049::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:02:34,049::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`59dce07d-211b-47c6-b7b8-de6bf87bda6b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:02:34,050::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fb8e7550-a0cd-464b-a138-1887f8e3244c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:02:34,050::task::993::Storage.TaskManager.Task::(_decref) Task=`fb8e7550-a0cd-464b-a138-1887f8e3244c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:02:34,068::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:34,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb8e7550-a0cd-464b-a138-1887f8e3244c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:34,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb8e7550-a0cd-464b-a138-1887f8e3244c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:02:34,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:02:34,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:02:34,069::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:02:34,069::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:02:34,069::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:02:34,069::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:02:34,069::task::993::Storage.TaskManager.Task::(_decref) Task=`fb8e7550-a0cd-464b-a138-1887f8e3244c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:02:34,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:34,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494183 s, 20.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:02:35,184::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:02:36,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:36,169::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:36,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) (539983) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) (539983) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(539983) Building response >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) (539983) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:36,170::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:02:36,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:36,171::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:02:36,234::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000826826 s, 443 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:02:36,235::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:36,235::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:36,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:36,239::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:36,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:36,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:36,244::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:36,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:36,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:36,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:36,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:02:36,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:36,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:36,252::__init__::225::IOProcess::(_processLogs) (539984) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:36,253::__init__::225::IOProcess::(_processLogs) (539984) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:36,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(539984) Building response >Thread-19::DEBUG::2014-08-11 17:02:36,256::__init__::225::IOProcess::(_processLogs) (539984) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:36,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:36,256::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:02:36,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:36,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323913 s, 31.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) (539985) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:37,621::__init__::225::IOProcess::(_processLogs) (539985) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:37,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(539985) Building response >Thread-19::DEBUG::2014-08-11 17:02:37,623::__init__::225::IOProcess::(_processLogs) (539985) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:37,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:02:37,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:37,625::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:02:37,691::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00482739 s, 103 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:37,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:37,692::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:37,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:37,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:37,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:37,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:37,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:37,695::__init__::225::IOProcess::(_processLogs) (539986) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:37,696::__init__::225::IOProcess::(_processLogs) (539986) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:37,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(539986) Building response >Thread-19::DEBUG::2014-08-11 17:02:37,698::__init__::225::IOProcess::(_processLogs) (539986) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:37,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:37,699::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:02:37,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:37,700::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:02:37,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:37,701::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:37,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:37,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:37,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:37,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(539987) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:37,704::__init__::225::IOProcess::(_processLogs) (539987) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:37,705::__init__::225::IOProcess::(_processLogs) (539987) Building response >Thread-19::DEBUG::2014-08-11 17:02:37,705::__init__::225::IOProcess::(_processLogs) (539987) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:37,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:37,707::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:37,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:37,709::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:02:37,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:37,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:37,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:37,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:37,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:37,712::__init__::225::IOProcess::(_processLogs) (539988) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:37,713::__init__::225::IOProcess::(_processLogs) (539988) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:37,713::__init__::225::IOProcess::(_processLogs) (539988) Building response >Thread-19::DEBUG::2014-08-11 17:02:37,713::__init__::225::IOProcess::(_processLogs) (539988) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:37,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:37,714::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:37,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:37,716::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:02:37,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:37,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:37,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:37,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:37,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:37,720::__init__::225::IOProcess::(_processLogs) (539989) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:37,720::__init__::225::IOProcess::(_processLogs) (539989) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:37,721::__init__::225::IOProcess::(_processLogs) (539989) Building response >Thread-19::DEBUG::2014-08-11 17:02:37,721::__init__::225::IOProcess::(_processLogs) (539989) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:37,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:37,722::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:02:38,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:38,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0676734 s, 15.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:02:40,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`0350f673-4a1e-4d7a-95da-9db169b1a100`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:02:40,699::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) (539990) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:02:40,700::__init__::225::IOProcess::(_processLogs) (539990) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:02:40,703::__init__::225::IOProcess::(_processLogs) (539990) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:40,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:40,704::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:02:40,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10102::INFO::2014-08-11 17:02:40,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:02:40,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:02:40,705::task::1191::Storage.TaskManager.Task::(prepare) Task=`0350f673-4a1e-4d7a-95da-9db169b1a100`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:02:40,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:02:40,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`0350f673-4a1e-4d7a-95da-9db169b1a100`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:02:40,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:02:40,706::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:02:40,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:02:40,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:02:40,707::task::993::Storage.TaskManager.Task::(_decref) Task=`0350f673-4a1e-4d7a-95da-9db169b1a100`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:02:40,707::__init__::225::IOProcess::(_processLogs) (539991) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:02:40,707::__init__::225::IOProcess::(_processLogs) (539991) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:02:40,708::__init__::225::IOProcess::(_processLogs) (539991) Building response >Thread-19::DEBUG::2014-08-11 17:02:40,708::__init__::225::IOProcess::(_processLogs) (539991) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:40,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:40,708::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:02:40,729::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:02:40,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:40,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0616333 s, 16.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:02:41,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:41,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:41,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:41,264::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:41,264::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:41,266::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:42,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:42,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262304 s, 39.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:02:44,101::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:02:44,101::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ccab2e8-5e56-4948-a1c3-56093b13d36b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:44,101::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:02:44,148::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:44,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ccab2e8-5e56-4948-a1c3-56093b13d36b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:44,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ccab2e8-5e56-4948-a1c3-56093b13d36b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:44,149::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:44,149::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:44,149::task::993::Storage.TaskManager.Task::(_decref) Task=`5ccab2e8-5e56-4948-a1c3-56093b13d36b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:02:44,156::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:02:44,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`e84665f8-3ab4-44bb-949c-1e334d50e63e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:02:44,156::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:02:44,156::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`997771bd-e2b4-4b39-a897-f1c93069d401`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:02:44,156::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:02:44,156::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:02:44,156::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`997771bd-e2b4-4b39-a897-f1c93069d401`::Granted request >Thread-10197::DEBUG::2014-08-11 17:02:44,157::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e84665f8-3ab4-44bb-949c-1e334d50e63e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:02:44,157::task::993::Storage.TaskManager.Task::(_decref) Task=`e84665f8-3ab4-44bb-949c-1e334d50e63e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:02:44,196::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:44,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`e84665f8-3ab4-44bb-949c-1e334d50e63e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:44,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`e84665f8-3ab4-44bb-949c-1e334d50e63e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:02:44,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:02:44,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:02:44,197::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:02:44,197::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:02:44,197::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:02:44,197::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:02:44,197::task::993::Storage.TaskManager.Task::(_decref) Task=`e84665f8-3ab4-44bb-949c-1e334d50e63e`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:02:44,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:45,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128648 s, 79.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:02:45,244::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:02:46,256::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:46,257::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:46,257::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:46,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:46,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:46,257::__init__::225::IOProcess::(_processLogs) (539992) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:46,257::__init__::225::IOProcess::(_processLogs) (539992) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:46,258::__init__::225::IOProcess::(_processLogs) (539992) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:46,258::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:02:46,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:46,320::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:46,321::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:46,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:46,327::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:46,328::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:46,332::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:02:46,335::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00962043 s, 38.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:46,335::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:46,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:46,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:46,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:46,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:46,336::__init__::225::IOProcess::(_processLogs) (539993) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:46,336::__init__::225::IOProcess::(_processLogs) (539993) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:46,338::__init__::225::IOProcess::(_processLogs) (539993) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:46,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:46,339::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:02:47,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:47,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131201 s, 78.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:02:47,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`7133b6f5-459e-4a91-8992-42bff4ad59b6`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:47,474::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:02:47,474::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00962043', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00482739', 'lastCheck': '9.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:47,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`7133b6f5-459e-4a91-8992-42bff4ad59b6`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00962043', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00482739', 'lastCheck': '9.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:02:47,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`7133b6f5-459e-4a91-8992-42bff4ad59b6`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:47,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:47,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:47,474::task::993::Storage.TaskManager.Task::(_decref) Task=`7133b6f5-459e-4a91-8992-42bff4ad59b6`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:02:47,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:02:47,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-28::DEBUG::2014-08-11 17:02:47,719::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,721::__init__::225::IOProcess::(_processLogs) (539994) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) (539995) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:02:47,722::__init__::225::IOProcess::(_processLogs) (539995) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:02:47,723::__init__::225::IOProcess::(_processLogs) (539994) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,723::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:02:47,725::__init__::225::IOProcess::(_processLogs) (539995) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,726::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:02:47,729::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) (539996) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:02:47,729::__init__::225::IOProcess::(_processLogs) (539996) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:02:47,756::__init__::225::IOProcess::(_processLogs) (539996) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,757::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-28::DEBUG::2014-08-11 17:02:47,757::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:02:47,759::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:02:47,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,762::__init__::225::IOProcess::(_processLogs) (539997) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:02:47,763::__init__::225::IOProcess::(_processLogs) (539997) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:02:47,763::__init__::225::IOProcess::(_processLogs) (539997) Queuing response >Thread-28::DEBUG::2014-08-11 17:02:47,764::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:02:47,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:47,765::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:02:47,767::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:02:47,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,770::__init__::225::IOProcess::(_processLogs) (539998) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:47,770::__init__::225::IOProcess::(_processLogs) (539998) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:47,771::__init__::225::IOProcess::(_processLogs) (539998) Building response >Thread-19::DEBUG::2014-08-11 17:02:47,771::__init__::225::IOProcess::(_processLogs) (539998) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:47,773::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:47,774::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:02:47,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,776::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:02:47,777::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:02:47,777::__init__::225::IOProcess::(_processLogs) (539999) Finding callback 'glob'... >Thread-28::INFO::2014-08-11 17:02:47,778::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:02:47,778::__init__::225::IOProcess::(_processLogs) (539999) Got request for method 'glob' >Thread-28::INFO::2014-08-11 17:02:47,778::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:02:47,779::__init__::225::IOProcess::(_processLogs) (539999) Building response >Thread-19::DEBUG::2014-08-11 17:02:47,780::__init__::225::IOProcess::(_processLogs) (539999) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:47,781::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:02:47,781::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:47,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,784::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,785::__init__::225::IOProcess::(_processLogs) (540000) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:47,785::__init__::225::IOProcess::(_processLogs) (540000) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:47,786::__init__::225::IOProcess::(_processLogs) (540000) Queuing response >Thread-28::DEBUG::2014-08-11 17:02:47,787::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:47,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:47,846::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:02:47,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00180066 s, 275 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:47,849::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:47,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:47,850::__init__::225::IOProcess::(_processLogs) (540001) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:47,850::__init__::225::IOProcess::(_processLogs) (540001) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:47,850::__init__::225::IOProcess::(_processLogs) (540001) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,851::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:02:47,851::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:02:47,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,851::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) (540002) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) (540002) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) (540002) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,852::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) (540003) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) (540003) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) (540003) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:47,853::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:02:47,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:47,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:47,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:47,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:47,854::__init__::225::IOProcess::(_processLogs) (540004) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:47,854::__init__::225::IOProcess::(_processLogs) (540004) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:47,855::__init__::225::IOProcess::(_processLogs) (540004) Building response >Thread-19::DEBUG::2014-08-11 17:02:47,855::__init__::225::IOProcess::(_processLogs) (540004) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:47,855::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:47,855::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:02:49,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:49,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439275 s, 23.3 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:02:50,239::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:02:51,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:51,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:51,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:51,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:51,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:51,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:51,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:02:51,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0591335 s, 17.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:02:53,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:53,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326875 s, 31.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:02:54,290::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:02:54,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`2361aa18-275b-45d2-b44c-b4e4e1ac3201`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:02:54,290::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:02:54,348::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:54,349::task::1191::Storage.TaskManager.Task::(prepare) Task=`2361aa18-275b-45d2-b44c-b4e4e1ac3201`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:02:54,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`2361aa18-275b-45d2-b44c-b4e4e1ac3201`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:02:54,349::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:02:54,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:02:54,349::task::993::Storage.TaskManager.Task::(_decref) Task=`2361aa18-275b-45d2-b44c-b4e4e1ac3201`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:02:54,356::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:02:54,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`1de5fb21-6621-4201-8944-03ec5c77bd7f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:02:54,356::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:02:54,356::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`15794025-93b1-4e93-9fbc-c30f7b60f49f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:02:54,356::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:02:54,357::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:02:54,357::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`15794025-93b1-4e93-9fbc-c30f7b60f49f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:02:54,357::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1de5fb21-6621-4201-8944-03ec5c77bd7f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:02:54,357::task::993::Storage.TaskManager.Task::(_decref) Task=`1de5fb21-6621-4201-8944-03ec5c77bd7f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:02:54,382::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:54,382::task::1191::Storage.TaskManager.Task::(prepare) Task=`1de5fb21-6621-4201-8944-03ec5c77bd7f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:02:54,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`1de5fb21-6621-4201-8944-03ec5c77bd7f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:02:54,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:02:54,382::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:02:54,382::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:02:54,383::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:02:54,383::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:02:54,383::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:02:54,383::task::993::Storage.TaskManager.Task::(_decref) Task=`1de5fb21-6621-4201-8944-03ec5c77bd7f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:02:55,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:55,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0151543 s, 67.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:02:55,737::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:02:56,339::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:56,340::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:56,340::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:56,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:02:56,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:02:56,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:56,402::__init__::225::IOProcess::(_processLogs) (540005) Finding callback 'statvfs'... >Thread-27::DEBUG::2014-08-11 17:02:56,405::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000365909 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:56,405::__init__::225::IOProcess::(_processLogs) (540005) Got request for method 'statvfs' >GuestMonitor-vm::DEBUG::2014-08-11 17:02:56,406::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:56,406::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:56,408::__init__::225::IOProcess::(_processLogs) (540005) Building response >Thread-19::DEBUG::2014-08-11 17:02:56,410::__init__::225::IOProcess::(_processLogs) (540005) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:56,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:56,414::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:02:56,414::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:56,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:56,417::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:56,419::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:56,421::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:02:56,423::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:02:56,423::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:02:56,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:56,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:56,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:56,427::__init__::225::IOProcess::(_processLogs) (540006) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:56,427::__init__::225::IOProcess::(_processLogs) (540006) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:56,428::__init__::225::IOProcess::(_processLogs) (540006) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:56,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:56,428::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:02:57,306::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:02:57,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:57,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148734 s, 68.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:57,855::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:57,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:57,855::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:57,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:57,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:57,856::__init__::225::IOProcess::(_processLogs) (540007) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:57,856::__init__::225::IOProcess::(_processLogs) (540007) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:57,857::__init__::225::IOProcess::(_processLogs) (540007) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:57,857::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:02:57,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:02:57,917::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00076402 s, 648 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:02:57,918::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:02:57,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:57,919::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:57,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:57,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:57,922::__init__::225::IOProcess::(_processLogs) (540008) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:02:57,922::__init__::225::IOProcess::(_processLogs) (540008) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:02:57,923::__init__::225::IOProcess::(_processLogs) (540008) Building response >Thread-19::DEBUG::2014-08-11 17:02:57,924::__init__::225::IOProcess::(_processLogs) (540008) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:57,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:57,925::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:02:57,925::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:02:57,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:57,927::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:57,927::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:57,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:57,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:57,929::__init__::225::IOProcess::(_processLogs) (540009) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:57,930::__init__::225::IOProcess::(_processLogs) (540009) Building response >Thread-19::DEBUG::2014-08-11 17:02:57,931::__init__::225::IOProcess::(_processLogs) (540009) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:57,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:57,932::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:57,932::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:02:57,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:57,934::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:57,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:57,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:57,935::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:57,936::__init__::225::IOProcess::(_processLogs) (540010) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:57,936::__init__::225::IOProcess::(_processLogs) (540010) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:57,937::__init__::225::IOProcess::(_processLogs) (540010) Building response >Thread-19::DEBUG::2014-08-11 17:02:57,938::__init__::225::IOProcess::(_processLogs) (540010) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:57,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:57,939::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:02:57,940::__init__::225::IOProcess::(_processLogs) (540010) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:02:57,940::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:02:57,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:02:57,943::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:02:57,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:02:57,944::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:02:57,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:02:57,945::__init__::225::IOProcess::(_processLogs) (540011) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:02:57,946::__init__::225::IOProcess::(_processLogs) (540011) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:02:57,947::__init__::225::IOProcess::(_processLogs) (540011) Building response >Thread-19::DEBUG::2014-08-11 17:02:57,947::__init__::225::IOProcess::(_processLogs) (540011) Queuing response >Thread-19::DEBUG::2014-08-11 17:02:57,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:02:57,948::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:02:59,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:02:59,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0321082 s, 31.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:01,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:01,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:01,432::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:01,432::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:01,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:01,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:01,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:01,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061413 s, 16.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:02,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`603498d2-3d35-43d6-b779-54a4de06ae65`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:02,700::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:03:02,700::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365909', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076402', 'lastCheck': '4.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:02,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`603498d2-3d35-43d6-b779-54a4de06ae65`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365909', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076402', 'lastCheck': '4.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:02,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`603498d2-3d35-43d6-b779-54a4de06ae65`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:02,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:02,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:02,701::task::993::Storage.TaskManager.Task::(_decref) Task=`603498d2-3d35-43d6-b779-54a4de06ae65`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:03:02,715::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:03:02,715::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:03,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:04,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0233884 s, 43.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:04,436::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:03:04,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`86eb2719-188f-43b9-8719-6a6453e52a57`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:04,437::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:03:04,510::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:04,510::task::1191::Storage.TaskManager.Task::(prepare) Task=`86eb2719-188f-43b9-8719-6a6453e52a57`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:04,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`86eb2719-188f-43b9-8719-6a6453e52a57`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:04,510::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:04,510::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:04,510::task::993::Storage.TaskManager.Task::(_decref) Task=`86eb2719-188f-43b9-8719-6a6453e52a57`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:03:04,518::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:03:04,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3bf3ea4-f8cf-4ae5-8659-6fa5864c011c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:03:04,518::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:03:04,518::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`63994127-57ef-4b5d-ba65-fca1e43d28a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:03:04,518::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:03:04,519::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:03:04,519::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`63994127-57ef-4b5d-ba65-fca1e43d28a3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:03:04,519::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3bf3ea4-f8cf-4ae5-8659-6fa5864c011c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:03:04,519::task::993::Storage.TaskManager.Task::(_decref) Task=`a3bf3ea4-f8cf-4ae5-8659-6fa5864c011c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:03:04,538::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:04,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3bf3ea4-f8cf-4ae5-8659-6fa5864c011c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:04,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3bf3ea4-f8cf-4ae5-8659-6fa5864c011c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:03:04,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:03:04,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:03:04,538::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:03:04,538::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:03:04,538::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:03:04,538::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:03:04,538::task::993::Storage.TaskManager.Task::(_decref) Task=`a3bf3ea4-f8cf-4ae5-8659-6fa5864c011c`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:03:05,247::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:03:06,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:06,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560316 s, 18.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) (540012) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:06,429::__init__::225::IOProcess::(_processLogs) (540012) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:06,432::__init__::225::IOProcess::(_processLogs) (540012) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:06,432::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:03:06,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:03:06,494::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000352467 s, 1.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:03:06,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:06,496::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:06,498::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:06,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:06,502::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm::DEBUG::2014-08-11 17:03:06,503::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:06,504::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:06,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:06,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:06,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:03:06,511::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:06,512::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:06,512::__init__::225::IOProcess::(_processLogs) (540013) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:06,514::__init__::225::IOProcess::(_processLogs) (540013) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:06,516::__init__::225::IOProcess::(_processLogs) (540013) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:06,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:06,517::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:07,945::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) (540014) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) (540014) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) (540014) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:07,946::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:03:07,947::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:03:08,009::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00235336 s, 210 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:08,010::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:08,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:08,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:08,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:08,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:08,013::__init__::225::IOProcess::(_processLogs) (540015) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:08,014::__init__::225::IOProcess::(_processLogs) (540015) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:08,015::__init__::225::IOProcess::(_processLogs) (540015) Building response >Thread-19::DEBUG::2014-08-11 17:03:08,015::__init__::225::IOProcess::(_processLogs) (540015) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:08,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:08,016::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:08,017::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:03:08,018::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:08,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:08,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:08,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:08,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:08,020::__init__::225::IOProcess::(_processLogs) (540016) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:08,021::__init__::225::IOProcess::(_processLogs) (540016) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:08,021::__init__::225::IOProcess::(_processLogs) (540016) Building response >Thread-19::DEBUG::2014-08-11 17:03:08,022::__init__::225::IOProcess::(_processLogs) (540016) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:08,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:08,023::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:08,024::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:03:08,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:08,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:08,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:08,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:08,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:08,027::__init__::225::IOProcess::(_processLogs) (540017) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:08,028::__init__::225::IOProcess::(_processLogs) (540017) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:08,028::__init__::225::IOProcess::(_processLogs) (540017) Building response >Thread-19::DEBUG::2014-08-11 17:03:08,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:08,030::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:08,031::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:03:08,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:08,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:08,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:08,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:08,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:08,034::__init__::225::IOProcess::(_processLogs) (540018) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:08,034::__init__::225::IOProcess::(_processLogs) (540018) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:08,035::__init__::225::IOProcess::(_processLogs) (540018) Building response >Thread-19::DEBUG::2014-08-11 17:03:08,035::__init__::225::IOProcess::(_processLogs) (540018) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:08,036::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:08,037::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:03:08,150::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:08,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228307 s, 44.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:03:10,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:10,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0741949 s, 13.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:03:10,748::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:11,521::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:11,522::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:11,522::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:11,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:11,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:11,526::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:12,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:12,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132075 s, 77.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:03:14,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:14,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799133 s, 12.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:14,608::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:03:14,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`2da3ed44-f00d-4c78-8778-45999fe8fea4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:14,608::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:03:14,631::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:14,631::task::1191::Storage.TaskManager.Task::(prepare) Task=`2da3ed44-f00d-4c78-8778-45999fe8fea4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:14,631::task::595::Storage.TaskManager.Task::(_updateState) Task=`2da3ed44-f00d-4c78-8778-45999fe8fea4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:14,631::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:14,631::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:14,631::task::993::Storage.TaskManager.Task::(_decref) Task=`2da3ed44-f00d-4c78-8778-45999fe8fea4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:03:14,712::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:03:14,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbffe047-887e-4432-9806-0a22e1bd9280`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:03:14,713::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:03:14,713::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b2ed2f7b-d9f4-4ac2-8c24-e0de65e22430`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:03:14,713::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:03:14,713::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:03:14,713::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b2ed2f7b-d9f4-4ac2-8c24-e0de65e22430`::Granted request >Thread-10197::DEBUG::2014-08-11 17:03:14,713::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dbffe047-887e-4432-9806-0a22e1bd9280`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:03:14,714::task::993::Storage.TaskManager.Task::(_decref) Task=`dbffe047-887e-4432-9806-0a22e1bd9280`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:03:14,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:14,764::task::1191::Storage.TaskManager.Task::(prepare) Task=`dbffe047-887e-4432-9806-0a22e1bd9280`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:14,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`dbffe047-887e-4432-9806-0a22e1bd9280`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:03:14,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:03:14,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:03:14,764::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:03:14,764::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:03:14,764::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:03:14,764::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:03:14,764::task::993::Storage.TaskManager.Task::(_decref) Task=`dbffe047-887e-4432-9806-0a22e1bd9280`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:03:15,325::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) (540019) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:16,518::__init__::225::IOProcess::(_processLogs) (540019) Got request for method 'statvfs' >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:16,530::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:16,531::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:16,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:16,536::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:16,541::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:16,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:16,562::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540019) Building response >Thread-19::DEBUG::2014-08-11 17:03:16,562::__init__::225::IOProcess::(_processLogs) (540019) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:16,562::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:16,562::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:03:16,563::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:16,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-27::DEBUG::2014-08-11 17:03:16,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000616904 s, 593 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:16,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:16,737::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:16,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:16,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:16,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:16,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:16,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:16,738::__init__::225::IOProcess::(_processLogs) (540020) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:16,738::__init__::225::IOProcess::(_processLogs) (540020) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:16,738::__init__::225::IOProcess::(_processLogs) (540020) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:16,738::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:03:16,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494328 s, 20.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:17,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d754101-431d-4585-b728-c8edfa8dba37`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:17,911::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:03:17,911::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616904', 'lastCheck': '1.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00235336', 'lastCheck': '9.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:17,911::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d754101-431d-4585-b728-c8edfa8dba37`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616904', 'lastCheck': '1.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00235336', 'lastCheck': '9.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:17,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d754101-431d-4585-b728-c8edfa8dba37`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:17,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:17,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:17,912::task::993::Storage.TaskManager.Task::(_decref) Task=`6d754101-431d-4585-b728-c8edfa8dba37`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:03:17,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:03:17,927::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:18,038::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:18,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:18,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:18,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:18,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:18,039::__init__::225::IOProcess::(_processLogs) (540021) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:18,039::__init__::225::IOProcess::(_processLogs) (540021) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:18,039::__init__::225::IOProcess::(_processLogs) (540021) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:18,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:03:18,039::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:03:18,121::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00566064 s, 87.4 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:18,121::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:18,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:18,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:18,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:18,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:18,122::__init__::225::IOProcess::(_processLogs) (540022) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:18,122::__init__::225::IOProcess::(_processLogs) (540022) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:18,123::__init__::225::IOProcess::(_processLogs) (540022) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:18,123::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:18,124::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:03:18,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:18,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:18,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:18,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) (540023) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) (540023) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) (540023) Building response >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) (540023) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:03:18,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) (540024) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) (540024) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) (540024) Building response >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) (540024) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:18,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:18,127::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:18,127::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:03:18,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:18,127::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:18,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:18,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:18,128::__init__::225::IOProcess::(_processLogs) (540025) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:18,128::__init__::225::IOProcess::(_processLogs) (540025) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:18,128::__init__::225::IOProcess::(_processLogs) (540025) Building response >Thread-19::DEBUG::2014-08-11 17:03:18,128::__init__::225::IOProcess::(_processLogs) (540025) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:18,128::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:18,128::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:03:18,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:18,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281496 s, 36.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:03:20,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`831b02d7-b210-4f19-839a-c2ca637d5967`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:03:20,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) (540026) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:03:20,299::__init__::225::IOProcess::(_processLogs) (540026) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:03:20,344::__init__::225::IOProcess::(_processLogs) (540026) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:20,345::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:03:20,345::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:03:20,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:20,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:20,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:20,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::INFO::2014-08-11 17:03:20,346::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:03:20,346::__init__::225::IOProcess::(_processLogs) (540027) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:03:20,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`831b02d7-b210-4f19-839a-c2ca637d5967`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:03:20,347::__init__::225::IOProcess::(_processLogs) (540027) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:03:20,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`831b02d7-b210-4f19-839a-c2ca637d5967`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:03:20,348::__init__::225::IOProcess::(_processLogs) (540027) Building response >Thread-10017::DEBUG::2014-08-11 17:03:20,348::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:03:20,348::__init__::225::IOProcess::(_processLogs) (540027) Queuing response >Thread-10017::DEBUG::2014-08-11 17:03:20,348::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:03:20,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:03:20,349::task::993::Storage.TaskManager.Task::(_decref) Task=`831b02d7-b210-4f19-839a-c2ca637d5967`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:03:20,349::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:03:20,369::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:03:20,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:20,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477132 s, 21.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:21,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:21,547::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:21,547::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:21,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:21,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:21,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:23,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:23,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0369885 s, 27.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:24,796::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:03:24,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`350f11ae-c59d-447d-80da-76a8aeb83471`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:24,796::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:03:24,829::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:24,830::task::1191::Storage.TaskManager.Task::(prepare) Task=`350f11ae-c59d-447d-80da-76a8aeb83471`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:24,830::task::595::Storage.TaskManager.Task::(_updateState) Task=`350f11ae-c59d-447d-80da-76a8aeb83471`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:24,830::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:24,830::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:24,830::task::993::Storage.TaskManager.Task::(_decref) Task=`350f11ae-c59d-447d-80da-76a8aeb83471`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:03:24,837::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:03:24,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`76697546-7120-4105-996f-1bbce1ce65b3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:03:24,837::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:03:24,837::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`94909434-2ebe-403f-b47a-58fbd18373c5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:03:24,838::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:03:24,838::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:03:24,838::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`94909434-2ebe-403f-b47a-58fbd18373c5`::Granted request >Thread-10197::DEBUG::2014-08-11 17:03:24,838::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76697546-7120-4105-996f-1bbce1ce65b3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:03:24,838::task::993::Storage.TaskManager.Task::(_decref) Task=`76697546-7120-4105-996f-1bbce1ce65b3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:03:24,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:24,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`76697546-7120-4105-996f-1bbce1ce65b3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:24,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`76697546-7120-4105-996f-1bbce1ce65b3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:03:24,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:03:24,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:03:24,855::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:03:24,855::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:03:24,855::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:03:24,855::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:03:24,856::task::993::Storage.TaskManager.Task::(_decref) Task=`76697546-7120-4105-996f-1bbce1ce65b3`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:03:25,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:25,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0732599 s, 14.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:03:25,755::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:26,554::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:26,554::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:26,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:26,560::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:26,561::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:26,561::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:26,739::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) (540028) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) (540028) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) (540028) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:26,740::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:03:26,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:03:26,801::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000540453 s, 677 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:26,801::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:26,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:26,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:26,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:26,802::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:26,802::__init__::225::IOProcess::(_processLogs) (540029) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:26,802::__init__::225::IOProcess::(_processLogs) (540029) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:26,802::__init__::225::IOProcess::(_processLogs) (540029) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:26,802::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:03:27,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:03:27,337::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:03:27,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.057298 s, 17.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:28,129::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:28,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:28,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:28,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:28,131::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:28,132::__init__::225::IOProcess::(_processLogs) (540030) Finding callback 'statvfs'... >Thread-28::DEBUG::2014-08-11 17:03:28,133::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:03:28,133::__init__::225::IOProcess::(_processLogs) (540030) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:28,193::__init__::225::IOProcess::(_processLogs) (540030) Building response >Thread-19::DEBUG::2014-08-11 17:03:28,194::__init__::225::IOProcess::(_processLogs) (540030) Queuing response >Thread-28::DEBUG::2014-08-11 17:03:28,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0012548 s, 394 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:28,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:28,197::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:28,198::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:28,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:28,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:28,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:28,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:28,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:28,203::__init__::225::IOProcess::(_processLogs) (540031) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:28,204::__init__::225::IOProcess::(_processLogs) (540031) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:28,206::__init__::225::IOProcess::(_processLogs) (540031) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:28,207::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:28,209::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:28,210::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:03:28,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:28,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:28,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:28,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:28,214::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:28,215::__init__::225::IOProcess::(_processLogs) (540032) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:28,216::__init__::225::IOProcess::(_processLogs) (540032) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:28,216::__init__::225::IOProcess::(_processLogs) (540032) Building response >Thread-19::DEBUG::2014-08-11 17:03:28,217::__init__::225::IOProcess::(_processLogs) (540032) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:28,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:28,219::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:28,221::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:03:28,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:28,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:28,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:28,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:28,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:28,226::__init__::225::IOProcess::(_processLogs) (540033) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:28,226::__init__::225::IOProcess::(_processLogs) (540033) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:28,227::__init__::225::IOProcess::(_processLogs) (540033) Building response >Thread-19::DEBUG::2014-08-11 17:03:28,228::__init__::225::IOProcess::(_processLogs) (540033) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:28,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:28,230::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:28,232::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:03:28,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:28,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:28,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:28,235::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:28,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:28,237::__init__::225::IOProcess::(_processLogs) (540034) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:28,237::__init__::225::IOProcess::(_processLogs) (540034) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:28,239::__init__::225::IOProcess::(_processLogs) (540034) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:28,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:28,241::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:03:29,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:29,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180946 s, 56.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:03:31,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:31,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172076 s, 59.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:31,561::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:31,561::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:31,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:31,567::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:31,568::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:31,568::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:03:33,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f9fab6-e1e6-4781-97b7-5633871683e8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:33,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:03:33,072::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540453', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012548', 'lastCheck': '4.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:33,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4f9fab6-e1e6-4781-97b7-5633871683e8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540453', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0012548', 'lastCheck': '4.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:33,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f9fab6-e1e6-4781-97b7-5633871683e8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:33,072::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:33,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:33,072::task::993::Storage.TaskManager.Task::(_decref) Task=`f4f9fab6-e1e6-4781-97b7-5633871683e8`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:03:33,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:03:33,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:33,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:33,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470788 s, 21.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:34,917::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:03:34,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`59d1e063-a8d4-42bc-8182-c75c02831670`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:34,918::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:03:34,983::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:34,983::task::1191::Storage.TaskManager.Task::(prepare) Task=`59d1e063-a8d4-42bc-8182-c75c02831670`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:34,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`59d1e063-a8d4-42bc-8182-c75c02831670`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:34,983::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:34,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:34,984::task::993::Storage.TaskManager.Task::(_decref) Task=`59d1e063-a8d4-42bc-8182-c75c02831670`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:03:34,990::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:03:34,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4be9104-22dd-49bd-8421-b10c17db5a89`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:03:34,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:03:34,990::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a1ba08ef-2a16-47f1-9fd5-408e9a2f1736`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:03:34,990::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:03:34,991::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:03:34,991::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a1ba08ef-2a16-47f1-9fd5-408e9a2f1736`::Granted request >Thread-10197::DEBUG::2014-08-11 17:03:34,991::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e4be9104-22dd-49bd-8421-b10c17db5a89`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:03:34,991::task::993::Storage.TaskManager.Task::(_decref) Task=`e4be9104-22dd-49bd-8421-b10c17db5a89`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:03:35,008::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:35,008::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4be9104-22dd-49bd-8421-b10c17db5a89`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:35,008::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4be9104-22dd-49bd-8421-b10c17db5a89`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:03:35,008::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:03:35,008::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:03:35,008::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:03:35,008::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:03:35,008::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:03:35,008::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:03:35,009::task::993::Storage.TaskManager.Task::(_decref) Task=`e4be9104-22dd-49bd-8421-b10c17db5a89`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:03:35,377::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:03:35,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:35,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0628182 s, 16.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:36,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:36,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:36,575::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:36,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:36,579::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:36,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:36,808::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) (540035) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:36,809::__init__::225::IOProcess::(_processLogs) (540035) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:36,810::__init__::225::IOProcess::(_processLogs) (540035) Queuing response >Thread-27::DEBUG::2014-08-11 17:03:36,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:03:36,811::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:36,869::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:03:36,875::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00123099 s, 297 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) (540036) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:36,876::__init__::225::IOProcess::(_processLogs) (540036) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:36,877::__init__::225::IOProcess::(_processLogs) (540036) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:36,877::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:03:37,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:37,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0237017 s, 43.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) (540037) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:38,240::__init__::225::IOProcess::(_processLogs) (540037) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:38,241::__init__::225::IOProcess::(_processLogs) (540037) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:38,241::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:03:38,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:03:38,301::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00100866 s, 491 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:38,303::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:38,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:38,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:38,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:38,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:38,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:38,306::__init__::225::IOProcess::(_processLogs) (540038) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:38,306::__init__::225::IOProcess::(_processLogs) (540038) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:38,307::__init__::225::IOProcess::(_processLogs) (540038) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:38,308::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:38,309::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:38,310::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:03:38,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:38,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:38,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:38,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:38,313::__init__::225::IOProcess::(_processLogs) (540039) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:38,314::__init__::225::IOProcess::(_processLogs) (540039) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:38,314::__init__::225::IOProcess::(_processLogs) (540039) Building response >Thread-19::DEBUG::2014-08-11 17:03:38,315::__init__::225::IOProcess::(_processLogs) (540039) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:38,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:38,316::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:38,317::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:03:38,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:38,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:38,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:38,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:38,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:38,320::__init__::225::IOProcess::(_processLogs) (540040) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:38,320::__init__::225::IOProcess::(_processLogs) (540040) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:38,321::__init__::225::IOProcess::(_processLogs) (540040) Building response >Thread-19::DEBUG::2014-08-11 17:03:38,321::__init__::225::IOProcess::(_processLogs) (540040) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:38,322::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:38,323::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:03:38,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:38,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:38,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:38,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:38,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:38,326::__init__::225::IOProcess::(_processLogs) (540041) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:38,327::__init__::225::IOProcess::(_processLogs) (540041) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:38,328::__init__::225::IOProcess::(_processLogs) (540041) Building response >Thread-19::DEBUG::2014-08-11 17:03:38,328::__init__::225::IOProcess::(_processLogs) (540041) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:38,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:38,329::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:03:39,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:40,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0728103 s, 14.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:03:40,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0f8de89-5909-4007-b4d7-76b5b02db54f`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:03:40,810::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:03:40,810::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:03:40,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:40,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:40,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:40,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:40,811::__init__::225::IOProcess::(_processLogs) (540042) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:03:40,811::__init__::225::IOProcess::(_processLogs) (540042) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:03:40,812::__init__::225::IOProcess::(_processLogs) (540042) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:40,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:40,812::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:03:40,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:40,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:03:40,813::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:03:40,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:03:40,813::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0f8de89-5909-4007-b4d7-76b5b02db54f`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10102::DEBUG::2014-08-11 17:03:40,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0f8de89-5909-4007-b4d7-76b5b02db54f`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:03:40,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:03:40,814::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:03:40,815::__init__::225::IOProcess::(_processLogs) (540043) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:03:40,815::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:03:40,815::__init__::225::IOProcess::(_processLogs) (540043) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:03:40,815::task::993::Storage.TaskManager.Task::(_decref) Task=`e0f8de89-5909-4007-b4d7-76b5b02db54f`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:03:40,816::__init__::225::IOProcess::(_processLogs) (540043) Building response >Thread-19::DEBUG::2014-08-11 17:03:40,816::__init__::225::IOProcess::(_processLogs) (540043) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:40,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:40,816::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:03:40,837::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:41,589::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:41,590::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:41,592::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:41,592::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:41,594::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:41,595::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:42,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:42,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425179 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:03:44,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:44,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141691 s, 72.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:45,080::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:03:45,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c936a15-451d-46f9-a3b5-f1bb24df8ad8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:45,081::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:03:45,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:45,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c936a15-451d-46f9-a3b5-f1bb24df8ad8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:45,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c936a15-451d-46f9-a3b5-f1bb24df8ad8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:45,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:45,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:45,133::task::993::Storage.TaskManager.Task::(_decref) Task=`1c936a15-451d-46f9-a3b5-f1bb24df8ad8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:03:45,141::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:03:45,142::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaace1ff-dac2-4808-8f45-b733a5c359b4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:03:45,142::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:03:45,142::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`95c1c667-f9b0-4f8e-87e7-e8d757eb8336`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:03:45,142::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:03:45,142::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:03:45,142::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`95c1c667-f9b0-4f8e-87e7-e8d757eb8336`::Granted request >Thread-10197::DEBUG::2014-08-11 17:03:45,143::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eaace1ff-dac2-4808-8f45-b733a5c359b4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:03:45,143::task::993::Storage.TaskManager.Task::(_decref) Task=`eaace1ff-dac2-4808-8f45-b733a5c359b4`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:03:45,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:45,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`eaace1ff-dac2-4808-8f45-b733a5c359b4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:45,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaace1ff-dac2-4808-8f45-b733a5c359b4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:03:45,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:03:45,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:03:45,160::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:03:45,160::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:03:45,160::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:03:45,160::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:03:45,160::task::993::Storage.TaskManager.Task::(_decref) Task=`eaace1ff-dac2-4808-8f45-b733a5c359b4`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:03:45,356::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:03:46,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:46,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247979 s, 41.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:03:46,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:46,600::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:46,600::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:46,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:46,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:46,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:03:46,878::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:46,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:46,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:46,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:46,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:46,879::__init__::225::IOProcess::(_processLogs) (540044) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:46,879::__init__::225::IOProcess::(_processLogs) (540044) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:46,879::__init__::225::IOProcess::(_processLogs) (540044) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:46,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:03:46,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:03:46,880::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:03:46,940::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000838541 s, 436 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:46,940::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) (540045) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) (540045) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) (540045) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:46,941::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:03:48,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`11d94dd6-a109-4bec-91f1-958cce5f2e67`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:48,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:03:48,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838541', 'lastCheck': '1.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100866', 'lastCheck': '9.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:48,265::task::1191::Storage.TaskManager.Task::(prepare) Task=`11d94dd6-a109-4bec-91f1-958cce5f2e67`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838541', 'lastCheck': '1.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100866', 'lastCheck': '9.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:03:48,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`11d94dd6-a109-4bec-91f1-958cce5f2e67`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:48,265::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:48,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:48,265::task::993::Storage.TaskManager.Task::(_decref) Task=`11d94dd6-a109-4bec-91f1-958cce5f2e67`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:03:48,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:03:48,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:48,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:03:48,367::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:48,367::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:48,368::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:48,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:48,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:48,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:48,370::__init__::225::IOProcess::(_processLogs) (540046) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:48,371::__init__::225::IOProcess::(_processLogs) (540046) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:48,401::__init__::225::IOProcess::(_processLogs) (540046) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:48,401::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:03:48,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:48,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0973334 s, 10.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:03:48,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.004768 s, 104 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:48,470::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:48,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:48,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:48,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:48,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:48,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:48,473::__init__::225::IOProcess::(_processLogs) (540047) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:48,473::__init__::225::IOProcess::(_processLogs) (540047) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:48,474::__init__::225::IOProcess::(_processLogs) (540047) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:48,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:48,475::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:48,476::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:03:48,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:48,477::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:48,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:48,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:48,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:48,479::__init__::225::IOProcess::(_processLogs) (540048) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:48,479::__init__::225::IOProcess::(_processLogs) (540048) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:48,480::__init__::225::IOProcess::(_processLogs) (540048) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:48,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:48,481::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:48,481::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:03:48,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:48,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:48,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:48,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:48,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:48,484::__init__::225::IOProcess::(_processLogs) (540049) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:48,484::__init__::225::IOProcess::(_processLogs) (540049) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:48,485::__init__::225::IOProcess::(_processLogs) (540049) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:48,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:48,485::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:48,485::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:03:48,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:48,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:48,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:48,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:48,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:48,486::__init__::225::IOProcess::(_processLogs) (540050) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:48,486::__init__::225::IOProcess::(_processLogs) (540050) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:48,487::__init__::225::IOProcess::(_processLogs) (540050) Building response >Thread-19::DEBUG::2014-08-11 17:03:48,487::__init__::225::IOProcess::(_processLogs) (540050) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:48,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:48,487::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:03:50,385::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:03:50,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:50,587::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426071 s, 24.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:03:51,606::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:51,606::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:51,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:51,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:51,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:51,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:52,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:52,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0536119 s, 19.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:03:54,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:54,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139019 s, 73.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:03:55,220::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:03:55,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`a893a219-c8a9-4877-9cbe-458be73a0ea0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:03:55,220::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:03:55,279::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:55,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`a893a219-c8a9-4877-9cbe-458be73a0ea0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:03:55,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`a893a219-c8a9-4877-9cbe-458be73a0ea0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:03:55,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:03:55,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:03:55,279::task::993::Storage.TaskManager.Task::(_decref) Task=`a893a219-c8a9-4877-9cbe-458be73a0ea0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:03:55,291::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:03:55,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b200819-4931-4016-bf09-ca67c3b774f2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:03:55,291::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:03:55,292::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8686fa65-3bcb-45c2-a912-52d6b6ba50df`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:03:55,292::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:03:55,292::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:03:55,292::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8686fa65-3bcb-45c2-a912-52d6b6ba50df`::Granted request >Thread-10197::DEBUG::2014-08-11 17:03:55,292::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5b200819-4931-4016-bf09-ca67c3b774f2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:03:55,292::task::993::Storage.TaskManager.Task::(_decref) Task=`5b200819-4931-4016-bf09-ca67c3b774f2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:03:55,347::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:55,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b200819-4931-4016-bf09-ca67c3b774f2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:03:55,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b200819-4931-4016-bf09-ca67c3b774f2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:03:55,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:03:55,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:03:55,348::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:03:55,348::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:03:55,348::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:03:55,348::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:03:55,348::task::993::Storage.TaskManager.Task::(_decref) Task=`5b200819-4931-4016-bf09-ca67c3b774f2`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:03:55,845::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:03:56,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:56,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:03:56,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:56,613::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:56,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:03:56,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:03:56,796::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:56,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400624 s, 25.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:56,942::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) (540051) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:56,943::__init__::225::IOProcess::(_processLogs) (540051) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:56,944::__init__::225::IOProcess::(_processLogs) DEBUG|(540051) Building response >Thread-19::DEBUG::2014-08-11 17:03:56,944::__init__::225::IOProcess::(_processLogs) (540051) Queuing response >Thread-27::DEBUG::2014-08-11 17:03:56,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:03:56,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:57,003::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:03:57,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00872565 s, 41.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:57,021::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:57,021::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:57,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) (540052) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) (540052) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:57,022::__init__::225::IOProcess::(_processLogs) DEBUG|(540052) Building response >Thread-19::DEBUG::2014-08-11 17:03:57,023::__init__::225::IOProcess::(_processLogs) (540052) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:57,023::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:57,023::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:03:57,374::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) (540053) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:58,487::__init__::225::IOProcess::(_processLogs) (540053) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:58,488::__init__::225::IOProcess::(_processLogs) DEBUG|(540053) Building response >Thread-19::DEBUG::2014-08-11 17:03:58,488::__init__::225::IOProcess::(_processLogs) (540053) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:58,488::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:58,488::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:03:58,489::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:03:58,591::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0124998 s, 39.6 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) (540054) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:03:58,592::__init__::225::IOProcess::(_processLogs) (540054) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:03:58,594::__init__::225::IOProcess::(_processLogs) DEBUG|(540054) Building response >Thread-19::DEBUG::2014-08-11 17:03:58,594::__init__::225::IOProcess::(_processLogs) (540054) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:58,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:58,594::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:03:58,595::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:58,595::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:03:58,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) (540055) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) (540055) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) (540055) Building response >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) (540055) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:58,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:58,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) (540056) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) (540056) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) (540056) Building response >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) (540056) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:03:58,598::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) (540057) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) (540057) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:03:58,599::__init__::225::IOProcess::(_processLogs) (540057) Building response >Thread-19::DEBUG::2014-08-11 17:03:58,600::__init__::225::IOProcess::(_processLogs) (540057) Queuing response >Thread-19::DEBUG::2014-08-11 17:03:58,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:03:58,600::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:03:58,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:03:58,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124558 s, 82.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:04:00,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:01,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0356105 s, 28.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:01,616::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:01,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:01,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:01,619::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:01,622::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:01,623::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:03,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:03,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0543628 s, 18.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:04:03,466::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19d4444-9e80-4ba3-bdb5-66d7104d5bf6`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:03,466::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:04:03,467::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00872565', 'lastCheck': '6.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124998', 'lastCheck': '4.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:04:03,467::task::1191::Storage.TaskManager.Task::(prepare) Task=`f19d4444-9e80-4ba3-bdb5-66d7104d5bf6`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00872565', 'lastCheck': '6.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0124998', 'lastCheck': '4.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:04:03,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`f19d4444-9e80-4ba3-bdb5-66d7104d5bf6`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:03,467::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:03,467::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:03,467::task::993::Storage.TaskManager.Task::(_decref) Task=`f19d4444-9e80-4ba3-bdb5-66d7104d5bf6`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:04:03,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:04:03,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:05,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:05,290::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266245 s, 38.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:04:05,393::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:04:05,399::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10205::DEBUG::2014-08-11 17:04:05,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`a774598f-740d-402c-be1b-b2a886e09fff`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:05,399::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:04:05,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:05,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`a774598f-740d-402c-be1b-b2a886e09fff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:05,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`a774598f-740d-402c-be1b-b2a886e09fff`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:05,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:05,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:05,448::task::993::Storage.TaskManager.Task::(_decref) Task=`a774598f-740d-402c-be1b-b2a886e09fff`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:04:05,454::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10197::DEBUG::2014-08-11 17:04:05,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`97a46e86-9537-434b-8f3f-177ea513e954`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:04:05,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:04:05,455::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`31fa77df-2a36-47a7-a57f-8e412f4b4f75`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:04:05,455::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:04:05,455::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:04:05,455::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`31fa77df-2a36-47a7-a57f-8e412f4b4f75`::Granted request >Thread-10197::DEBUG::2014-08-11 17:04:05,456::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`97a46e86-9537-434b-8f3f-177ea513e954`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:04:05,456::task::993::Storage.TaskManager.Task::(_decref) Task=`97a46e86-9537-434b-8f3f-177ea513e954`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:04:05,497::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:05,497::task::1191::Storage.TaskManager.Task::(prepare) Task=`97a46e86-9537-434b-8f3f-177ea513e954`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:05,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`97a46e86-9537-434b-8f3f-177ea513e954`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:04:05,498::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:04:05,498::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:04:05,498::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:04:05,498::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:04:05,498::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:04:05,498::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:04:05,498::task::993::Storage.TaskManager.Task::(_decref) Task=`97a46e86-9537-434b-8f3f-177ea513e954`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:06,626::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:06,626::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:06,627::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:06,630::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:06,630::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:06,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) (540058) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) (540058) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:07,024::__init__::225::IOProcess::(_processLogs) DEBUG|(540058) Building response >Thread-19::DEBUG::2014-08-11 17:04:07,025::__init__::225::IOProcess::(_processLogs) (540058) Queuing response >Thread-27::DEBUG::2014-08-11 17:04:07,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:04:07,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:07,086::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:04:07,087::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000528036 s, 693 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:07,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:07,087::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:07,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:07,087::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) (540059) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) (540059) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) DEBUG|(540059) Building response >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) (540059) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:07,088::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:04:07,089::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:04:07,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:07,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510882 s, 20.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:08,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) (540060) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) (540060) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:08,600::__init__::225::IOProcess::(_processLogs) DEBUG|(540060) Building response >Thread-19::DEBUG::2014-08-11 17:04:08,601::__init__::225::IOProcess::(_processLogs) (540060) Queuing response >Thread-28::DEBUG::2014-08-11 17:04:08,601::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:04:08,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:08,659::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:04:08,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00109367 s, 453 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) (540061) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:08,662::__init__::225::IOProcess::(_processLogs) (540061) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:08,663::__init__::225::IOProcess::(_processLogs) DEBUG|(540061) Building response >Thread-19::DEBUG::2014-08-11 17:04:08,663::__init__::225::IOProcess::(_processLogs) (540061) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:08,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:08,663::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:08,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) (540062) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) (540062) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) (540062) Building response >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) (540062) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:08,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) (540063) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) (540063) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) (540063) Building response >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) (540063) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:08,666::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:08,667::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:08,667::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:04:08,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:08,667::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:08,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) (540064) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) (540064) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) (540064) Building response >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) (540064) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:08,668::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:04:09,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:09,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310286 s, 33.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:04:10,861::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:04:11,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:11,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138639 s, 73.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:11,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:11,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:11,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:11,634::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:11,635::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:11,635::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:13,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:13,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0516078 s, 19.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:04:15,392::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:04:15,571::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:04:15,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d41a3a2-304f-4c94-9313-7e2ac492812f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:15,571::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:04:15,608::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:15,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d41a3a2-304f-4c94-9313-7e2ac492812f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:15,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d41a3a2-304f-4c94-9313-7e2ac492812f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:15,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:15,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:15,608::task::993::Storage.TaskManager.Task::(_decref) Task=`4d41a3a2-304f-4c94-9313-7e2ac492812f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:04:15,615::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:04:15,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`af57e2ff-2ce7-415e-a5b7-be371a93d69a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:04:15,615::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:04:15,616::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3bcdc07d-b59b-471e-b8bb-1fb2be30d8a8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:04:15,616::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:04:15,616::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:04:15,616::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3bcdc07d-b59b-471e-b8bb-1fb2be30d8a8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:04:15,616::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af57e2ff-2ce7-415e-a5b7-be371a93d69a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:04:15,616::task::993::Storage.TaskManager.Task::(_decref) Task=`af57e2ff-2ce7-415e-a5b7-be371a93d69a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:04:15,632::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:15,632::task::1191::Storage.TaskManager.Task::(prepare) Task=`af57e2ff-2ce7-415e-a5b7-be371a93d69a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:15,632::task::595::Storage.TaskManager.Task::(_updateState) Task=`af57e2ff-2ce7-415e-a5b7-be371a93d69a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:04:15,632::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:04:15,632::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:04:15,633::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:04:15,633::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:04:15,633::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:04:15,633::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:04:15,633::task::993::Storage.TaskManager.Task::(_decref) Task=`af57e2ff-2ce7-415e-a5b7-be371a93d69a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:04:15,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:15,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162727 s, 62.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:16,635::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:16,636::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:16,636::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:16,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:16,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:16,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) (540065) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:17,090::__init__::225::IOProcess::(_processLogs) (540065) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:17,091::__init__::225::IOProcess::(_processLogs) DEBUG|(540065) Building response >Thread-19::DEBUG::2014-08-11 17:04:17,091::__init__::225::IOProcess::(_processLogs) (540065) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:17,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:17,091::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:04:17,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:04:17,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00101847 s, 359 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:17,153::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:17,153::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:17,153::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:17,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:17,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:17,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:17,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:17,154::__init__::225::IOProcess::(_processLogs) (540066) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:17,154::__init__::225::IOProcess::(_processLogs) (540066) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:17,154::__init__::225::IOProcess::(_processLogs) DEBUG|(540066) Building response >Thread-19::DEBUG::2014-08-11 17:04:17,155::__init__::225::IOProcess::(_processLogs) (540066) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:17,155::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:17,155::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:04:17,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:17,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526219 s, 19.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:18,668::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:18,668::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:18,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:18,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:18,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:18,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:18,669::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:18,669::__init__::225::IOProcess::(_processLogs) (540067) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:18,669::__init__::225::IOProcess::(_processLogs) (540067) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:18,669::__init__::225::IOProcess::(_processLogs) DEBUG|(540067) Building response >Thread-19::DEBUG::2014-08-11 17:04:18,669::__init__::225::IOProcess::(_processLogs) (540067) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:18,669::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:04:18,670::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:04:18,670::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:04:18,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`989927be-db13-405e-a8dc-fdd2b2d5e4af`::moving from state init -> state preparing >Thread-28::DEBUG::2014-08-11 17:04:18,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00173685 s, 285 kB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:04:18,733::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2014-08-11 17:04:18,735::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10205::INFO::2014-08-11 17:04:18,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101847', 'lastCheck': '1.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109367', 'lastCheck': '10.1', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:04:18,736::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-10205::DEBUG::2014-08-11 17:04:18,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`989927be-db13-405e-a8dc-fdd2b2d5e4af`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101847', 'lastCheck': '1.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109367', 'lastCheck': '10.1', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:04:18,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10205::DEBUG::2014-08-11 17:04:18,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`989927be-db13-405e-a8dc-fdd2b2d5e4af`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:04:18,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10205::DEBUG::2014-08-11 17:04:18,738::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:04:18,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10205::DEBUG::2014-08-11 17:04:18,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:04:18,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10205::DEBUG::2014-08-11 17:04:18,740::task::993::Storage.TaskManager.Task::(_decref) Task=`989927be-db13-405e-a8dc-fdd2b2d5e4af`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:04:18,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:18,743::__init__::225::IOProcess::(_processLogs) (540068) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:18,744::__init__::225::IOProcess::(_processLogs) (540068) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:18,745::__init__::225::IOProcess::(_processLogs) DEBUG|(540068) Building response >Thread-19::DEBUG::2014-08-11 17:04:18,746::__init__::225::IOProcess::(_processLogs) (540068) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:18,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:18,747::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:18,748::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:18,749::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:04:18,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:18,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:18,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:18,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:18,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:18,752::__init__::225::IOProcess::(_processLogs) (540069) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:18,753::__init__::225::IOProcess::(_processLogs) (540069) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:18,754::__init__::225::IOProcess::(_processLogs) (540069) Building response >Thread-19::DEBUG::2014-08-11 17:04:18,754::__init__::225::IOProcess::(_processLogs) (540069) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:18,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:18,754::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:18,755::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:18,755::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:04:18,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:18,755::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:18,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:18,755::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) (540070) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) (540070) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) (540070) Building response >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) (540070) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:04:18,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) (540071) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) (540071) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:18,757::__init__::225::IOProcess::(_processLogs) (540071) Building response >Thread-19::DEBUG::2014-08-11 17:04:18,758::__init__::225::IOProcess::(_processLogs) (540071) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:18,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:18,758::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:04:18,766::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:04:18,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:19,918::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:20,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423604 s, 24.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:04:20,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1374daa-ac36-479d-ac84-58943d94a283`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:04:20,395::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:04:20,395::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:20,395::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:04:20,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:20,395::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:20,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:20,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:20,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:20,396::__init__::225::IOProcess::(_processLogs) (540072) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:04:20,396::__init__::225::IOProcess::(_processLogs) (540072) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:04:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|(540072) Building response >Thread-19::DEBUG::2014-08-11 17:04:20,400::__init__::225::IOProcess::(_processLogs) (540072) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:20,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:04:20,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:20,401::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:04:20,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:20,401::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:04:20,401::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:04:20,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:04:20,402::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1374daa-ac36-479d-ac84-58943d94a283`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:04:20,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:04:20,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1374daa-ac36-479d-ac84-58943d94a283`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:04:20,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:04:20,403::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:04:20,403::__init__::225::IOProcess::(_processLogs) (540073) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:04:20,403::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:04:20,404::__init__::225::IOProcess::(_processLogs) (540073) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:04:20,404::task::993::Storage.TaskManager.Task::(_decref) Task=`b1374daa-ac36-479d-ac84-58943d94a283`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:04:20,404::__init__::225::IOProcess::(_processLogs) (540073) Building response >Thread-19::DEBUG::2014-08-11 17:04:20,404::__init__::225::IOProcess::(_processLogs) (540073) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:20,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:20,405::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:04:20,425::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:21,642::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:21,642::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:21,643::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:21,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:21,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:21,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:22,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:22,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423832 s, 24.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:04:24,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:24,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0910463 s, 11.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:04:25,692::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:04:25,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`d37cb4eb-201f-4191-86d7-046e25043550`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:25,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:04:25,754::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:25,754::task::1191::Storage.TaskManager.Task::(prepare) Task=`d37cb4eb-201f-4191-86d7-046e25043550`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:25,754::task::595::Storage.TaskManager.Task::(_updateState) Task=`d37cb4eb-201f-4191-86d7-046e25043550`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:25,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:25,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:25,755::task::993::Storage.TaskManager.Task::(_decref) Task=`d37cb4eb-201f-4191-86d7-046e25043550`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:04:25,762::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:04:25,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a847382-5504-4cac-a2f8-b1062a490cda`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:04:25,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:04:25,762::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b6a0c5c5-e8fa-41b8-b115-ea45cf5d1f58`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:04:25,762::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:04:25,762::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:04:25,762::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b6a0c5c5-e8fa-41b8-b115-ea45cf5d1f58`::Granted request >Thread-10197::DEBUG::2014-08-11 17:04:25,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6a847382-5504-4cac-a2f8-b1062a490cda`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:04:25,763::task::993::Storage.TaskManager.Task::(_decref) Task=`6a847382-5504-4cac-a2f8-b1062a490cda`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:04:25,778::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:25,779::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a847382-5504-4cac-a2f8-b1062a490cda`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:25,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a847382-5504-4cac-a2f8-b1062a490cda`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:04:25,779::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:04:25,779::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:04:25,779::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:04:25,779::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:04:25,779::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:04:25,779::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:04:25,779::task::993::Storage.TaskManager.Task::(_decref) Task=`6a847382-5504-4cac-a2f8-b1062a490cda`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:04:25,868::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:04:26,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:26,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130204 s, 78.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:26,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:26,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:26,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:26,649::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:26,650::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:26,650::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) (540074) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) (540074) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) (540074) Building response >Thread-19::DEBUG::2014-08-11 17:04:27,156::__init__::225::IOProcess::(_processLogs) (540074) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:27,157::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:04:27,157::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:04:27,157::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:04:27,217::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000781079 s, 469 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) (540075) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:27,218::__init__::225::IOProcess::(_processLogs) (540075) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:27,219::__init__::225::IOProcess::(_processLogs) DEBUG|(540075) Building response >Thread-19::DEBUG::2014-08-11 17:04:27,219::__init__::225::IOProcess::(_processLogs) (540075) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:27,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:27,220::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:04:27,406::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:04:28,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:28,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499105 s, 20.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:28,758::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:28,759::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:28,759::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:28,760::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:28,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:28,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:28,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:28,763::__init__::225::IOProcess::(_processLogs) (540076) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:28,763::__init__::225::IOProcess::(_processLogs) (540076) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:28,765::__init__::225::IOProcess::(_processLogs) DEBUG|(540076) Building response >Thread-19::DEBUG::2014-08-11 17:04:28,766::__init__::225::IOProcess::(_processLogs) (540076) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:28,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:28,766::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:04:28,767::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:04:28,825::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000425343 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:28,826::__init__::225::IOProcess::(_processLogs) (540077) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:28,827::__init__::225::IOProcess::(_processLogs) (540077) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:28,827::__init__::225::IOProcess::(_processLogs) (540077) Building response >Thread-19::DEBUG::2014-08-11 17:04:28,827::__init__::225::IOProcess::(_processLogs) (540077) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:28,827::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:04:28,827::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:28,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) (540078) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) (540078) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) (540078) Building response >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) (540078) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:28,829::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) (540079) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) (540079) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) (540079) Building response >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) (540079) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:28,830::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) (540080) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) (540080) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:28,831::__init__::225::IOProcess::(_processLogs) DEBUG|(540080) Building response >Thread-19::DEBUG::2014-08-11 17:04:28,832::__init__::225::IOProcess::(_processLogs) (540080) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:28,832::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:04:28,832::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:04:30,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:30,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262523 s, 39.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:31,655::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:31,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:31,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:31,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:31,662::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:31,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:32,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:32,756::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520768 s, 19.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:04:33,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`86800eee-0d89-4744-94c3-644b05cff64d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:33,938::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:04:33,938::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781079', 'lastCheck': '6.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425343', 'lastCheck': '5.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:04:33,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`86800eee-0d89-4744-94c3-644b05cff64d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000781079', 'lastCheck': '6.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425343', 'lastCheck': '5.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:04:33,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`86800eee-0d89-4744-94c3-644b05cff64d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:33,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:33,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:33,938::task::993::Storage.TaskManager.Task::(_decref) Task=`86800eee-0d89-4744-94c3-644b05cff64d`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:04:33,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:04:33,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:34,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:34,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028615 s, 35.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:04:35,439::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:04:35,838::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:04:35,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b8969e2-f3a9-4947-a37a-051017b67d37`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:35,839::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:04:35,892::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:35,892::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b8969e2-f3a9-4947-a37a-051017b67d37`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:35,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b8969e2-f3a9-4947-a37a-051017b67d37`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:35,892::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:35,892::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:35,893::task::993::Storage.TaskManager.Task::(_decref) Task=`8b8969e2-f3a9-4947-a37a-051017b67d37`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:04:35,899::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:04:35,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb4210e5-7c4d-4864-a931-46cdff41c960`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:04:35,900::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:04:35,900::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`deba9a4c-e6bc-443b-a57b-aa74a0c0073e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:04:35,900::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:04:35,900::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:04:35,900::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`deba9a4c-e6bc-443b-a57b-aa74a0c0073e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:04:35,900::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cb4210e5-7c4d-4864-a931-46cdff41c960`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:04:35,900::task::993::Storage.TaskManager.Task::(_decref) Task=`cb4210e5-7c4d-4864-a931-46cdff41c960`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:04:35,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:35,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb4210e5-7c4d-4864-a931-46cdff41c960`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:35,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb4210e5-7c4d-4864-a931-46cdff41c960`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:04:35,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:04:35,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:04:35,943::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:04:35,943::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:04:35,944::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:04:35,944::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:04:35,944::task::993::Storage.TaskManager.Task::(_decref) Task=`cb4210e5-7c4d-4864-a931-46cdff41c960`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:36,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:36,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:36,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:36,670::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:36,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:36,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:36,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:36,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130311 s, 78.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:37,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:37,221::__init__::225::IOProcess::(_processLogs) (540081) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:37,221::__init__::225::IOProcess::(_processLogs) (540081) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:37,221::__init__::225::IOProcess::(_processLogs) DEBUG|(540081) Building response >Thread-27::DEBUG::2014-08-11 17:04:37,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:04:37,222::__init__::225::IOProcess::(_processLogs) (540081) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:37,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:37,280::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:04:37,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000764664 s, 479 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:37,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:37,283::__init__::225::IOProcess::(_processLogs) (540082) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:37,283::__init__::225::IOProcess::(_processLogs) (540082) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:37,283::__init__::225::IOProcess::(_processLogs) DEBUG|(540082) Building response >Thread-19::DEBUG::2014-08-11 17:04:37,283::__init__::225::IOProcess::(_processLogs) (540082) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:37,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:37,284::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:38,833::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:38,834::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) (540083) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:38,835::__init__::225::IOProcess::(_processLogs) (540083) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:38,839::__init__::225::IOProcess::(_processLogs) DEBUG|(540083) Building response >Thread-19::DEBUG::2014-08-11 17:04:38,839::__init__::225::IOProcess::(_processLogs) (540083) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:38,839::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:04:38,839::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:04:38,840::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:04:38,899::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000425276 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:38,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:38,900::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:38,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:38,900::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:38,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:38,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:38,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:38,901::__init__::225::IOProcess::(_processLogs) (540084) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:38,901::__init__::225::IOProcess::(_processLogs) (540084) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:38,901::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540084) Building response >Thread-19::DEBUG::2014-08-11 17:04:38,902::__init__::225::IOProcess::(_processLogs) (540084) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:38,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:38,902::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:38,902::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:38,902::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:04:38,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) (540085) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) (540085) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) (540085) Building response >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) (540085) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:38,903::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) (540086) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:38,904::__init__::225::IOProcess::(_processLogs) (540086) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) (540086) Building response >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) (540086) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:38,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) (540087) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) (540087) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) (540087) Building response >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) (540087) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:38,906::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:04:38,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:39,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559406 s, 18.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:04:40,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`5be15d45-c827-4247-ae51-e2deaa111670`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:04:40,919::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:40,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:40,920::__init__::225::IOProcess::(_processLogs) (540088) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:04:40,920::__init__::225::IOProcess::(_processLogs) (540088) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:04:40,920::__init__::225::IOProcess::(_processLogs) DEBUG|(540088) Building response >Thread-19::DEBUG::2014-08-11 17:04:40,920::__init__::225::IOProcess::(_processLogs) (540088) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:40,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:40,921::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:04:40,921::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:40,921::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:04:40,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:40,922::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10102::INFO::2014-08-11 17:04:40,922::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:04:40,922::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:04:40,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`5be15d45-c827-4247-ae51-e2deaa111670`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:04:40,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:04:40,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`5be15d45-c827-4247-ae51-e2deaa111670`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:04:40,923::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:04:40,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:04:40,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:04:40,924::__init__::225::IOProcess::(_processLogs) (540089) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:04:40,924::task::993::Storage.TaskManager.Task::(_decref) Task=`5be15d45-c827-4247-ae51-e2deaa111670`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:04:40,925::__init__::225::IOProcess::(_processLogs) (540089) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:04:40,925::__init__::225::IOProcess::(_processLogs) (540089) Building response >Thread-19::DEBUG::2014-08-11 17:04:40,925::__init__::225::IOProcess::(_processLogs) (540089) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:40,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:40,925::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:04:40,946::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:04:41,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:41,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152842 s, 67.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:41,670::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:41,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:41,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:41,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:41,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:41,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:43,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:43,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0631295 s, 16.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:04:45,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:45,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0533265 s, 19.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:04:45,450::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:04:46,000::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:04:46,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`84792406-9463-4ea1-b28b-e3692f9b221d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:46,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:04:46,054::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:46,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`84792406-9463-4ea1-b28b-e3692f9b221d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:46,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`84792406-9463-4ea1-b28b-e3692f9b221d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:46,055::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:46,055::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:46,055::task::993::Storage.TaskManager.Task::(_decref) Task=`84792406-9463-4ea1-b28b-e3692f9b221d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:04:46,061::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:04:46,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`5eddf3a7-a73c-461c-9ce6-df9fb1abb414`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:04:46,061::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:04:46,062::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9b634e4b-636c-4f4c-82ff-a3a4974af962`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:04:46,062::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:04:46,062::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:04:46,062::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9b634e4b-636c-4f4c-82ff-a3a4974af962`::Granted request >Thread-10197::DEBUG::2014-08-11 17:04:46,062::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5eddf3a7-a73c-461c-9ce6-df9fb1abb414`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:04:46,062::task::993::Storage.TaskManager.Task::(_decref) Task=`5eddf3a7-a73c-461c-9ce6-df9fb1abb414`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:04:46,082::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:46,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`5eddf3a7-a73c-461c-9ce6-df9fb1abb414`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:46,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`5eddf3a7-a73c-461c-9ce6-df9fb1abb414`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:04:46,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:04:46,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:04:46,083::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:04:46,083::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:04:46,083::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:04:46,083::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:04:46,083::task::993::Storage.TaskManager.Task::(_decref) Task=`5eddf3a7-a73c-461c-9ce6-df9fb1abb414`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:46,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:46,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:46,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:46,683::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:46,683::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:46,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:04:47,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:47,284::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:47,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:47,284::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) (540090) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) (540090) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) DEBUG|(540090) Building response >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) (540090) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:47,285::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:04:47,286::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:04:47,286::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:04:47,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000540214 s, 678 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:47,346::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:47,347::__init__::225::IOProcess::(_processLogs) (540091) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:47,347::__init__::225::IOProcess::(_processLogs) (540091) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:47,347::__init__::225::IOProcess::(_processLogs) DEBUG|(540091) Building response >Thread-19::DEBUG::2014-08-11 17:04:47,347::__init__::225::IOProcess::(_processLogs) (540091) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:47,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:47,348::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:04:47,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:47,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0331361 s, 30.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:48,906::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:48,906::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:48,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) (540092) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) (540092) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) DEBUG|(540092) Building response >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) (540092) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:48,907::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:04:48,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:04:48,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00181403 s, 273 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:48,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:48,969::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:48,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:48,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:48,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:48,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:48,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:48,970::__init__::225::IOProcess::(_processLogs) (540093) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:48,970::__init__::225::IOProcess::(_processLogs) (540093) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:48,970::__init__::225::IOProcess::(_processLogs) (540093) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) (540094) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:48,971::__init__::225::IOProcess::(_processLogs) (540094) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:48,972::__init__::225::IOProcess::(_processLogs) (540094) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:48,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:48,972::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:04:48,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:48,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:48,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:48,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:48,973::__init__::225::IOProcess::(_processLogs) (540095) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:48,973::__init__::225::IOProcess::(_processLogs) (540095) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:48,973::__init__::225::IOProcess::(_processLogs) (540095) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:48,973::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:48,973::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:04:48,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:48,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:48,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:48,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:48,974::__init__::225::IOProcess::(_processLogs) (540096) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:48,975::__init__::225::IOProcess::(_processLogs) (540096) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:48,975::__init__::225::IOProcess::(_processLogs) (540096) Building response >Thread-19::DEBUG::2014-08-11 17:04:48,975::__init__::225::IOProcess::(_processLogs) (540096) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:48,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:48,975::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:04:49,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`12bb4897-3d34-4bfd-b45c-4bbc141b3c12`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:49,113::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:04:49,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540214', 'lastCheck': '1.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00181403', 'lastCheck': '0.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:04:49,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`12bb4897-3d34-4bfd-b45c-4bbc141b3c12`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000540214', 'lastCheck': '1.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00181403', 'lastCheck': '0.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:04:49,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`12bb4897-3d34-4bfd-b45c-4bbc141b3c12`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:49,114::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:49,114::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:49,114::task::993::Storage.TaskManager.Task::(_decref) Task=`12bb4897-3d34-4bfd-b45c-4bbc141b3c12`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:04:49,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:04:49,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:49,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:49,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128022 s, 80.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:04:50,447::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:04:51,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:51,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306112 s, 33.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:51,683::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:51,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:51,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:51,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:51,686::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:51,686::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:04:53,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:53,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300432 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:04:55,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:55,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526143 s, 19.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:04:55,973::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:04:56,533::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:04:56,534::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a0b16f7-c7db-43a7-890d-f763ff496034`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:04:56,534::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:04:56,597::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:56,597::task::1191::Storage.TaskManager.Task::(prepare) Task=`4a0b16f7-c7db-43a7-890d-f763ff496034`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:04:56,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`4a0b16f7-c7db-43a7-890d-f763ff496034`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:04:56,598::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:04:56,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:04:56,598::task::993::Storage.TaskManager.Task::(_decref) Task=`4a0b16f7-c7db-43a7-890d-f763ff496034`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:04:56,604::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:04:56,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ad85811-c8b3-4485-ab4f-1defd110a537`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:04:56,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:04:56,605::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`238b3cfe-e5de-4f36-81bc-5001b8444bb8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:04:56,605::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:04:56,605::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:04:56,605::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`238b3cfe-e5de-4f36-81bc-5001b8444bb8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:04:56,606::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0ad85811-c8b3-4485-ab4f-1defd110a537`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:04:56,606::task::993::Storage.TaskManager.Task::(_decref) Task=`0ad85811-c8b3-4485-ab4f-1defd110a537`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:04:56,624::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:56,624::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ad85811-c8b3-4485-ab4f-1defd110a537`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:04:56,624::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ad85811-c8b3-4485-ab4f-1defd110a537`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:04:56,624::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:04:56,624::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:04:56,625::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:04:56,625::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:04:56,625::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:04:56,625::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:04:56,625::task::993::Storage.TaskManager.Task::(_decref) Task=`0ad85811-c8b3-4485-ab4f-1defd110a537`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:04:56,687::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:56,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:04:56,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:56,690::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:56,690::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:04:56,691::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:04:57,348::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:57,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:57,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:57,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:57,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:57,349::__init__::225::IOProcess::(_processLogs) (540097) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:57,349::__init__::225::IOProcess::(_processLogs) (540097) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:57,349::__init__::225::IOProcess::(_processLogs) (540097) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:57,350::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:04:57,350::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:04:57,411::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0016626 s, 220 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:57,411::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:57,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) (540098) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) (540098) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) (540098) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:57,412::__init__::225::IOProcess::(_processLogs) Generating json... >VM Channels Listener::DEBUG::2014-08-11 17:04:57,462::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:04:57,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:04:57,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129691 s, 79.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:58,975::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:58,975::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) (540099) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) (540099) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) (540099) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:58,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:04:58,977::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:04:59,118::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000907837 s, 545 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:04:59,120::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:04:59,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:59,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:59,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:59,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:59,121::__init__::225::IOProcess::(_processLogs) (540100) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:04:59,121::__init__::225::IOProcess::(_processLogs) (540100) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:04:59,122::__init__::225::IOProcess::(_processLogs) (540100) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:59,122::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:04:59,123::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:04:59,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:59,123::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:59,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) (540101) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) (540101) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) (540101) Building response >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) (540101) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:04:59,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) (540102) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) (540102) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) (540102) Building response >Thread-19::DEBUG::2014-08-11 17:04:59,125::__init__::225::IOProcess::(_processLogs) (540102) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:04:59,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:04:59,127::__init__::225::IOProcess::(_processLogs) (540103) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:04:59,127::__init__::225::IOProcess::(_processLogs) (540103) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:04:59,127::__init__::225::IOProcess::(_processLogs) (540103) Building response >Thread-19::DEBUG::2014-08-11 17:04:59,127::__init__::225::IOProcess::(_processLogs) (540103) Queuing response >Thread-19::DEBUG::2014-08-11 17:04:59,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:04:59,127::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:04:59,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:00,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578521 s, 17.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:05:01,695::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:01,697::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:01,698::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:01,700::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:01,702::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:01,704::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:02,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:02,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299374 s, 34.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:04,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:05:04,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4795332-d943-409e-92f0-492ab684072d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:04,326::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:05:04,326::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0016626', 'lastCheck': '6.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000907837', 'lastCheck': '5.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:04,327::task::1191::Storage.TaskManager.Task::(prepare) Task=`b4795332-d943-409e-92f0-492ab684072d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0016626', 'lastCheck': '6.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000907837', 'lastCheck': '5.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:04,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`b4795332-d943-409e-92f0-492ab684072d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:04,327::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:04,327::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:04,327::task::993::Storage.TaskManager.Task::(_decref) Task=`b4795332-d943-409e-92f0-492ab684072d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:05:04,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0154328 s, 66.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:05:04,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:04,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:05:05,455::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:05:06,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:06,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537916 s, 19.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:05:06,647::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:05:06,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`73d4a995-4b73-43bf-9700-cd9fda4d3e65`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:06,648::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >GuestMonitor-vm::DEBUG::2014-08-11 17:05:06,709::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:06,710::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:06,711::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:06,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:06,713::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:06,714::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::INFO::2014-08-11 17:05:06,722::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:06,723::task::1191::Storage.TaskManager.Task::(prepare) Task=`73d4a995-4b73-43bf-9700-cd9fda4d3e65`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:06,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`73d4a995-4b73-43bf-9700-cd9fda4d3e65`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:06,723::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:06,723::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:06,723::task::993::Storage.TaskManager.Task::(_decref) Task=`73d4a995-4b73-43bf-9700-cd9fda4d3e65`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:05:06,730::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:05:06,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`506d83dc-6f91-4b52-bb76-b6203a80e455`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:05:06,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:05:06,730::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5a5905f6-7279-45f4-9f54-c05b37cfcdd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:05:06,730::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:05:06,730::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:05:06,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5a5905f6-7279-45f4-9f54-c05b37cfcdd4`::Granted request >Thread-10197::DEBUG::2014-08-11 17:05:06,731::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`506d83dc-6f91-4b52-bb76-b6203a80e455`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:05:06,731::task::993::Storage.TaskManager.Task::(_decref) Task=`506d83dc-6f91-4b52-bb76-b6203a80e455`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:05:06,769::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:06,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`506d83dc-6f91-4b52-bb76-b6203a80e455`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:06,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`506d83dc-6f91-4b52-bb76-b6203a80e455`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:05:06,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:05:06,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:05:06,770::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:05:06,770::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:05:06,770::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:05:06,770::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:05:06,770::task::993::Storage.TaskManager.Task::(_decref) Task=`506d83dc-6f91-4b52-bb76-b6203a80e455`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:05:07,413::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:07,413::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:07,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:07,413::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:07,413::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) (540104) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) (540104) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) DEBUG|(540104) Building response >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) (540104) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:07,414::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:07,415::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:05:07,415::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:05:07,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000708385 s, 517 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:07,477::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:07,477::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:07,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:07,477::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:07,477::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:07,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:07,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:07,478::__init__::225::IOProcess::(_processLogs) (540105) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:07,478::__init__::225::IOProcess::(_processLogs) (540105) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:07,478::__init__::225::IOProcess::(_processLogs) DEBUG|(540105) Building response >Thread-19::DEBUG::2014-08-11 17:05:07,478::__init__::225::IOProcess::(_processLogs) (540105) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:07,479::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:07,479::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:05:08,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:08,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133423 s, 76.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:09,127::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) (540106) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:09,128::__init__::225::IOProcess::(_processLogs) (540106) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:09,130::__init__::225::IOProcess::(_processLogs) DEBUG|(540106) Building response >Thread-19::DEBUG::2014-08-11 17:05:09,130::__init__::225::IOProcess::(_processLogs) (540106) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:09,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:09,131::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:05:09,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:05:09,191::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00171937 s, 288 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) (540107) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:09,192::__init__::225::IOProcess::(_processLogs) (540107) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:09,193::__init__::225::IOProcess::(_processLogs) DEBUG|(540107) Building response >Thread-19::DEBUG::2014-08-11 17:05:09,193::__init__::225::IOProcess::(_processLogs) (540107) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:09,193::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:09,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) (540108) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) (540108) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) (540108) Building response >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) (540108) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:05:09,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) (540109) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) (540109) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) (540109) Building response >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) (540109) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:09,196::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:09,197::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:09,197::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:05:09,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:09,197::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:09,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) (540110) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) (540110) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) (540110) Building response >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) (540110) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:09,198::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:05:10,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:10,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129191 s, 79.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:05:10,980::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:05:11,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:11,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:11,720::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:11,720::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:11,722::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:11,722::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:12,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:12,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.066559 s, 15.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:14,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:14,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556172 s, 18.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:05:15,492::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:16,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:16,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:16,726::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:16,727::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:16,727::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:16,727::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:16,865::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:05:16,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`d24ceb4e-6363-40f2-8c6a-9388adf59ccd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:16,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:05:16,882::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:16,882::task::1191::Storage.TaskManager.Task::(prepare) Task=`d24ceb4e-6363-40f2-8c6a-9388adf59ccd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:16,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`d24ceb4e-6363-40f2-8c6a-9388adf59ccd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:16,882::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:16,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:16,883::task::993::Storage.TaskManager.Task::(_decref) Task=`d24ceb4e-6363-40f2-8c6a-9388adf59ccd`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:05:16,889::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:05:16,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`5522421e-98ed-4e82-897e-9999b1fbcab2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:05:16,889::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:05:16,889::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`259b7559-828f-4a89-ad2a-ab7f35d2f5ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:05:16,890::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:05:16,890::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:05:16,890::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`259b7559-828f-4a89-ad2a-ab7f35d2f5ef`::Granted request >Thread-10197::DEBUG::2014-08-11 17:05:16,890::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5522421e-98ed-4e82-897e-9999b1fbcab2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:05:16,890::task::993::Storage.TaskManager.Task::(_decref) Task=`5522421e-98ed-4e82-897e-9999b1fbcab2`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:05:16,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10197::INFO::2014-08-11 17:05:16,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:16,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`5522421e-98ed-4e82-897e-9999b1fbcab2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:16,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`5522421e-98ed-4e82-897e-9999b1fbcab2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:05:16,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:05:16,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:05:16,970::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:05:16,970::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:05:16,970::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:05:16,970::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:05:16,970::task::993::Storage.TaskManager.Task::(_decref) Task=`5522421e-98ed-4e82-897e-9999b1fbcab2`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:05:17,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554763 s, 18.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:17,479::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:17,479::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) (540111) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:17,480::__init__::225::IOProcess::(_processLogs) (540111) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:17,481::__init__::225::IOProcess::(_processLogs) DEBUG|(540111) Building response >Thread-19::DEBUG::2014-08-11 17:05:17,481::__init__::225::IOProcess::(_processLogs) (540111) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:17,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:17,482::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:05:17,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:05:17,542::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000365198 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:17,542::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:17,543::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:17,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:17,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:17,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:17,543::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:17,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:17,544::__init__::225::IOProcess::(_processLogs) (540112) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:17,544::__init__::225::IOProcess::(_processLogs) (540112) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:17,544::__init__::225::IOProcess::(_processLogs) (540112) Building response >Thread-19::DEBUG::2014-08-11 17:05:17,544::__init__::225::IOProcess::(_processLogs) (540112) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:17,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:17,544::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:05:19,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:19,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044912 s, 22.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:19,198::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:19,198::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:19,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:19,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:19,199::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:19,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:05:19,199::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:05:19,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:19,258::__init__::225::IOProcess::(_processLogs) (540113) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:19,258::__init__::225::IOProcess::(_processLogs) (540113) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:19,258::__init__::225::IOProcess::(_processLogs) (540113) Building response >Thread-19::DEBUG::2014-08-11 17:05:19,258::__init__::225::IOProcess::(_processLogs) (540113) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:19,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:19,259::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:05:19,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00110465 s, 448 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:19,260::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:19,260::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) (540114) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) (540114) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:19,261::__init__::225::IOProcess::(_processLogs) DEBUG|(540114) Building response >Thread-19::DEBUG::2014-08-11 17:05:19,262::__init__::225::IOProcess::(_processLogs) (540114) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:19,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:19,262::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:05:19,262::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:19,262::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:05:19,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) (540115) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) (540115) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) (540115) Building response >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) (540115) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:19,263::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:19,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) (540116) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) (540116) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) (540116) Building response >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) (540116) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:19,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) (540117) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) (540117) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) (540117) Building response >Thread-19::DEBUG::2014-08-11 17:05:19,266::__init__::225::IOProcess::(_processLogs) (540117) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:19,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:19,267::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:05:19,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`767ddde2-f09e-412e-8f1f-cd3bf8e22d3a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:19,547::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:05:19,547::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365198', 'lastCheck': '2.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110465', 'lastCheck': '0.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:19,547::task::1191::Storage.TaskManager.Task::(prepare) Task=`767ddde2-f09e-412e-8f1f-cd3bf8e22d3a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365198', 'lastCheck': '2.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110465', 'lastCheck': '0.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:19,547::task::595::Storage.TaskManager.Task::(_updateState) Task=`767ddde2-f09e-412e-8f1f-cd3bf8e22d3a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:19,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:19,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:19,547::task::993::Storage.TaskManager.Task::(_decref) Task=`767ddde2-f09e-412e-8f1f-cd3bf8e22d3a`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:05:19,561::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:19,562::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:05:20,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`137acb8a-f3f1-4b74-811a-d9c03a466ab9`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:05:20,458::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:20,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:20,459::__init__::225::IOProcess::(_processLogs) (540118) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:05:20,459::__init__::225::IOProcess::(_processLogs) (540118) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:05:20,462::__init__::225::IOProcess::(_processLogs) DEBUG|(540118) Building response >Thread-19::DEBUG::2014-08-11 17:05:20,462::__init__::225::IOProcess::(_processLogs) (540118) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:20,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:20,462::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:05:20,463::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:20,463::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:05:20,463::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:20,463::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:05:20,463::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:05:20,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:05:20,464::task::1191::Storage.TaskManager.Task::(prepare) Task=`137acb8a-f3f1-4b74-811a-d9c03a466ab9`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:05:20,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:05:20,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`137acb8a-f3f1-4b74-811a-d9c03a466ab9`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:05:20,465::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:05:20,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:05:20,465::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:05:20,465::__init__::225::IOProcess::(_processLogs) (540119) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:05:20,465::task::993::Storage.TaskManager.Task::(_decref) Task=`137acb8a-f3f1-4b74-811a-d9c03a466ab9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:05:20,466::__init__::225::IOProcess::(_processLogs) (540119) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:05:20,466::__init__::225::IOProcess::(_processLogs) (540119) Building response >Thread-19::DEBUG::2014-08-11 17:05:20,466::__init__::225::IOProcess::(_processLogs) (540119) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:20,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:20,466::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:05:20,487::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:05:21,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:21,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370778 s, 27.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:21,729::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:21,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:21,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:21,733::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:21,733::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:21,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:23,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:23,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0449778 s, 22.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:25,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:25,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462969 s, 22.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:05:25,988::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:26,735::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:26,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:26,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:26,739::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:26,740::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:26,740::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:27,025::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:05:27,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`45682052-33cc-4cd0-92e2-4c1f3fbcf490`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:27,025::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:05:27,069::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:27,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`45682052-33cc-4cd0-92e2-4c1f3fbcf490`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:27,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`45682052-33cc-4cd0-92e2-4c1f3fbcf490`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:27,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:27,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:27,069::task::993::Storage.TaskManager.Task::(_decref) Task=`45682052-33cc-4cd0-92e2-4c1f3fbcf490`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:05:27,076::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:05:27,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac683fd-84f0-440b-88dc-d1829bed779c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:05:27,076::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:05:27,076::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3b804239-e513-49b4-86e9-d27ade452c1d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:05:27,076::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:05:27,077::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:05:27,077::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3b804239-e513-49b4-86e9-d27ade452c1d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:05:27,077::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4ac683fd-84f0-440b-88dc-d1829bed779c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:05:27,077::task::993::Storage.TaskManager.Task::(_decref) Task=`4ac683fd-84f0-440b-88dc-d1829bed779c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:05:27,094::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:27,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ac683fd-84f0-440b-88dc-d1829bed779c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:27,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac683fd-84f0-440b-88dc-d1829bed779c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:05:27,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:05:27,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:05:27,094::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:05:27,094::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:05:27,094::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:05:27,094::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:05:27,095::task::993::Storage.TaskManager.Task::(_decref) Task=`4ac683fd-84f0-440b-88dc-d1829bed779c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:05:27,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:05:27,545::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:27,546::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:27,546::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:27,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:27,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:27,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:27,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:27,549::__init__::225::IOProcess::(_processLogs) (540120) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:27,549::__init__::225::IOProcess::(_processLogs) (540120) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:27,550::__init__::225::IOProcess::(_processLogs) DEBUG|(540120) Building response >VM Channels Listener::DEBUG::2014-08-11 17:05:27,551::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-27::DEBUG::2014-08-11 17:05:27,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:05:27,552::__init__::225::IOProcess::(_processLogs) (540120) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:27,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:27,612::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:05:27,613::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000969778 s, 377 kB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:27,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799384 s, 12.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:27,615::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:27,615::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:27,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:27,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:27,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:27,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:27,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:27,618::__init__::225::IOProcess::(_processLogs) (540121) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:27,619::__init__::225::IOProcess::(_processLogs) (540121) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:27,620::__init__::225::IOProcess::(_processLogs) DEBUG|(540121) Building response >Thread-19::DEBUG::2014-08-11 17:05:27,621::__init__::225::IOProcess::(_processLogs) (540121) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:27,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:27,622::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) (540122) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:29,267::__init__::225::IOProcess::(_processLogs) (540122) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:29,275::__init__::225::IOProcess::(_processLogs) DEBUG|(540122) Building response >Thread-19::DEBUG::2014-08-11 17:05:29,275::__init__::225::IOProcess::(_processLogs) (540122) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:29,275::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:05:29,276::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:05:29,276::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:05:29,336::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00107338 s, 461 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) (540123) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:29,337::__init__::225::IOProcess::(_processLogs) (540123) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:29,338::__init__::225::IOProcess::(_processLogs) DEBUG|(540123) Building response >Thread-19::DEBUG::2014-08-11 17:05:29,338::__init__::225::IOProcess::(_processLogs) (540123) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:29,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:29,338::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:05:29,339::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:29,339::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:05:29,339::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:29,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:29,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:29,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) (540124) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) (540124) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) (540124) Building response >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) (540124) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:29,340::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) (540125) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) (540125) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) (540125) Building response >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) (540125) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:29,341::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) (540126) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:29,342::__init__::225::IOProcess::(_processLogs) (540126) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:29,343::__init__::225::IOProcess::(_processLogs) DEBUG|(540126) Building response >Thread-19::DEBUG::2014-08-11 17:05:29,343::__init__::225::IOProcess::(_processLogs) (540126) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:29,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:29,343::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:05:29,629::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:29,741::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537128 s, 19.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:31,742::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:31,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:31,747::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:31,748::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:31,750::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:05:31,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:31,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:31,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537195 s, 19.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:33,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:34,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0255448 s, 40.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:05:34,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`60433e75-4ab4-4889-b1ae-f97ea772270f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:34,725::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:05:34,725::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000969778', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107338', 'lastCheck': '5.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:34,725::task::1191::Storage.TaskManager.Task::(prepare) Task=`60433e75-4ab4-4889-b1ae-f97ea772270f`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000969778', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107338', 'lastCheck': '5.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:34,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`60433e75-4ab4-4889-b1ae-f97ea772270f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:34,725::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:34,725::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:34,725::task::993::Storage.TaskManager.Task::(_decref) Task=`60433e75-4ab4-4889-b1ae-f97ea772270f`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:05:34,739::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:34,739::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:05:35,496::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:05:36,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:36,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386725 s, 26.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:36,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:36,752::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:36,752::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:36,817::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:36,818::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:36,818::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:37,126::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:05:37,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`808d0f01-8518-44fa-be71-8ae82cf91791`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:37,126::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:05:37,184::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:37,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`808d0f01-8518-44fa-be71-8ae82cf91791`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:37,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`808d0f01-8518-44fa-be71-8ae82cf91791`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:37,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:37,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:37,185::task::993::Storage.TaskManager.Task::(_decref) Task=`808d0f01-8518-44fa-be71-8ae82cf91791`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:05:37,191::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:05:37,191::task::595::Storage.TaskManager.Task::(_updateState) Task=`f981a0cf-23f9-4c52-8598-1a80d8f207ae`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:05:37,192::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:05:37,192::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`85004077-e7f6-43c2-9aa9-81cb13c26a04`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:05:37,192::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:05:37,192::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:05:37,192::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`85004077-e7f6-43c2-9aa9-81cb13c26a04`::Granted request >Thread-10197::DEBUG::2014-08-11 17:05:37,192::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f981a0cf-23f9-4c52-8598-1a80d8f207ae`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:05:37,192::task::993::Storage.TaskManager.Task::(_decref) Task=`f981a0cf-23f9-4c52-8598-1a80d8f207ae`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:05:37,251::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:37,251::task::1191::Storage.TaskManager.Task::(prepare) Task=`f981a0cf-23f9-4c52-8598-1a80d8f207ae`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:37,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`f981a0cf-23f9-4c52-8598-1a80d8f207ae`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:05:37,251::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:05:37,251::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:05:37,251::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:05:37,252::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:05:37,252::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:05:37,252::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:05:37,252::task::993::Storage.TaskManager.Task::(_decref) Task=`f981a0cf-23f9-4c52-8598-1a80d8f207ae`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:37,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:37,622::__init__::225::IOProcess::(_processLogs) (540127) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:37,622::__init__::225::IOProcess::(_processLogs) (540127) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:37,622::__init__::225::IOProcess::(_processLogs) DEBUG|(540127) Building response >Thread-19::DEBUG::2014-08-11 17:05:37,622::__init__::225::IOProcess::(_processLogs) (540127) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:37,622::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:05:37,623::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:05:37,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:05:37,683::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000890352 s, 411 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:37,683::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:05:37,684::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:37,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:37,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:37,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:37,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) (540128) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) (540128) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) (540128) Building response >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) (540128) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:37,685::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:05:38,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:38,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130937 s, 78.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) (540129) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) (540129) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) (540129) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:39,344::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:05:39,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:05:39,407::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00199053 s, 249 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:39,408::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:39,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:39,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:39,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:39,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:39,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:39,409::__init__::225::IOProcess::(_processLogs) (540130) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:39,409::__init__::225::IOProcess::(_processLogs) (540130) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:39,409::__init__::225::IOProcess::(_processLogs) (540130) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:39,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) (540131) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:39,410::__init__::225::IOProcess::(_processLogs) (540131) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) (540131) Building response >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) (540131) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:39,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) (540132) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) (540132) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) (540132) Building response >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) (540132) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:39,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:39,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:39,413::__init__::225::IOProcess::(_processLogs) (540133) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:39,413::__init__::225::IOProcess::(_processLogs) (540133) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:39,413::__init__::225::IOProcess::(_processLogs) (540133) Building response >Thread-19::DEBUG::2014-08-11 17:05:39,413::__init__::225::IOProcess::(_processLogs) (540133) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:39,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:39,414::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:05:40,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:40,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139375 s, 73.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:05:40,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`08755138-907d-46ea-9d27-4f29f90b8746`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:05:40,990::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) (540134) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:05:40,991::__init__::225::IOProcess::(_processLogs) (540134) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:05:40,992::__init__::225::IOProcess::(_processLogs) (540134) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:40,992::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:40,993::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:05:40,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:40,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:05:40,993::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:05:40,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:05:40,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`08755138-907d-46ea-9d27-4f29f90b8746`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:05:40,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:05:40,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`08755138-907d-46ea-9d27-4f29f90b8746`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:05:40,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:05:40,995::__init__::225::IOProcess::(_processLogs) (540135) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:05:40,995::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:05:40,996::__init__::225::IOProcess::(_processLogs) (540135) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:05:40,996::task::993::Storage.TaskManager.Task::(_decref) Task=`08755138-907d-46ea-9d27-4f29f90b8746`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:05:40,996::__init__::225::IOProcess::(_processLogs) (540135) Building response >Thread-19::DEBUG::2014-08-11 17:05:40,996::__init__::225::IOProcess::(_processLogs) (540135) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:40,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:40,996::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:05:41,017::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:41,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:41,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:41,759::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:41,824::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:41,824::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:41,825::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:42,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:42,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122194 s, 83.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:44,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:44,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.071191 s, 14.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:05:45,571::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:05:46,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:46,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179416 s, 57.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:46,764::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:46,765::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:46,765::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:46,829::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:46,830::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:46,830::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:47,282::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:05:47,283::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba7a8be8-b8bc-4d2b-9c03-3ac9f2484149`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:47,283::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:05:47,296::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:47,296::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba7a8be8-b8bc-4d2b-9c03-3ac9f2484149`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:47,296::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba7a8be8-b8bc-4d2b-9c03-3ac9f2484149`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:47,296::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:47,296::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:47,297::task::993::Storage.TaskManager.Task::(_decref) Task=`ba7a8be8-b8bc-4d2b-9c03-3ac9f2484149`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:05:47,303::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:05:47,303::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed8e4c53-f385-4c6b-8b6e-a368f8c5424f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:05:47,303::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:05:47,303::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c26d7d1b-0490-42d7-ade1-3c8e5df8f26c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:05:47,304::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:05:47,304::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:05:47,304::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c26d7d1b-0490-42d7-ade1-3c8e5df8f26c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:05:47,304::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ed8e4c53-f385-4c6b-8b6e-a368f8c5424f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:05:47,304::task::993::Storage.TaskManager.Task::(_decref) Task=`ed8e4c53-f385-4c6b-8b6e-a368f8c5424f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:05:47,320::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:47,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed8e4c53-f385-4c6b-8b6e-a368f8c5424f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:47,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed8e4c53-f385-4c6b-8b6e-a368f8c5424f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:05:47,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:05:47,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:05:47,320::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:05:47,321::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:05:47,321::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:05:47,321::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:05:47,321::task::993::Storage.TaskManager.Task::(_decref) Task=`ed8e4c53-f385-4c6b-8b6e-a368f8c5424f`::ref 0 aborting False >Thread-27::DEBUG::2014-08-11 17:05:47,685::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:05:47,686::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:05:47,686::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:47,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) (540136) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) (540137) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:05:47,687::__init__::225::IOProcess::(_processLogs) (540137) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:05:47,698::__init__::225::IOProcess::(_processLogs) (540136) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,698::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:05:47,708::__init__::225::IOProcess::(_processLogs) (540137) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:05:47,712::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) (540138) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:05:47,712::__init__::225::IOProcess::(_processLogs) (540138) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:05:47,730::__init__::225::IOProcess::(_processLogs) (540138) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,730::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:05:47,730::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) (540139) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:05:47,731::__init__::225::IOProcess::(_processLogs) (540139) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:05:47,733::__init__::225::IOProcess::(_processLogs) (540139) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,733::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:05:47,733::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:05:47,734::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:05:47,734::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:47,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) (540140) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) (540140) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) (540140) Building response >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) (540140) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,736::__init__::225::IOProcess::(_processLogs) (540141) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:05:47,736::__init__::225::IOProcess::(_processLogs) (540141) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:05:47,736::__init__::225::IOProcess::(_processLogs) (540141) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,736::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-27::DEBUG::2014-08-11 17:05:47,736::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-27::INFO::2014-08-11 17:05:47,736::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-27::INFO::2014-08-11 17:05:47,737::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) (540142) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) (540142) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:47,737::__init__::225::IOProcess::(_processLogs) (540142) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,738::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:05:47,738::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:05:47,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00100413 s, 364 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:47,798::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) (540143) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) (540143) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:47,799::__init__::225::IOProcess::(_processLogs) (540143) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:47,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:47,800::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:05:48,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:48,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520658 s, 19.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) (540144) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:49,414::__init__::225::IOProcess::(_processLogs) (540144) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:49,415::__init__::225::IOProcess::(_processLogs) (540144) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:49,415::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:05:49,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:05:49,478::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00272306 s, 182 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) (540145) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:49,479::__init__::225::IOProcess::(_processLogs) (540145) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:49,482::__init__::225::IOProcess::(_processLogs) (540145) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:49,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:49,482::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:05:49,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:49,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:49,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:49,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:49,483::__init__::225::IOProcess::(_processLogs) (540146) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:49,483::__init__::225::IOProcess::(_processLogs) (540146) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:49,485::__init__::225::IOProcess::(_processLogs) (540146) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:49,485::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:49,485::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:05:49,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:49,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:49,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:49,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:49,486::__init__::225::IOProcess::(_processLogs) (540147) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:49,486::__init__::225::IOProcess::(_processLogs) (540147) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:49,487::__init__::225::IOProcess::(_processLogs) (540147) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:49,488::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:49,488::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:05:49,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:49,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) (540148) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) (540148) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) (540148) Building response >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) (540148) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:49,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:49,490::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:05:49,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`73b48563-d8a1-435d-b223-a21dedb0b61c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:49,905::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:05:49,905::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100413', 'lastCheck': '2.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272306', 'lastCheck': '0.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:49,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`73b48563-d8a1-435d-b223-a21dedb0b61c`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00100413', 'lastCheck': '2.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272306', 'lastCheck': '0.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:05:49,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`73b48563-d8a1-435d-b223-a21dedb0b61c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:49,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:49,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:49,906::task::993::Storage.TaskManager.Task::(_decref) Task=`73b48563-d8a1-435d-b223-a21dedb0b61c`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:05:49,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:05:49,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:05:50,526::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:05:50,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:50,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441916 s, 23.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:51,770::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:51,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:51,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:51,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:51,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:51,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:52,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:52,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046123 s, 22.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:05:54,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:55,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0595788 s, 17.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:05:56,033::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:56,772::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:56,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:05:56,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:56,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:56,840::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:05:56,840::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:05:57,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:57,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258826 s, 39.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:05:57,352::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:05:57,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`e47b97af-7d40-4be0-bc2b-2cc3fbd95a8c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:05:57,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:05:57,431::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:57,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`e47b97af-7d40-4be0-bc2b-2cc3fbd95a8c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:05:57,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`e47b97af-7d40-4be0-bc2b-2cc3fbd95a8c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:05:57,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:05:57,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:05:57,431::task::993::Storage.TaskManager.Task::(_decref) Task=`e47b97af-7d40-4be0-bc2b-2cc3fbd95a8c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:05:57,438::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:05:57,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f3b2cf0-f3f1-4d2e-880b-6e0baed74030`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:05:57,438::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:05:57,438::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`25d6a56b-0465-4753-befa-89ea45e4221d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:05:57,438::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:05:57,439::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:05:57,439::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`25d6a56b-0465-4753-befa-89ea45e4221d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:05:57,439::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2f3b2cf0-f3f1-4d2e-880b-6e0baed74030`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:05:57,439::task::993::Storage.TaskManager.Task::(_decref) Task=`2f3b2cf0-f3f1-4d2e-880b-6e0baed74030`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:05:57,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:57,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f3b2cf0-f3f1-4d2e-880b-6e0baed74030`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:05:57,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f3b2cf0-f3f1-4d2e-880b-6e0baed74030`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:05:57,456::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:05:57,456::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:05:57,456::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:05:57,456::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:05:57,456::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:05:57,456::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:05:57,456::task::993::Storage.TaskManager.Task::(_decref) Task=`2f3b2cf0-f3f1-4d2e-880b-6e0baed74030`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:05:57,604::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) (540149) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:57,801::__init__::225::IOProcess::(_processLogs) (540149) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:57,802::__init__::225::IOProcess::(_processLogs) (540149) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:57,802::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:05:57,803::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:05:57,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000379804 s, 964 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:57,862::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:57,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:57,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:57,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:57,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:57,863::__init__::225::IOProcess::(_processLogs) (540150) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:57,863::__init__::225::IOProcess::(_processLogs) (540150) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:57,864::__init__::225::IOProcess::(_processLogs) (540150) Building response >Thread-19::DEBUG::2014-08-11 17:05:57,864::__init__::225::IOProcess::(_processLogs) (540150) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:57,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:57,864::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:05:59,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:05:59,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508228 s, 20.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) (540151) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) (540151) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:59,490::__init__::225::IOProcess::(_processLogs) (540151) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:59,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:05:59,491::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:05:59,492::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:05:59,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00110994 s, 446 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) (540152) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:05:59,554::__init__::225::IOProcess::(_processLogs) (540152) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:05:59,555::__init__::225::IOProcess::(_processLogs) (540152) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:59,555::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:59,555::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:05:59,555::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:05:59,555::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:59,555::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) (540153) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) (540153) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) (540153) Building response >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) (540153) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:59,556::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) (540154) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:59,557::__init__::225::IOProcess::(_processLogs) (540154) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) (540154) Building response >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) (540154) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:05:59,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:05:59,559::__init__::225::IOProcess::(_processLogs) (540155) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:05:59,559::__init__::225::IOProcess::(_processLogs) (540155) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:05:59,559::__init__::225::IOProcess::(_processLogs) (540155) Building response >Thread-19::DEBUG::2014-08-11 17:05:59,559::__init__::225::IOProcess::(_processLogs) (540155) Queuing response >Thread-19::DEBUG::2014-08-11 17:05:59,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:05:59,559::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:06:01,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:01,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177325 s, 57.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:01,778::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:01,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:01,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:01,847::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:01,848::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:01,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:03,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:03,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0656995 s, 15.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:06:05,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`d45d0f71-ee03-47d5-b98e-4216b1c27fa9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:05,056::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:06:05,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379804', 'lastCheck': '7.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110994', 'lastCheck': '5.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:05,056::task::1191::Storage.TaskManager.Task::(prepare) Task=`d45d0f71-ee03-47d5-b98e-4216b1c27fa9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000379804', 'lastCheck': '7.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110994', 'lastCheck': '5.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:05,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`d45d0f71-ee03-47d5-b98e-4216b1c27fa9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:05,056::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:05,056::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:05,056::task::993::Storage.TaskManager.Task::(_decref) Task=`d45d0f71-ee03-47d5-b98e-4216b1c27fa9`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:06:05,070::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:06:05,071::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:06:05,534::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:06:05,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:05,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137857 s, 74.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:06,787::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:06,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:06,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:06,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:06,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:06,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:06:07,542::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:06:07,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`159a5010-6a59-475f-8fb5-841ff9c643e9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:07,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:06:07,591::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:07,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`159a5010-6a59-475f-8fb5-841ff9c643e9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:07,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`159a5010-6a59-475f-8fb5-841ff9c643e9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:07,591::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:07,591::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:07,591::task::993::Storage.TaskManager.Task::(_decref) Task=`159a5010-6a59-475f-8fb5-841ff9c643e9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:06:07,598::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:06:07,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`33bb8fdf-2188-4e1a-b4e5-db50812ab8e2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:06:07,598::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:06:07,598::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c3368f4-24fa-4521-ba4a-99adf6a904c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:06:07,599::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:06:07,599::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:06:07,599::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c3368f4-24fa-4521-ba4a-99adf6a904c7`::Granted request >Thread-10197::DEBUG::2014-08-11 17:06:07,599::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`33bb8fdf-2188-4e1a-b4e5-db50812ab8e2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:06:07,599::task::993::Storage.TaskManager.Task::(_decref) Task=`33bb8fdf-2188-4e1a-b4e5-db50812ab8e2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:06:07,615::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:07,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`33bb8fdf-2188-4e1a-b4e5-db50812ab8e2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:07,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`33bb8fdf-2188-4e1a-b4e5-db50812ab8e2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:06:07,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:06:07,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:06:07,616::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:06:07,616::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:06:07,616::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:06:07,616::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:06:07,616::task::993::Storage.TaskManager.Task::(_decref) Task=`33bb8fdf-2188-4e1a-b4e5-db50812ab8e2`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:06:07,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:07,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497908 s, 20.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) (540156) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:07,864::__init__::225::IOProcess::(_processLogs) (540156) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:07,865::__init__::225::IOProcess::(_processLogs) (540156) Queuing response >Thread-27::DEBUG::2014-08-11 17:06:07,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:06:07,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:07,925::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:06:07,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000338086 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) (540157) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:07,926::__init__::225::IOProcess::(_processLogs) (540157) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:07,927::__init__::225::IOProcess::(_processLogs) (540157) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:07,927::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:07,927::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:09,559::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:09,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:09,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:09,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:09,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:09,560::__init__::225::IOProcess::(_processLogs) (540158) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:09,560::__init__::225::IOProcess::(_processLogs) (540158) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:09,560::__init__::225::IOProcess::(_processLogs) (540158) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:09,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:06:09,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:06:09,561::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:06:09,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00243858 s, 203 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:09,622::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:09,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:09,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:09,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:09,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:09,623::__init__::225::IOProcess::(_processLogs) (540159) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:09,623::__init__::225::IOProcess::(_processLogs) (540159) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:09,623::__init__::225::IOProcess::(_processLogs) (540159) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:09,624::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:09,624::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:06:09,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:09,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:09,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) (540160) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) (540160) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) (540160) Building response >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) (540160) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:09,625::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) (540161) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) (540161) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) (540161) Building response >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) (540161) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:09,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:09,627::__init__::225::IOProcess::(_processLogs) (540162) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:09,628::__init__::225::IOProcess::(_processLogs) (540162) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:09,628::__init__::225::IOProcess::(_processLogs) (540162) Building response >Thread-19::DEBUG::2014-08-11 17:06:09,628::__init__::225::IOProcess::(_processLogs) (540162) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:09,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:09,628::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:06:09,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:09,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171047 s, 59.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:06:11,069::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:11,794::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:11,794::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:11,795::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:11,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:06:11,880::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:11,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:11,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:11,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501866 s, 20.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:06:13,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:14,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315386 s, 32.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:06:15,625::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:06:16,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:16,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655981 s, 15.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:16,800::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:16,801::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:16,801::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:16,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:16,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:16,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:06:17,651::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:06:17,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a579db6-a371-4407-b5fb-444e7d727610`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:17,652::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:06:17,666::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:17,666::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a579db6-a371-4407-b5fb-444e7d727610`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:17,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a579db6-a371-4407-b5fb-444e7d727610`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:17,666::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:17,666::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:17,666::task::993::Storage.TaskManager.Task::(_decref) Task=`1a579db6-a371-4407-b5fb-444e7d727610`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:06:17,672::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:06:17,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c035b30-a0b6-4253-9098-53d257cfdf04`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:06:17,673::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:06:17,673::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`887da530-2b56-4e46-988b-2ceeef67ff8c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:06:17,673::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:06:17,673::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:06:17,673::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`887da530-2b56-4e46-988b-2ceeef67ff8c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:06:17,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7c035b30-a0b6-4253-9098-53d257cfdf04`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:06:17,674::task::993::Storage.TaskManager.Task::(_decref) Task=`7c035b30-a0b6-4253-9098-53d257cfdf04`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:06:17,689::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:17,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c035b30-a0b6-4253-9098-53d257cfdf04`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621450100736', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:17,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c035b30-a0b6-4253-9098-53d257cfdf04`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:06:17,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:06:17,690::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:06:17,690::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:06:17,690::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:06:17,690::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:06:17,690::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:06:17,690::task::993::Storage.TaskManager.Task::(_decref) Task=`7c035b30-a0b6-4253-9098-53d257cfdf04`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) (540163) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:17,928::__init__::225::IOProcess::(_processLogs) (540163) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:17,931::__init__::225::IOProcess::(_processLogs) (540163) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:17,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:06:17,931::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:06:17,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000372981 s, 981 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:17,990::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:17,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:17,990::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) (540164) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) (540164) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) (540164) Building response >Thread-19::DEBUG::2014-08-11 17:06:17,991::__init__::225::IOProcess::(_processLogs) DEBUG|(540164) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:17,992::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:17,992::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:06:18,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:18,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0231335 s, 44.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:19,628::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:19,628::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:19,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:19,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:19,628::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:19,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:19,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:19,629::__init__::225::IOProcess::(_processLogs) (540165) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:19,629::__init__::225::IOProcess::(_processLogs) (540165) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:19,631::__init__::225::IOProcess::(_processLogs) DEBUG|(540165) Building response >Thread-19::DEBUG::2014-08-11 17:06:19,631::__init__::225::IOProcess::(_processLogs) (540165) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:19,632::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:19,632::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:06:19,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:06:19,693::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00136204 s, 363 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:19,693::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:19,693::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:19,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:19,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:19,694::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:19,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:19,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:19,694::__init__::225::IOProcess::(_processLogs) (540166) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:19,694::__init__::225::IOProcess::(_processLogs) (540166) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:19,694::__init__::225::IOProcess::(_processLogs) DEBUG|(540166) Building response >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) (540166) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:19,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) (540167) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) (540167) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) (540167) Building response >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) (540167) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:19,696::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) (540168) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:19,697::__init__::225::IOProcess::(_processLogs) (540168) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) (540168) Building response >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) (540168) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:19,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) (540169) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) (540169) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) (540169) Building response >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) (540169) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:19,699::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:06:20,203::task::595::Storage.TaskManager.Task::(_updateState) Task=`4807b590-3541-4632-94ba-a41f7152b3ac`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:20,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:06:20,203::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372981', 'lastCheck': '2.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136204', 'lastCheck': '0.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:20,203::task::1191::Storage.TaskManager.Task::(prepare) Task=`4807b590-3541-4632-94ba-a41f7152b3ac`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372981', 'lastCheck': '2.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136204', 'lastCheck': '0.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:20,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`4807b590-3541-4632-94ba-a41f7152b3ac`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:20,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:20,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:20,204::task::993::Storage.TaskManager.Task::(_decref) Task=`4807b590-3541-4632-94ba-a41f7152b3ac`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:06:20,216::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:06:20,217::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:20,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:20,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128085 s, 79.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:06:20,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba77385-d07b-4d9e-b649-9e6e98a0d9a0`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:06:20,537::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:06:20,537::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:20,537::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:06:20,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:20,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:20,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:20,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:20,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:20,538::__init__::225::IOProcess::(_processLogs) (540170) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:06:20,538::__init__::225::IOProcess::(_processLogs) (540170) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:06:20,542::__init__::225::IOProcess::(_processLogs) DEBUG|(540170) Building response >Thread-19::DEBUG::2014-08-11 17:06:20,542::__init__::225::IOProcess::(_processLogs) (540170) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:20,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:20,543::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:06:20,543::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:20,543::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:06:20,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:20,544::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:06:20,544::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:06:20,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:06:20,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ba77385-d07b-4d9e-b649-9e6e98a0d9a0`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:06:20,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:06:20,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba77385-d07b-4d9e-b649-9e6e98a0d9a0`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:06:20,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:06:20,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:06:20,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:06:20,546::__init__::225::IOProcess::(_processLogs) (540171) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:06:20,546::task::993::Storage.TaskManager.Task::(_decref) Task=`6ba77385-d07b-4d9e-b649-9e6e98a0d9a0`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:20,547::__init__::225::IOProcess::(_processLogs) (540171) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:06:20,547::__init__::225::IOProcess::(_processLogs) (540171) Building response >Thread-19::DEBUG::2014-08-11 17:06:20,547::__init__::225::IOProcess::(_processLogs) (540171) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:20,547::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:20,547::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:06:20,568::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:21,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:21,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:21,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:21,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:21,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:21,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:22,336::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:22,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0375626 s, 27.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:06:24,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:24,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124048 s, 82.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:06:26,077::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:06:26,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:26,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0656838 s, 15.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:26,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:26,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:26,813::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:26,899::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:26,900::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:26,900::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:06:27,637::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:06:27,719::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:06:27,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`815b0f05-89a6-4747-b18f-e4124b402041`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:27,720::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:06:27,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:27,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`815b0f05-89a6-4747-b18f-e4124b402041`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:27,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`815b0f05-89a6-4747-b18f-e4124b402041`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:27,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:27,740::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:27,740::task::993::Storage.TaskManager.Task::(_decref) Task=`815b0f05-89a6-4747-b18f-e4124b402041`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:06:27,746::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:06:27,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eed4491-fb01-467e-a951-2c5a81848531`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:06:27,747::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:06:27,747::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dcce5a14-0d6c-4afc-b60f-51a621e94679`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:06:27,747::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:06:27,747::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:06:27,747::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dcce5a14-0d6c-4afc-b60f-51a621e94679`::Granted request >Thread-10197::DEBUG::2014-08-11 17:06:27,747::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4eed4491-fb01-467e-a951-2c5a81848531`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:06:27,747::task::993::Storage.TaskManager.Task::(_decref) Task=`4eed4491-fb01-467e-a951-2c5a81848531`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:06:27,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:27,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`4eed4491-fb01-467e-a951-2c5a81848531`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:27,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`4eed4491-fb01-467e-a951-2c5a81848531`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:06:27,768::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:06:27,768::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:06:27,768::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:06:27,768::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:06:27,768::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:06:27,768::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:06:27,768::task::993::Storage.TaskManager.Task::(_decref) Task=`4eed4491-fb01-467e-a951-2c5a81848531`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) (540172) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:27,993::__init__::225::IOProcess::(_processLogs) (540172) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:27,994::__init__::225::IOProcess::(_processLogs) DEBUG|(540172) Building response >Thread-19::DEBUG::2014-08-11 17:06:27,994::__init__::225::IOProcess::(_processLogs) (540172) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:27,994::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:27,995::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:06:27,995::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:06:28,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00111092 s, 329 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) (540173) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) (540173) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:28,056::__init__::225::IOProcess::(_processLogs) DEBUG|(540173) Building response >Thread-19::DEBUG::2014-08-11 17:06:28,057::__init__::225::IOProcess::(_processLogs) (540173) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:28,057::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:06:28,057::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:06:28,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:28,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0685835 s, 14.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:29,699::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) (540174) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) (540174) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) DEBUG|(540174) Building response >Thread-19::DEBUG::2014-08-11 17:06:29,700::__init__::225::IOProcess::(_processLogs) (540174) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:29,701::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:06:29,701::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:06:29,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:06:29,761::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00108199 s, 457 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:29,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:29,763::__init__::225::IOProcess::(_processLogs) (540175) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:29,763::__init__::225::IOProcess::(_processLogs) (540175) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:29,763::__init__::225::IOProcess::(_processLogs) (540175) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:29,763::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:29,763::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) (540176) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:29,764::__init__::225::IOProcess::(_processLogs) (540176) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) (540176) Building response >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) (540176) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:29,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) (540177) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) (540177) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) (540177) Building response >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) (540177) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:29,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:29,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:29,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:29,767::__init__::225::IOProcess::(_processLogs) (540178) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:29,767::__init__::225::IOProcess::(_processLogs) (540178) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:29,767::__init__::225::IOProcess::(_processLogs) (540178) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:29,767::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:06:30,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:30,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0999221 s, 10.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:31,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:31,821::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:31,823::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:31,906::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:31,908::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:31,910::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:32,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:33,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069624 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:06:35,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:35,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0260559 s, 39.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:06:35,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b526cd1-9e76-44e9-9bbd-3d70bf487c5f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:35,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:06:35,383::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111092', 'lastCheck': '7.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108199', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:35,383::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b526cd1-9e76-44e9-9bbd-3d70bf487c5f`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111092', 'lastCheck': '7.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108199', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:35,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b526cd1-9e76-44e9-9bbd-3d70bf487c5f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:35,383::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:35,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:35,384::task::993::Storage.TaskManager.Task::(_decref) Task=`8b526cd1-9e76-44e9-9bbd-3d70bf487c5f`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:06:35,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:06:35,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:06:35,610::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:36,829::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:36,830::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:36,830::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:36,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:36,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:36,918::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:37,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:37,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504907 s, 20.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:06:37,803::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:06:37,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d9743f2-aeec-4dcf-93d2-0cd855fc2d02`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:37,804::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:06:37,818::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:37,818::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d9743f2-aeec-4dcf-93d2-0cd855fc2d02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:37,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d9743f2-aeec-4dcf-93d2-0cd855fc2d02`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:37,818::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:37,818::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:37,818::task::993::Storage.TaskManager.Task::(_decref) Task=`0d9743f2-aeec-4dcf-93d2-0cd855fc2d02`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:06:37,825::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:06:37,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`75a44212-70d1-40e7-9c15-8cf0a1398202`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:06:37,825::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:06:37,826::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9d5ed43-8634-4ed8-a45d-e7c6c560b33e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:06:37,826::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:06:37,826::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:06:37,826::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9d5ed43-8634-4ed8-a45d-e7c6c560b33e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:06:37,826::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`75a44212-70d1-40e7-9c15-8cf0a1398202`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:06:37,826::task::993::Storage.TaskManager.Task::(_decref) Task=`75a44212-70d1-40e7-9c15-8cf0a1398202`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:06:37,843::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:37,843::task::1191::Storage.TaskManager.Task::(prepare) Task=`75a44212-70d1-40e7-9c15-8cf0a1398202`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:37,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`75a44212-70d1-40e7-9c15-8cf0a1398202`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:06:37,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:06:37,843::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:06:37,843::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:06:37,843::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:06:37,844::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:06:37,844::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:06:37,844::task::993::Storage.TaskManager.Task::(_decref) Task=`75a44212-70d1-40e7-9c15-8cf0a1398202`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:38,058::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:38,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:38,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:38,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:38,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:38,058::__init__::225::IOProcess::(_processLogs) (540179) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:38,059::__init__::225::IOProcess::(_processLogs) (540179) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:38,059::__init__::225::IOProcess::(_processLogs) (540179) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:38,059::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:06:38,060::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:06:38,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00418342 s, 87.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) (540180) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:38,124::__init__::225::IOProcess::(_processLogs) (540180) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:38,125::__init__::225::IOProcess::(_processLogs) (540180) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:38,125::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:06:39,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:39,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0303092 s, 33.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:39,768::__init__::225::IOProcess::(_processLogs) (540181) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:39,769::__init__::225::IOProcess::(_processLogs) (540181) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:39,769::__init__::225::IOProcess::(_processLogs) DEBUG|(540181) Building response >Thread-19::DEBUG::2014-08-11 17:06:39,769::__init__::225::IOProcess::(_processLogs) (540181) Queuing response >Thread-28::DEBUG::2014-08-11 17:06:39,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:06:39,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:39,828::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:06:39,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000447852 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:39,830::__init__::225::IOProcess::(_processLogs) (540182) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:39,831::__init__::225::IOProcess::(_processLogs) (540182) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:39,831::__init__::225::IOProcess::(_processLogs) DEBUG|(540182) Building response >Thread-19::DEBUG::2014-08-11 17:06:39,831::__init__::225::IOProcess::(_processLogs) (540182) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:39,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:39,831::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:39,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) (540183) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) (540183) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) (540183) Building response >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) (540183) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:06:39,833::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) (540184) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) (540184) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) (540184) Building response >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) (540184) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:39,834::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:39,835::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:39,835::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:06:39,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:39,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:39,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) (540185) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) (540185) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) (540185) Building response >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) (540185) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:39,836::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:06:41,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0dbb446-fb36-4591-97d1-e857fd0a1bb2`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:06:41,079::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:06:41,079::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) (540186) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:06:41,080::__init__::225::IOProcess::(_processLogs) (540186) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:06:41,093::__init__::225::IOProcess::(_processLogs) DEBUG|(540186) Building response >Thread-19::DEBUG::2014-08-11 17:06:41,093::__init__::225::IOProcess::(_processLogs) (540186) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:41,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:41,094::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:06:41,094::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:41,094::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:06:41,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:41,095::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10102::INFO::2014-08-11 17:06:41,095::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:06:41,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:06:41,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0dbb446-fb36-4591-97d1-e857fd0a1bb2`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:06:41,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:06:41,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0dbb446-fb36-4591-97d1-e857fd0a1bb2`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:06:41,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:06:41,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:06:41,097::__init__::225::IOProcess::(_processLogs) (540187) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:06:41,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:06:41,097::__init__::225::IOProcess::(_processLogs) (540187) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:06:41,097::task::993::Storage.TaskManager.Task::(_decref) Task=`c0dbb446-fb36-4591-97d1-e857fd0a1bb2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:41,098::__init__::225::IOProcess::(_processLogs) (540187) Building response >Thread-19::DEBUG::2014-08-11 17:06:41,098::__init__::225::IOProcess::(_processLogs) (540187) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:41,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:41,098::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:06:41,120::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:06:41,424::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:41,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474356 s, 21.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:41,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:41,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:41,833::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:41,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:41,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:41,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:43,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:43,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0724806 s, 14.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:06:45,654::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:06:45,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:45,827::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0884985 s, 11.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:46,837::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:46,838::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:46,838::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:46,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:46,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:46,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:47,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:06:47,946::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:06:47,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`1db8e290-c3a4-43f0-ac35-9a3b69a09a1c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:47,946::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:06:47,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0684662 s, 15.0 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:06:47,988::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:47,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`1db8e290-c3a4-43f0-ac35-9a3b69a09a1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:47,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`1db8e290-c3a4-43f0-ac35-9a3b69a09a1c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:47,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:47,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:47,988::task::993::Storage.TaskManager.Task::(_decref) Task=`1db8e290-c3a4-43f0-ac35-9a3b69a09a1c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:06:47,995::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:06:47,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`76e01a8d-50be-4ee9-876e-3b3acf8a2acb`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:06:47,995::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:06:47,995::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d055b2ea-509b-46e3-9115-5227b02796f8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:06:47,995::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:06:47,996::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:06:47,996::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d055b2ea-509b-46e3-9115-5227b02796f8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:06:47,996::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76e01a8d-50be-4ee9-876e-3b3acf8a2acb`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:06:47,996::task::993::Storage.TaskManager.Task::(_decref) Task=`76e01a8d-50be-4ee9-876e-3b3acf8a2acb`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:06:48,020::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:48,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`76e01a8d-50be-4ee9-876e-3b3acf8a2acb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:48,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`76e01a8d-50be-4ee9-876e-3b3acf8a2acb`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:06:48,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:06:48,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:06:48,020::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:06:48,020::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:06:48,020::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:06:48,020::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:06:48,021::task::993::Storage.TaskManager.Task::(_decref) Task=`76e01a8d-50be-4ee9-876e-3b3acf8a2acb`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:48,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:48,127::__init__::225::IOProcess::(_processLogs) (540188) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:48,127::__init__::225::IOProcess::(_processLogs) (540188) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:48,128::__init__::225::IOProcess::(_processLogs) DEBUG|(540188) Building response >Thread-19::DEBUG::2014-08-11 17:06:48,128::__init__::225::IOProcess::(_processLogs) (540188) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:48,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:48,129::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:06:48,129::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:06:48,190::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00171249 s, 214 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:48,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:48,192::__init__::225::IOProcess::(_processLogs) (540189) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:48,192::__init__::225::IOProcess::(_processLogs) (540189) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:48,192::__init__::225::IOProcess::(_processLogs) DEBUG|(540189) Building response >Thread-19::DEBUG::2014-08-11 17:06:48,192::__init__::225::IOProcess::(_processLogs) (540189) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:48,192::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:06:48,193::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) (540190) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:49,836::__init__::225::IOProcess::(_processLogs) (540190) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:49,837::__init__::225::IOProcess::(_processLogs) DEBUG|(540190) Building response >Thread-19::DEBUG::2014-08-11 17:06:49,837::__init__::225::IOProcess::(_processLogs) (540190) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:49,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:49,837::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:06:49,838::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:06:49,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00134386 s, 368 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:49,898::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:49,898::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) (540191) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) (540191) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:49,899::__init__::225::IOProcess::(_processLogs) DEBUG|(540191) Building response >Thread-19::DEBUG::2014-08-11 17:06:49,900::__init__::225::IOProcess::(_processLogs) (540191) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:49,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:49,900::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:49,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:49,900::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) (540192) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) (540192) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:49,901::__init__::225::IOProcess::(_processLogs) DEBUG|(540192) Building response >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) (540192) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:49,902::__init__::225::IOProcess::(_processLogs) (540193) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) (540193) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) DEBUG|(540193) Building response >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) (540193) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:49,903::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:06:49,904::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:49,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:49,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:49,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:49,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:49,904::__init__::225::IOProcess::(_processLogs) (540194) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:49,905::__init__::225::IOProcess::(_processLogs) (540194) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:49,905::__init__::225::IOProcess::(_processLogs) (540194) Building response >Thread-19::DEBUG::2014-08-11 17:06:49,905::__init__::225::IOProcess::(_processLogs) (540194) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:49,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:49,905::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:06:49,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:50,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0929978 s, 11.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:06:50,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`e53e0010-a844-407e-8aaf-8b1104b40002`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:50,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:06:50,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171249', 'lastCheck': '2.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134386', 'lastCheck': '0.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:50,562::task::1191::Storage.TaskManager.Task::(prepare) Task=`e53e0010-a844-407e-8aaf-8b1104b40002`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00171249', 'lastCheck': '2.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00134386', 'lastCheck': '0.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:06:50,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`e53e0010-a844-407e-8aaf-8b1104b40002`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:50,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:50,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:50,562::task::993::Storage.TaskManager.Task::(_decref) Task=`e53e0010-a844-407e-8aaf-8b1104b40002`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:06:50,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:06:50,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:06:50,617::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:51,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:51,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:51,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:51,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:51,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:51,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:06:52,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:52,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158473 s, 64.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:06:54,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:54,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324341 s, 31.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:06:56,127::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:06:56,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:56,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155234 s, 66.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:56,849::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:56,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:06:56,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:56,955::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:56,955::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:06:56,955::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:06:57,667::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:06:58,054::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:06:58,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ed6b06b-0789-45d0-be21-606ddd3a4d6b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:06:58,054::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:06:58,079::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:58,079::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ed6b06b-0789-45d0-be21-606ddd3a4d6b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:06:58,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ed6b06b-0789-45d0-be21-606ddd3a4d6b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:06:58,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:06:58,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:06:58,079::task::993::Storage.TaskManager.Task::(_decref) Task=`4ed6b06b-0789-45d0-be21-606ddd3a4d6b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:06:58,086::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:06:58,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`f637e8f4-22e5-482a-9172-6e1ea2ae023f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:06:58,086::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:06:58,086::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ad396eee-d13b-4c07-b0f1-edacb8c3a8c3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:06:58,086::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:06:58,087::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:06:58,087::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ad396eee-d13b-4c07-b0f1-edacb8c3a8c3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:06:58,087::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f637e8f4-22e5-482a-9172-6e1ea2ae023f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:06:58,087::task::993::Storage.TaskManager.Task::(_decref) Task=`f637e8f4-22e5-482a-9172-6e1ea2ae023f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:06:58,103::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:58,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`f637e8f4-22e5-482a-9172-6e1ea2ae023f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:06:58,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`f637e8f4-22e5-482a-9172-6e1ea2ae023f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:06:58,103::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:06:58,103::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:06:58,104::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:06:58,104::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:06:58,104::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:06:58,104::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:06:58,104::task::993::Storage.TaskManager.Task::(_decref) Task=`f637e8f4-22e5-482a-9172-6e1ea2ae023f`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:06:58,193::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) (540195) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:58,194::__init__::225::IOProcess::(_processLogs) (540195) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:58,195::__init__::225::IOProcess::(_processLogs) DEBUG|(540195) Building response >Thread-19::DEBUG::2014-08-11 17:06:58,195::__init__::225::IOProcess::(_processLogs) (540195) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:58,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:58,195::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:06:58,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:06:58,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00120565 s, 304 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:58,256::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:58,256::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:58,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) (540196) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) (540196) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:58,257::__init__::225::IOProcess::(_processLogs) DEBUG|(540196) Building response >Thread-19::DEBUG::2014-08-11 17:06:58,258::__init__::225::IOProcess::(_processLogs) (540196) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:58,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:58,258::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:06:58,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:06:58,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0753063 s, 13.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) (540197) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:59,905::__init__::225::IOProcess::(_processLogs) (540197) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:59,906::__init__::225::IOProcess::(_processLogs) DEBUG|(540197) Building response >Thread-19::DEBUG::2014-08-11 17:06:59,906::__init__::225::IOProcess::(_processLogs) (540197) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:59,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:59,906::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:06:59,907::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:06:59,966::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000888462 s, 557 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:06:59,967::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:59,967::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:06:59,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:59,967::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:59,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:59,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:59,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:59,968::__init__::225::IOProcess::(_processLogs) (540198) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:06:59,968::__init__::225::IOProcess::(_processLogs) (540198) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:06:59,968::__init__::225::IOProcess::(_processLogs) DEBUG|(540198) Building response >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) (540198) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:59,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) (540199) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) (540199) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) (540199) Building response >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) (540199) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:06:59,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) (540200) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) (540200) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) (540200) Building response >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) (540200) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:59,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:59,972::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:06:59,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:06:59,972::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:06:59,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:06:59,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) (540201) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) (540201) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) (540201) Building response >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) (540201) Queuing response >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:06:59,973::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:07:00,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:00,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577715 s, 17.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:01,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:01,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:01,860::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:01,962::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:01,964::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:01,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:02,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:02,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269079 s, 38.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:07:04,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:04,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415286 s, 24.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:07:05,639::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:07:05,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`59b1d9a0-a1e3-4766-8d0a-7e8af52711dd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:05,709::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:07:05,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120565', 'lastCheck': '7.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000888462', 'lastCheck': '5.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:05,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`59b1d9a0-a1e3-4766-8d0a-7e8af52711dd`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120565', 'lastCheck': '7.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000888462', 'lastCheck': '5.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:05,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`59b1d9a0-a1e3-4766-8d0a-7e8af52711dd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:05,709::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:05,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:05,709::task::993::Storage.TaskManager.Task::(_decref) Task=`59b1d9a0-a1e3-4766-8d0a-7e8af52711dd`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:07:05,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:07:05,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:06,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:06,866::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:06,866::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:06,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:07:06,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:06,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:06,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:06,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132714 s, 77.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:07:08,131::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:07:08,131::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c8b0772-233f-416d-8af4-1032438af549`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:08,132::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:07:08,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:08,186::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c8b0772-233f-416d-8af4-1032438af549`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:08,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c8b0772-233f-416d-8af4-1032438af549`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:08,186::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:08,186::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:08,186::task::993::Storage.TaskManager.Task::(_decref) Task=`0c8b0772-233f-416d-8af4-1032438af549`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:07:08,192::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:07:08,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`af31941c-b056-4436-9c40-25c0a6e7dbb4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:07:08,193::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:07:08,193::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`436d0670-4c30-4848-8dc4-596fd2b90b9f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:07:08,193::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:07:08,193::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:07:08,193::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`436d0670-4c30-4848-8dc4-596fd2b90b9f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:07:08,193::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af31941c-b056-4436-9c40-25c0a6e7dbb4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:07:08,194::task::993::Storage.TaskManager.Task::(_decref) Task=`af31941c-b056-4436-9c40-25c0a6e7dbb4`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:07:08,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:08,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`af31941c-b056-4436-9c40-25c0a6e7dbb4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:08,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`af31941c-b056-4436-9c40-25c0a6e7dbb4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:07:08,210::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:07:08,210::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:07:08,211::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:07:08,211::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:07:08,211::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:07:08,211::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:07:08,211::task::993::Storage.TaskManager.Task::(_decref) Task=`af31941c-b056-4436-9c40-25c0a6e7dbb4`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) (540202) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) (540202) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:08,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540202) Building response >Thread-19::DEBUG::2014-08-11 17:07:08,260::__init__::225::IOProcess::(_processLogs) (540202) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:08,260::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:08,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:07:08,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:07:08,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00133855 s, 273 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:08,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) (540203) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) (540203) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540203) Building response >Thread-19::DEBUG::2014-08-11 17:07:08,322::__init__::225::IOProcess::(_processLogs) (540203) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:08,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:07:08,323::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:07:08,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:09,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411871 s, 24.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:09,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:09,973::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:09,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:09,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:09,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:09,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:09,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:09,974::__init__::225::IOProcess::(_processLogs) (540204) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:09,974::__init__::225::IOProcess::(_processLogs) (540204) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:09,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540204) Building response >Thread-19::DEBUG::2014-08-11 17:07:09,975::__init__::225::IOProcess::(_processLogs) (540204) Queuing response >Thread-28::DEBUG::2014-08-11 17:07:09,975::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:09,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:10,033::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:07:10,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00039211 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:10,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:10,034::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:10,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:10,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:10,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:10,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:10,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:10,035::__init__::225::IOProcess::(_processLogs) (540205) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:10,035::__init__::225::IOProcess::(_processLogs) (540205) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:10,035::__init__::225::IOProcess::(_processLogs) (540205) Building response >Thread-19::DEBUG::2014-08-11 17:07:10,035::__init__::225::IOProcess::(_processLogs) (540205) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:10,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:10,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) (540206) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) (540206) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) (540206) Building response >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) (540206) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:07:10,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) (540207) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) (540207) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) (540207) Building response >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) (540207) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:10,038::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:10,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:10,039::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:07:10,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:10,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:10,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) (540208) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) (540208) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) (540208) Building response >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) (540208) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:10,040::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:07:11,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:07:11,176::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:07:11,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053572 s, 19.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:11,872::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:11,872::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:11,873::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:11,977::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:11,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:11,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:13,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:13,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269274 s, 38.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:07:15,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:15,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121002 s, 84.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:07:15,705::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:16,877::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:16,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:16,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:16,980::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:16,980::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:16,980::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:17,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:17,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137464 s, 74.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:07:18,256::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:07:18,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`747c4466-bd7a-40f5-8f44-b589ab3108a4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:18,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:07:18,316::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:18,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`747c4466-bd7a-40f5-8f44-b589ab3108a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:18,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`747c4466-bd7a-40f5-8f44-b589ab3108a4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:18,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:18,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:18,316::task::993::Storage.TaskManager.Task::(_decref) Task=`747c4466-bd7a-40f5-8f44-b589ab3108a4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:07:18,323::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:07:18,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b5b8f2b-3ca6-4698-95ce-02becccb5839`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:07:18,323::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:07:18,324::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`eb7269df-5d50-4578-a50a-6416d3816da0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-19::DEBUG::2014-08-11 17:07:18,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-10197::DEBUG::2014-08-11 17:07:18,324::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-19::DEBUG::2014-08-11 17:07:18,325::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-10197::DEBUG::2014-08-11 17:07:18,325::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-19::DEBUG::2014-08-11 17:07:18,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::DEBUG::2014-08-11 17:07:18,326::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`eb7269df-5d50-4578-a50a-6416d3816da0`::Granted request >Thread-19::DEBUG::2014-08-11 17:07:18,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:18,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::DEBUG::2014-08-11 17:07:18,327::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9b5b8f2b-3ca6-4698-95ce-02becccb5839`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-19::DEBUG::2014-08-11 17:07:18,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10197::DEBUG::2014-08-11 17:07:18,328::task::993::Storage.TaskManager.Task::(_decref) Task=`9b5b8f2b-3ca6-4698-95ce-02becccb5839`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:07:18,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:18,329::__init__::225::IOProcess::(_processLogs) (540209) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:18,329::__init__::225::IOProcess::(_processLogs) (540209) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:18,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540209) Building response >Thread-27::DEBUG::2014-08-11 17:07:18,331::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:18,331::__init__::225::IOProcess::(_processLogs) (540209) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:18,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:18,391::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:07:18,393::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000942503 s, 388 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:18,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:18,396::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:18,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:18,397::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:18,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:18,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:18,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:18,400::__init__::225::IOProcess::(_processLogs) (540210) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:18,400::__init__::225::IOProcess::(_processLogs) (540210) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:18,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540210) Building response >Thread-19::DEBUG::2014-08-11 17:07:18,403::__init__::225::IOProcess::(_processLogs) (540210) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:18,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:18,403::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10197::INFO::2014-08-11 17:07:18,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:18,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b5b8f2b-3ca6-4698-95ce-02becccb5839`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:18,433::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b5b8f2b-3ca6-4698-95ce-02becccb5839`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:07:18,433::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:07:18,433::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:07:18,433::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:07:18,434::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:07:18,434::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:07:18,434::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:07:18,434::task::993::Storage.TaskManager.Task::(_decref) Task=`9b5b8f2b-3ca6-4698-95ce-02becccb5839`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:07:19,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:19,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012668 s, 80.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:20,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,040::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:20,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:20,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:20,041::__init__::225::IOProcess::(_processLogs) (540211) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:20,041::__init__::225::IOProcess::(_processLogs) (540211) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:20,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540211) Building response >Thread-28::DEBUG::2014-08-11 17:07:20,042::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:20,042::__init__::225::IOProcess::(_processLogs) (540211) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,100::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:07:20,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000474433 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:20,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,101::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:20,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) (540212) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) (540212) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) (540212) Building response >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) (540212) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:20,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) (540213) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) (540213) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) (540213) Building response >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) (540213) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) (540214) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) (540214) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) (540214) Building response >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) (540214) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:20,106::__init__::225::IOProcess::(_processLogs) (540215) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:20,107::__init__::225::IOProcess::(_processLogs) (540215) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:20,107::__init__::225::IOProcess::(_processLogs) (540215) Building response >Thread-19::DEBUG::2014-08-11 17:07:20,107::__init__::225::IOProcess::(_processLogs) (540215) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,107::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:07:20,641::task::595::Storage.TaskManager.Task::(_updateState) Task=`52cc6375-868c-4b47-972f-851c2cc1d1ce`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:07:20,641::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) (540216) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:07:20,642::__init__::225::IOProcess::(_processLogs) (540216) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:07:20,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540216) Building response >Thread-19::DEBUG::2014-08-11 17:07:20,649::__init__::225::IOProcess::(_processLogs) (540216) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:07:20,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:20,650::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:07:20,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:20,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:20,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:20,650::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:07:20,650::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:07:20,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:07:20,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`52cc6375-868c-4b47-972f-851c2cc1d1ce`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:07:20,651::__init__::225::IOProcess::(_processLogs) (540217) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:07:20,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`52cc6375-868c-4b47-972f-851c2cc1d1ce`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:07:20,652::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:07:20,652::__init__::225::IOProcess::(_processLogs) (540217) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:07:20,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:07:20,653::__init__::225::IOProcess::(_processLogs) (540217) Building response >Thread-10017::DEBUG::2014-08-11 17:07:20,653::task::993::Storage.TaskManager.Task::(_decref) Task=`52cc6375-868c-4b47-972f-851c2cc1d1ce`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:07:20,653::__init__::225::IOProcess::(_processLogs) (540217) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:20,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:20,654::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:07:20,673::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:07:20,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`e82a31d4-2f36-47c9-b636-a72a358b608d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:20,956::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:07:20,956::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000942503', 'lastCheck': '2.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474433', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:20,956::task::1191::Storage.TaskManager.Task::(prepare) Task=`e82a31d4-2f36-47c9-b636-a72a358b608d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000942503', 'lastCheck': '2.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000474433', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:20,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`e82a31d4-2f36-47c9-b636-a72a358b608d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:20,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:20,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:20,956::task::993::Storage.TaskManager.Task::(_decref) Task=`e82a31d4-2f36-47c9-b636-a72a358b608d`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:07:20,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:07:20,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:21,563::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:21,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281776 s, 36.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:21,880::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:21,880::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:21,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:21,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:21,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:21,987::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:23,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:23,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0643009 s, 15.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:07:25,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:25,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0890908 s, 11.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:07:26,184::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:26,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:26,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:26,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:26,992::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:26,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:26,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:07:27,721::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:07:27,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:28,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373178 s, 27.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:28,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:28,403::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:28,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:28,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) (540218) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) (540218) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540218) Building response >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) (540218) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:28,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:07:28,405::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:28,405::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:07:28,465::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:07:28,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4abc7a3-bc25-4117-93d9-d9da9d34c41f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:28,466::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-27::DEBUG::2014-08-11 17:07:28,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0026004 s, 141 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:28,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:28,468::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) (540219) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) (540219) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:28,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540219) Building response >Thread-19::DEBUG::2014-08-11 17:07:28,470::__init__::225::IOProcess::(_processLogs) (540219) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:28,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:28,470::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::INFO::2014-08-11 17:07:28,503::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:28,503::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4abc7a3-bc25-4117-93d9-d9da9d34c41f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:28,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4abc7a3-bc25-4117-93d9-d9da9d34c41f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:28,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:28,504::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:28,504::task::993::Storage.TaskManager.Task::(_decref) Task=`e4abc7a3-bc25-4117-93d9-d9da9d34c41f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:07:28,510::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:07:28,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`68a9df27-fabe-48e8-be20-27ef473be332`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:07:28,511::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:07:28,511::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`01316647-2b04-4072-a99a-23b77a9e990b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:07:28,511::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:07:28,511::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:07:28,511::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`01316647-2b04-4072-a99a-23b77a9e990b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:07:28,511::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68a9df27-fabe-48e8-be20-27ef473be332`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:07:28,512::task::993::Storage.TaskManager.Task::(_decref) Task=`68a9df27-fabe-48e8-be20-27ef473be332`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:07:28,528::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:28,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`68a9df27-fabe-48e8-be20-27ef473be332`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:28,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`68a9df27-fabe-48e8-be20-27ef473be332`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:07:28,528::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:07:28,528::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:07:28,529::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:07:28,529::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:07:28,529::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:07:28,529::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:07:28,529::task::993::Storage.TaskManager.Task::(_decref) Task=`68a9df27-fabe-48e8-be20-27ef473be332`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:07:30,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:30,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:30,111::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:30,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:30,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:30,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:30,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:30,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:30,114::__init__::225::IOProcess::(_processLogs) (540220) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:30,114::__init__::225::IOProcess::(_processLogs) (540220) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:30,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540220) Building response >Thread-28::DEBUG::2014-08-11 17:07:30,115::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:30,115::__init__::225::IOProcess::(_processLogs) (540220) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:30,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:30,175::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:07:30,176::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0004458 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:30,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:30,178::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:30,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:30,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:30,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:30,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:30,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:30,181::__init__::225::IOProcess::(_processLogs) (540221) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:30,182::__init__::225::IOProcess::(_processLogs) (540221) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:30,184::__init__::225::IOProcess::(_processLogs) (540221) Building response >Dummy-51::DEBUG::2014-08-11 17:07:30,184::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0737522 s, 13.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:30,184::__init__::225::IOProcess::(_processLogs) (540221) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:30,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:30,185::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:07:30,186::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:07:30,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:30,187::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:30,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:30,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:30,189::__init__::225::IOProcess::(_processLogs) (540222) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:30,190::__init__::225::IOProcess::(_processLogs) (540222) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:30,191::__init__::225::IOProcess::(_processLogs) (540222) Building response >Thread-19::DEBUG::2014-08-11 17:07:30,191::__init__::225::IOProcess::(_processLogs) (540222) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:30,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:30,192::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:30,193::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:07:30,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:30,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:30,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:30,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:30,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:30,195::__init__::225::IOProcess::(_processLogs) (540223) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:30,195::__init__::225::IOProcess::(_processLogs) (540223) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:30,196::__init__::225::IOProcess::(_processLogs) (540223) Building response >Thread-19::DEBUG::2014-08-11 17:07:30,196::__init__::225::IOProcess::(_processLogs) (540223) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:30,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:30,197::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:30,198::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:07:30,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:30,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:30,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:30,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:30,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:30,201::__init__::225::IOProcess::(_processLogs) (540224) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:30,201::__init__::225::IOProcess::(_processLogs) (540224) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:30,202::__init__::225::IOProcess::(_processLogs) (540224) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:30,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:30,203::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:31,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:31,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:31,896::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:31,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:32,001::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:32,003::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:32,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:32,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388993 s, 26.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:07:34,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:34,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496124 s, 20.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:07:35,681::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:07:36,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`820083b8-c5f8-4af1-8b15-b4effbb898ff`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:36,133::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:07:36,133::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0026004', 'lastCheck': '7.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004458', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:36,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`820083b8-c5f8-4af1-8b15-b4effbb898ff`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0026004', 'lastCheck': '7.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004458', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:36,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`820083b8-c5f8-4af1-8b15-b4effbb898ff`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:36,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:36,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:36,134::task::993::Storage.TaskManager.Task::(_decref) Task=`820083b8-c5f8-4af1-8b15-b4effbb898ff`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:07:36,147::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:07:36,148::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:36,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:36,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054215 s, 18.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:36,900::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:36,901::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:36,901::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:37,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:37,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:37,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) (540225) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) (540225) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:38,471::__init__::225::IOProcess::(_processLogs) (540225) Queuing response >Thread-27::DEBUG::2014-08-11 17:07:38,472::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:38,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:38,531::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:07:38,531::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0005415 s, 676 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:38,532::__init__::225::IOProcess::(_processLogs) (540226) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:38,533::__init__::225::IOProcess::(_processLogs) (540226) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:38,533::__init__::225::IOProcess::(_processLogs) (540226) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:38,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:38,534::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:07:38,583::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [6c840493] >Thread-10205::DEBUG::2014-08-11 17:07:38,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce0f282-197b-4d55-9a50-fd279266a8f6`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:38,583::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:07:38,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::INFO::2014-08-11 17:07:38,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:38,683::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ce0f282-197b-4d55-9a50-fd279266a8f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:38,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce0f282-197b-4d55-9a50-fd279266a8f6`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:38,683::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:38,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:38,683::task::993::Storage.TaskManager.Task::(_decref) Task=`4ce0f282-197b-4d55-9a50-fd279266a8f6`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:07:38,690::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [6c840493] >Thread-10197::DEBUG::2014-08-11 17:07:38,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ea48879-71c7-4531-9786-6e2923bf68b7`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:07:38,690::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:07:38,690::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f1c9b0f2-c457-4fec-8e24-ce3a04a2278d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:07:38,691::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:07:38,691::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:07:38,691::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f1c9b0f2-c457-4fec-8e24-ce3a04a2278d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:07:38,691::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3ea48879-71c7-4531-9786-6e2923bf68b7`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:07:38,691::task::993::Storage.TaskManager.Task::(_decref) Task=`3ea48879-71c7-4531-9786-6e2923bf68b7`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:07:38,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054015 s, 19.0 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:07:38,748::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:38,749::task::1191::Storage.TaskManager.Task::(prepare) Task=`3ea48879-71c7-4531-9786-6e2923bf68b7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56478400512', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:38,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`3ea48879-71c7-4531-9786-6e2923bf68b7`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:07:38,749::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:07:38,749::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:07:38,749::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:07:38,749::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:07:38,749::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:07:38,749::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:07:38,749::task::993::Storage.TaskManager.Task::(_decref) Task=`3ea48879-71c7-4531-9786-6e2923bf68b7`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) (540227) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:40,203::__init__::225::IOProcess::(_processLogs) (540227) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:40,204::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540227) Building response >Thread-19::DEBUG::2014-08-11 17:07:40,204::__init__::225::IOProcess::(_processLogs) (540227) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:40,204::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:07:40,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:40,205::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:07:40,274::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00262028 s, 189 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:40,274::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:40,274::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) (540228) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) (540228) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:40,275::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540228) Building response >Thread-19::DEBUG::2014-08-11 17:07:40,276::__init__::225::IOProcess::(_processLogs) (540228) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:40,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:40,276::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:07:40,276::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:40,276::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) (540229) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) (540229) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) (540229) Building response >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) (540229) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:40,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:40,278::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:40,278::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:40,278::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:07:40,278::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:40,279::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:40,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) (540230) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) (540230) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) (540230) Building response >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) (540230) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:40,280::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) (540231) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:40,281::__init__::225::IOProcess::(_processLogs) (540231) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:40,282::__init__::225::IOProcess::(_processLogs) (540231) Building response >Thread-19::DEBUG::2014-08-11 17:07:40,282::__init__::225::IOProcess::(_processLogs) (540231) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:40,282::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:40,282::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:07:40,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:40,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0582196 s, 17.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:07:41,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`daaf10ee-4c51-43b2-9006-0caccdcfd060`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:07:41,186::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:41,187::__init__::225::IOProcess::(_processLogs) (540232) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:07:41,188::__init__::225::IOProcess::(_processLogs) (540232) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:07:41,189::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540232) Building response >Thread-19::DEBUG::2014-08-11 17:07:41,189::__init__::225::IOProcess::(_processLogs) (540232) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:41,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:41,190::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:07:41,190::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:41,190::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:07:41,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10102::INFO::2014-08-11 17:07:41,191::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:07:41,191::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-10102::DEBUG::2014-08-11 17:07:41,191::task::1191::Storage.TaskManager.Task::(prepare) Task=`daaf10ee-4c51-43b2-9006-0caccdcfd060`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:07:41,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:07:41,192::task::595::Storage.TaskManager.Task::(_updateState) Task=`daaf10ee-4c51-43b2-9006-0caccdcfd060`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:07:41,192::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:07:41,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:07:41,192::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:07:41,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:07:41,193::task::993::Storage.TaskManager.Task::(_decref) Task=`daaf10ee-4c51-43b2-9006-0caccdcfd060`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:07:41,193::__init__::225::IOProcess::(_processLogs) (540233) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:07:41,194::__init__::225::IOProcess::(_processLogs) (540233) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:07:41,194::__init__::225::IOProcess::(_processLogs) (540233) Building response >Thread-19::DEBUG::2014-08-11 17:07:41,194::__init__::225::IOProcess::(_processLogs) (540233) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:41,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:41,194::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:07:41,213::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:41,907::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:41,907::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:41,908::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:42,007::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:42,008::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:42,008::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:42,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:42,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380371 s, 26.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:07:44,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:45,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.075511 s, 13.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:07:45,738::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:46,913::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:46,914::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:46,914::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:47,014::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:47,014::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:47,015::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:47,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:47,195::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014216 s, 72.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:48,534::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:48,534::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:48,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:48,534::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:48,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:48,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:48,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:48,535::__init__::225::IOProcess::(_processLogs) (540234) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:48,535::__init__::225::IOProcess::(_processLogs) (540234) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:48,538::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540234) Building response >Thread-19::DEBUG::2014-08-11 17:07:48,538::__init__::225::IOProcess::(_processLogs) (540234) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:48,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:48,538::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:07:48,539::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:07:48,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000646507 s, 566 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:48,682::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:48,683::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:48,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:48,683::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:48,683::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:48,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) (540235) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) (540235) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) (540235) Building response >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) (540235) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:48,685::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:07:48,783::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10205::DEBUG::2014-08-11 17:07:48,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`548b77a7-7caa-414a-b9fc-b7e92ed2847e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:48,783::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:07:48,798::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:48,799::task::1191::Storage.TaskManager.Task::(prepare) Task=`548b77a7-7caa-414a-b9fc-b7e92ed2847e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:48,799::task::595::Storage.TaskManager.Task::(_updateState) Task=`548b77a7-7caa-414a-b9fc-b7e92ed2847e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:48,799::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:48,799::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:48,799::task::993::Storage.TaskManager.Task::(_decref) Task=`548b77a7-7caa-414a-b9fc-b7e92ed2847e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:07:48,806::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10197::DEBUG::2014-08-11 17:07:48,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d638481-24cf-4bf4-80f1-a6c27bb3696f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:07:48,806::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:07:48,806::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e7add84b-1694-4f3d-bf81-efb4312cf93e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:07:48,806::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:07:48,807::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:07:48,807::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e7add84b-1694-4f3d-bf81-efb4312cf93e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:07:48,807::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4d638481-24cf-4bf4-80f1-a6c27bb3696f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:07:48,807::task::993::Storage.TaskManager.Task::(_decref) Task=`4d638481-24cf-4bf4-80f1-a6c27bb3696f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:07:48,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:48,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`4d638481-24cf-4bf4-80f1-a6c27bb3696f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:48,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`4d638481-24cf-4bf4-80f1-a6c27bb3696f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:07:48,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:07:48,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:07:48,824::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:07:48,824::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:07:48,824::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:07:48,824::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:07:48,824::task::993::Storage.TaskManager.Task::(_decref) Task=`4d638481-24cf-4bf4-80f1-a6c27bb3696f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:07:49,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:49,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484329 s, 21.1 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:07:50,281::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) (540236) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:07:50,283::__init__::225::IOProcess::(_processLogs) (540236) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:07:50,284::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540236) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,285::__init__::225::IOProcess::(_processLogs) (540236) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:50,286::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:07:50,287::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,288::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:07:50,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,289::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,291::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,292::__init__::225::IOProcess::(_processLogs) (540237) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:07:50,293::__init__::225::IOProcess::(_processLogs) (540237) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:07:50,294::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540237) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,294::__init__::225::IOProcess::(_processLogs) (540237) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:50,296::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:07:50,298::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,299::__init__::225::IOProcess::(_processLogs) (540238) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:07:50,299::__init__::225::IOProcess::(_processLogs) (540238) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:07:50,313::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540238) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,313::__init__::225::IOProcess::(_processLogs) (540238) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,313::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:07:50,314::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:07:50,314::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:50,314::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) (540239) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:07:50,315::__init__::225::IOProcess::(_processLogs) (540239) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:07:50,317::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540239) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,317::__init__::225::IOProcess::(_processLogs) (540239) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,317::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:07:50,317::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:07:50,317::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:07:50,318::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,318::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) (540240) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) (540240) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) (540240) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,319::__init__::225::IOProcess::(_processLogs) (540240) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) (540241) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:07:50,320::__init__::225::IOProcess::(_processLogs) (540241) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:07:50,321::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540241) Building response >Thread-28::DEBUG::2014-08-11 17:07:50,321::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:07:50,321::__init__::225::IOProcess::(_processLogs) (540241) Queuing response >Thread-28::INFO::2014-08-11 17:07:50,321::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:07:50,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::INFO::2014-08-11 17:07:50,322::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:07:50,322::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:07:50,323::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,323::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:50,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,323::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:07:50,324::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:50,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,382::__init__::225::IOProcess::(_processLogs) (540242) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:50,383::__init__::225::IOProcess::(_processLogs) (540242) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:50,383::__init__::225::IOProcess::(_processLogs) (540242) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,383::__init__::225::IOProcess::(_processLogs) (540242) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:07:50,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000543465 s, 911 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:50,384::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) (540243) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:50,385::__init__::225::IOProcess::(_processLogs) (540243) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:50,386::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540243) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,386::__init__::225::IOProcess::(_processLogs) (540243) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:50,386::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:07:50,386::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:07:50,386::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) (540244) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:50,387::__init__::225::IOProcess::(_processLogs) (540244) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:50,391::__init__::225::IOProcess::(_processLogs) (540244) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,391::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:50,391::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:07:50,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,392::__init__::225::IOProcess::(_processLogs) (540245) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:50,392::__init__::225::IOProcess::(_processLogs) (540245) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:50,392::__init__::225::IOProcess::(_processLogs) (540245) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,392::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:07:50,392::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:07:50,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:50,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:50,393::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:50,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:50,393::__init__::225::IOProcess::(_processLogs) (540246) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:07:50,394::__init__::225::IOProcess::(_processLogs) (540246) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:07:50,394::__init__::225::IOProcess::(_processLogs) (540246) Building response >Thread-19::DEBUG::2014-08-11 17:07:50,394::__init__::225::IOProcess::(_processLogs) (540246) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:50,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:50,394::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:07:50,690::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:07:51,286::task::595::Storage.TaskManager.Task::(_updateState) Task=`14bb88c3-6766-4d20-997a-9b64837ce7ed`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:51,286::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:07:51,287::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646507', 'lastCheck': '2.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543465', 'lastCheck': '0.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:51,287::task::1191::Storage.TaskManager.Task::(prepare) Task=`14bb88c3-6766-4d20-997a-9b64837ce7ed`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000646507', 'lastCheck': '2.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000543465', 'lastCheck': '0.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:07:51,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`14bb88c3-6766-4d20-997a-9b64837ce7ed`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:51,287::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:51,287::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:51,287::task::993::Storage.TaskManager.Task::(_decref) Task=`14bb88c3-6766-4d20-997a-9b64837ce7ed`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:07:51,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:07:51,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:51,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:51,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013245 s, 77.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:51,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:51,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:51,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:52,020::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:52,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:52,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:53,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:53,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144421 s, 70.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:07:55,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:55,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526235 s, 19.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:07:56,266::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:56,925::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:56,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:07:56,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:57,023::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:57,024::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:07:57,024::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:07:57,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:57,707::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0517589 s, 19.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:07:57,755::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:07:58,685::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:58,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:58,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:58,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:07:58,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:58,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:58,686::__init__::225::IOProcess::(_processLogs) (540247) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:58,686::__init__::225::IOProcess::(_processLogs) (540247) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:58,686::__init__::225::IOProcess::(_processLogs) (540247) Queuing response >Thread-27::DEBUG::2014-08-11 17:07:58,686::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:07:58,687::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:58,745::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:07:58,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000958201 s, 382 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) (540248) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:07:58,747::__init__::225::IOProcess::(_processLogs) (540248) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:07:58,748::__init__::225::IOProcess::(_processLogs) (540248) Queuing response >Thread-19::DEBUG::2014-08-11 17:07:58,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:07:58,749::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:07:58,876::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:07:58,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`740fd50a-d56f-4207-9a75-3411aecea538`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:07:58,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:07:58,945::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:58,946::task::1191::Storage.TaskManager.Task::(prepare) Task=`740fd50a-d56f-4207-9a75-3411aecea538`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:07:58,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`740fd50a-d56f-4207-9a75-3411aecea538`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:07:58,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:07:58,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:07:58,946::task::993::Storage.TaskManager.Task::(_decref) Task=`740fd50a-d56f-4207-9a75-3411aecea538`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:07:58,953::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:07:58,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`50a3a84e-2291-4cec-add6-23c278839a40`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:07:58,954::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:07:58,954::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d252c599-eec8-4779-a7f1-dade1ee7caf8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:07:58,954::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:07:58,954::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:07:58,954::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d252c599-eec8-4779-a7f1-dade1ee7caf8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:07:58,955::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`50a3a84e-2291-4cec-add6-23c278839a40`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:07:58,955::task::993::Storage.TaskManager.Task::(_decref) Task=`50a3a84e-2291-4cec-add6-23c278839a40`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:07:59,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:59,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`50a3a84e-2291-4cec-add6-23c278839a40`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:07:59,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`50a3a84e-2291-4cec-add6-23c278839a40`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:07:59,014::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:07:59,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:07:59,015::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:07:59,015::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:07:59,015::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:07:59,015::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:07:59,015::task::993::Storage.TaskManager.Task::(_decref) Task=`50a3a84e-2291-4cec-add6-23c278839a40`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:07:59,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:07:59,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306649 s, 33.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:00,394::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:00,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:00,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:00,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:00,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:00,394::__init__::225::IOProcess::(_processLogs) (540249) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:00,395::__init__::225::IOProcess::(_processLogs) (540249) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:00,396::__init__::225::IOProcess::(_processLogs) (540249) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:00,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:08:00,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:08:00,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000538778 s, 919 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) (540250) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:00,456::__init__::225::IOProcess::(_processLogs) (540250) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:00,457::__init__::225::IOProcess::(_processLogs) (540250) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:00,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:00,457::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:08:00,457::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) (540251) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) (540251) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) (540251) Building response >Thread-19::DEBUG::2014-08-11 17:08:00,458::__init__::225::IOProcess::(_processLogs) (540251) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:00,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) (540252) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) (540252) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) (540252) Building response >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) (540252) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:00,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:00,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:00,461::__init__::225::IOProcess::(_processLogs) (540253) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:00,461::__init__::225::IOProcess::(_processLogs) (540253) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:00,461::__init__::225::IOProcess::(_processLogs) (540253) Building response >Thread-19::DEBUG::2014-08-11 17:08:00,461::__init__::225::IOProcess::(_processLogs) (540253) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:00,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:00,462::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:08:01,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:01,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174911 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:01,932::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:01,934::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:01,937::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:02,030::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:02,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:02,034::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:03,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:04,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0695598 s, 14.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:08:05,752::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:08:06,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:06,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496462 s, 20.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:08:06,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bee40a2-85b6-48b1-ae79-228f8b60b419`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:06,546::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:08:06,546::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000958201', 'lastCheck': '7.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538778', 'lastCheck': '6.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:06,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bee40a2-85b6-48b1-ae79-228f8b60b419`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000958201', 'lastCheck': '7.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000538778', 'lastCheck': '6.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:06,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bee40a2-85b6-48b1-ae79-228f8b60b419`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:06,547::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:06,547::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:06,547::task::993::Storage.TaskManager.Task::(_decref) Task=`5bee40a2-85b6-48b1-ae79-228f8b60b419`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:08:06,562::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:08:06,562::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:06,944::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:06,944::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:06,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:07,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:07,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:07,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:08,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:08,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0344293 s, 29.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:08,749::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:08,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:08,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:08,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:08,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:08,749::__init__::225::IOProcess::(_processLogs) (540254) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:08,750::__init__::225::IOProcess::(_processLogs) (540254) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:08,750::__init__::225::IOProcess::(_processLogs) (540254) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:08,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:08:08,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:08:08,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000364647 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:08,809::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:08,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) (540255) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) (540255) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:08,810::__init__::225::IOProcess::(_processLogs) DEBUG|(540255) Building response >Thread-19::DEBUG::2014-08-11 17:08:08,811::__init__::225::IOProcess::(_processLogs) (540255) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:08,811::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:08,811::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:08:09,050::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:08:09,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c03aa9d-d948-4623-b2ce-d27fd58bb76c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:09,051::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:08:09,078::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:09,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c03aa9d-d948-4623-b2ce-d27fd58bb76c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:09,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c03aa9d-d948-4623-b2ce-d27fd58bb76c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:09,078::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:09,078::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:09,078::task::993::Storage.TaskManager.Task::(_decref) Task=`5c03aa9d-d948-4623-b2ce-d27fd58bb76c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:08:09,085::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:08:09,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b817898-24c8-4ce2-97e6-aea3335967f5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:08:09,085::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:08:09,085::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5e61f496-4902-4f5e-b1f5-bb4cabc7abf6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:08:09,085::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:08:09,086::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:08:09,086::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5e61f496-4902-4f5e-b1f5-bb4cabc7abf6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:08:09,087::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b817898-24c8-4ce2-97e6-aea3335967f5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:08:09,087::task::993::Storage.TaskManager.Task::(_decref) Task=`2b817898-24c8-4ce2-97e6-aea3335967f5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:08:09,104::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:09,105::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b817898-24c8-4ce2-97e6-aea3335967f5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:09,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b817898-24c8-4ce2-97e6-aea3335967f5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:08:09,106::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:08:09,107::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:08:09,108::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:08:09,109::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:08:09,110::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:08:09,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:08:09,111::task::993::Storage.TaskManager.Task::(_decref) Task=`2b817898-24c8-4ce2-97e6-aea3335967f5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:08:10,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:10,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227556 s, 45.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) (540256) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:10,462::__init__::225::IOProcess::(_processLogs) (540256) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:11,288::__init__::225::IOProcess::(_processLogs) DEBUG|(540256) Building response >Thread-19::DEBUG::2014-08-11 17:08:11,288::__init__::225::IOProcess::(_processLogs) (540256) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:11,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:11,289::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:08:11,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:08:11,349::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-28::DEBUG::2014-08-11 17:08:11,350::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000490334 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:11,352::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:11,352::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:11,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:11,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:11,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:11,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:11,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:11,355::__init__::225::IOProcess::(_processLogs) (540257) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:11,355::__init__::225::IOProcess::(_processLogs) (540257) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:11,356::__init__::225::IOProcess::(_processLogs) DEBUG|(540257) Building response >Thread-19::DEBUG::2014-08-11 17:08:11,357::__init__::225::IOProcess::(_processLogs) (540257) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:11,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:11,358::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:08:11,359::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:11,360::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:08:11,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:11,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:11,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:11,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) (540258) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) (540258) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) (540258) Building response >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) (540258) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:11,361::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:11,362::__init__::225::IOProcess::(_processLogs) (540259) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) (540259) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) (540259) Building response >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) (540259) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:08:11,363::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) (540260) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) (540260) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) (540260) Building response >Thread-19::DEBUG::2014-08-11 17:08:11,364::__init__::225::IOProcess::(_processLogs) (540260) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:11,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:11,365::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:11,950::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:11,951::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:11,951::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:12,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:12,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:12,048::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:12,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:12,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538374 s, 19.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:08:14,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:14,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560423 s, 18.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:08:15,816::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:08:16,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:16,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0279101 s, 36.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:16,957::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:16,957::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:16,957::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:17,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:17,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:17,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:18,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) (540261) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:18,812::__init__::225::IOProcess::(_processLogs) (540261) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:18,814::__init__::225::IOProcess::(_processLogs) DEBUG|(540261) Building response >Thread-19::DEBUG::2014-08-11 17:08:18,815::__init__::225::IOProcess::(_processLogs) (540261) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:18,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:18,815::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:08:18,815::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:18,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0795185 s, 12.9 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:08:18,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00369498 s, 99.1 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:18,881::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:18,881::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:18,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:18,882::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:18,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:18,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:18,884::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:18,885::__init__::225::IOProcess::(_processLogs) (540262) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:18,885::__init__::225::IOProcess::(_processLogs) (540262) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:18,886::__init__::225::IOProcess::(_processLogs) (540262) Building response >Thread-19::DEBUG::2014-08-11 17:08:18,886::__init__::225::IOProcess::(_processLogs) (540262) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:18,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:18,887::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:08:19,146::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:08:19,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`d99006c1-f063-48e8-bbd1-d656d9c66300`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:19,148::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:08:19,199::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:19,199::task::1191::Storage.TaskManager.Task::(prepare) Task=`d99006c1-f063-48e8-bbd1-d656d9c66300`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:19,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`d99006c1-f063-48e8-bbd1-d656d9c66300`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:19,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:19,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:19,200::task::993::Storage.TaskManager.Task::(_decref) Task=`d99006c1-f063-48e8-bbd1-d656d9c66300`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:08:19,210::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:08:19,211::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f6a2dbe-8c74-4c89-b273-c14817e2ecee`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:08:19,211::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:08:19,211::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fba0a4ca-bfa5-401a-a47a-df5e74ace8d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:08:19,211::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:08:19,211::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:08:19,211::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fba0a4ca-bfa5-401a-a47a-df5e74ace8d9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:08:19,211::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9f6a2dbe-8c74-4c89-b273-c14817e2ecee`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:08:19,211::task::993::Storage.TaskManager.Task::(_decref) Task=`9f6a2dbe-8c74-4c89-b273-c14817e2ecee`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:08:19,253::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:19,254::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f6a2dbe-8c74-4c89-b273-c14817e2ecee`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:19,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f6a2dbe-8c74-4c89-b273-c14817e2ecee`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:08:19,254::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:08:19,254::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:08:19,254::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:08:19,254::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:08:19,254::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:08:19,254::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:08:19,254::task::993::Storage.TaskManager.Task::(_decref) Task=`9f6a2dbe-8c74-4c89-b273-c14817e2ecee`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:08:20,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`823f8252-fdd4-4481-bee6-7d74bbc31a93`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:08:20,810::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:08:20,810::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) (540263) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:08:20,811::__init__::225::IOProcess::(_processLogs) (540263) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:08:20,812::__init__::225::IOProcess::(_processLogs) DEBUG|(540263) Building response >Thread-19::DEBUG::2014-08-11 17:08:20,812::__init__::225::IOProcess::(_processLogs) (540263) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:20,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:20,812::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:08:20,813::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:20,813::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:08:20,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:20,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:20,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:08:20,814::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:08:20,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:08:20,814::task::1191::Storage.TaskManager.Task::(prepare) Task=`823f8252-fdd4-4481-bee6-7d74bbc31a93`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:08:20,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:08:20,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`823f8252-fdd4-4481-bee6-7d74bbc31a93`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:08:20,815::__init__::225::IOProcess::(_processLogs) (540264) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:08:20,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:08:20,816::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:08:20,816::__init__::225::IOProcess::(_processLogs) (540264) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:08:20,816::task::993::Storage.TaskManager.Task::(_decref) Task=`823f8252-fdd4-4481-bee6-7d74bbc31a93`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:08:20,816::__init__::225::IOProcess::(_processLogs) (540264) Building response >Thread-19::DEBUG::2014-08-11 17:08:20,817::__init__::225::IOProcess::(_processLogs) (540264) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:20,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:20,817::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:08:20,838::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:08:20,892::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:21,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.066604 s, 15.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:21,364::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) (540265) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) (540265) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) (540265) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:21,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:08:21,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:08:21,427::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00337361 s, 147 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:21,427::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) (540266) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) (540266) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:21,428::__init__::225::IOProcess::(_processLogs) (540266) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:21,429::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:21,429::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:08:21,429::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:08:21,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) (540267) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) (540267) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) (540267) Building response >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) (540267) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:21,430::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) (540268) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) (540268) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) (540268) Building response >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) (540268) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:21,431::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:21,432::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:21,432::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:08:21,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:21,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) (540269) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) (540269) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) (540269) Building response >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) (540269) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:21,433::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:08:21,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`8822cd76-fcc6-46f8-b262-17fd940eeef1`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:21,806::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:08:21,806::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00369498', 'lastCheck': '2.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00337361', 'lastCheck': '0.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:21,806::task::1191::Storage.TaskManager.Task::(prepare) Task=`8822cd76-fcc6-46f8-b262-17fd940eeef1`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00369498', 'lastCheck': '2.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00337361', 'lastCheck': '0.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:21,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`8822cd76-fcc6-46f8-b262-17fd940eeef1`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:21,806::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:21,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:21,806::task::993::Storage.TaskManager.Task::(_decref) Task=`8822cd76-fcc6-46f8-b262-17fd940eeef1`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:08:21,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:08:21,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:21,963::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:21,963::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:21,964::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:22,059::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:22,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:22,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:23,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:23,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189278 s, 54.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:08:25,111::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:25,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.074736 s, 13.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:08:26,358::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:26,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:26,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:26,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:27,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:27,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:27,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:27,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:27,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505682 s, 20.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:08:27,882::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:08:28,885::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:28,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:28,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:28,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:28,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:28,886::__init__::225::IOProcess::(_processLogs) (540270) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:28,886::__init__::225::IOProcess::(_processLogs) (540270) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:28,886::__init__::225::IOProcess::(_processLogs) (540270) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:28,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:08:28,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:08:28,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000638319 s, 573 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) (540271) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:28,946::__init__::225::IOProcess::(_processLogs) (540271) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:28,947::__init__::225::IOProcess::(_processLogs) (540271) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:28,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:28,947::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:08:29,330::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:08:29,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`719e0106-7121-440a-8323-670705ca3c3b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:29,330::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:08:29,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:29,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`719e0106-7121-440a-8323-670705ca3c3b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:29,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`719e0106-7121-440a-8323-670705ca3c3b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:29,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:29,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:29,365::task::993::Storage.TaskManager.Task::(_decref) Task=`719e0106-7121-440a-8323-670705ca3c3b`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:08:29,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10197::DEBUG::2014-08-11 17:08:29,429::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:08:29,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e23ea0e-2138-4f9d-8073-f0697a7f0569`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:08:29,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:08:29,430::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2d72bd7a-f080-4c42-8359-27b68d716920`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:08:29,430::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:08:29,431::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:08:29,431::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2d72bd7a-f080-4c42-8359-27b68d716920`::Granted request >Thread-10197::DEBUG::2014-08-11 17:08:29,431::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e23ea0e-2138-4f9d-8073-f0697a7f0569`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:08:29,431::task::993::Storage.TaskManager.Task::(_decref) Task=`3e23ea0e-2138-4f9d-8073-f0697a7f0569`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:08:29,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0640107 s, 16.0 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:08:29,522::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:29,523::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e23ea0e-2138-4f9d-8073-f0697a7f0569`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:29,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e23ea0e-2138-4f9d-8073-f0697a7f0569`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:08:29,523::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:08:29,523::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:08:29,523::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:08:29,523::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:08:29,523::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:08:29,523::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:08:29,523::task::993::Storage.TaskManager.Task::(_decref) Task=`3e23ea0e-2138-4f9d-8073-f0697a7f0569`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:08:31,433::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:31,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:31,433::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:31,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:31,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:31,434::__init__::225::IOProcess::(_processLogs) (540272) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:31,434::__init__::225::IOProcess::(_processLogs) (540272) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:31,434::__init__::225::IOProcess::(_processLogs) (540272) Queuing response >Thread-28::DEBUG::2014-08-11 17:08:31,434::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:08:31,435::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:31,494::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:08:31,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000722028 s, 686 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:31,497::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:31,497::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:31,498::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:31,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:31,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:31,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:31,499::__init__::225::IOProcess::(_processLogs) (540273) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:31,500::__init__::225::IOProcess::(_processLogs) (540273) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:31,501::__init__::225::IOProcess::(_processLogs) (540273) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:31,502::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:31,503::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:08:31,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:08:31,563::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:08:31,564::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:31,564::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:31,564::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) (540274) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) (540274) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) (540274) Building response >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) (540274) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:31,565::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:31,566::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:08:31,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:31,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:31,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:31,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) (540275) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) (540275) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) (540275) Building response >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) (540275) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:31,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) (540276) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) (540276) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540276) Building response >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) (540276) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:08:31,568::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:08:31,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275622 s, 37.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:31,968::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:31,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:31,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:32,072::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:32,074::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:32,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:33,600::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:33,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332734 s, 30.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:08:35,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:35,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410135 s, 25.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:08:35,845::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:36,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:36,980::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:36,980::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:08:37,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f759a53-431b-4597-9101-e1e832588191`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:37,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:08:37,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638319', 'lastCheck': '8.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722028', 'lastCheck': '5.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:37,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f759a53-431b-4597-9101-e1e832588191`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000638319', 'lastCheck': '8.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000722028', 'lastCheck': '5.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:37,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f759a53-431b-4597-9101-e1e832588191`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:37,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:37,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:37,043::task::993::Storage.TaskManager.Task::(_decref) Task=`4f759a53-431b-4597-9101-e1e832588191`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:08:37,059::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:08:37,059::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:37,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:37,083::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:37,083::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:37,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:37,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130621 s, 78.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:38,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:38,948::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:38,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:38,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:38,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:38,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:38,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:38,949::__init__::225::IOProcess::(_processLogs) (540277) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:38,949::__init__::225::IOProcess::(_processLogs) (540277) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:38,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540277) Building response >Thread-19::DEBUG::2014-08-11 17:08:38,950::__init__::225::IOProcess::(_processLogs) (540277) Queuing response >Thread-27::DEBUG::2014-08-11 17:08:38,950::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:08:38,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:39,008::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:08:39,014::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00320389 s, 114 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:39,015::__init__::225::IOProcess::(_processLogs) (540278) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:39,016::__init__::225::IOProcess::(_processLogs) (540278) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:39,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540278) Building response >Thread-19::DEBUG::2014-08-11 17:08:39,016::__init__::225::IOProcess::(_processLogs) (540278) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:39,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:39,017::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:08:39,581::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:08:39,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`f30b63a5-50ea-427f-98c3-c69df7c088aa`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:39,581::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:08:39,595::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:39,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`f30b63a5-50ea-427f-98c3-c69df7c088aa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:39,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`f30b63a5-50ea-427f-98c3-c69df7c088aa`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:39,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:39,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:39,596::task::993::Storage.TaskManager.Task::(_decref) Task=`f30b63a5-50ea-427f-98c3-c69df7c088aa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:08:39,602::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:08:39,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb504433-047c-4b70-857e-40d68c66252c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:08:39,603::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:08:39,603::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e6daabc4-fc65-454e-a01b-c48232fab2c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:08:39,603::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:08:39,603::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:08:39,603::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e6daabc4-fc65-454e-a01b-c48232fab2c2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:08:39,604::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fb504433-047c-4b70-857e-40d68c66252c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:08:39,604::task::993::Storage.TaskManager.Task::(_decref) Task=`fb504433-047c-4b70-857e-40d68c66252c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:08:39,621::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:39,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb504433-047c-4b70-857e-40d68c66252c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:39,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb504433-047c-4b70-857e-40d68c66252c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:08:39,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:08:39,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:08:39,622::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:08:39,622::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:08:39,622::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:08:39,622::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:08:39,622::task::993::Storage.TaskManager.Task::(_decref) Task=`fb504433-047c-4b70-857e-40d68c66252c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:08:39,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:40,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0758848 s, 13.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:08:41,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`d12dda05-24a5-4e63-9609-3e6429c85c99`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:08:41,360::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:08:41,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,360::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:08:41,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) (540279) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) (540279) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:08:41,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540279) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,362::__init__::225::IOProcess::(_processLogs) (540279) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,362::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,362::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:08:41,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,362::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:08:41,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-10102::INFO::2014-08-11 17:08:41,363::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:08:41,363::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:08:41,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`d12dda05-24a5-4e63-9609-3e6429c85c99`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10102::DEBUG::2014-08-11 17:08:41,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`d12dda05-24a5-4e63-9609-3e6429c85c99`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:08:41,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:08:41,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:08:41,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:08:41,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:08:41,365::__init__::225::IOProcess::(_processLogs) (540280) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:08:41,365::task::993::Storage.TaskManager.Task::(_decref) Task=`d12dda05-24a5-4e63-9609-3e6429c85c99`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:08:41,366::__init__::225::IOProcess::(_processLogs) (540280) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:08:41,366::__init__::225::IOProcess::(_processLogs) (540280) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,366::__init__::225::IOProcess::(_processLogs) (540280) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,366::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:08:41,387::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:08:41,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,569::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:41,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:41,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:41,570::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:41,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:41,570::__init__::225::IOProcess::(_processLogs) (540281) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:41,570::__init__::225::IOProcess::(_processLogs) (540281) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:41,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540281) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,574::__init__::225::IOProcess::(_processLogs) (540281) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:08:41,575::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:08:41,636::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000879463 s, 563 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:41,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,639::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:41,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,639::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:41,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:41,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:41,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:41,640::__init__::225::IOProcess::(_processLogs) (540282) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:41,640::__init__::225::IOProcess::(_processLogs) (540282) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:41,640::__init__::225::IOProcess::(_processLogs) (540282) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,640::__init__::225::IOProcess::(_processLogs) (540282) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,640::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:41,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) (540283) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) (540283) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) (540283) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) (540283) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:08:41,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) (540284) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) (540284) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) (540284) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) (540284) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,643::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:41,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:41,644::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:08:41,644::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:41,644::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) (540285) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) (540285) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) (540285) Building response >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) (540285) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:41,645::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:41,984::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:41,985::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:41,985::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:42,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:08:42,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:42,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:42,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:42,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739596 s, 13.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:08:44,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:44,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148094 s, 69.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:08:45,951::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:08:46,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:46,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522328 s, 19.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:46,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:46,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:46,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:47,095::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:47,095::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:47,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:48,374::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:48,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127742 s, 80.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:49,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:49,017::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:49,017::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:49,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:49,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:49,018::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:49,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:49,018::__init__::225::IOProcess::(_processLogs) (540286) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:49,018::__init__::225::IOProcess::(_processLogs) (540286) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:49,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540286) Building response >Thread-19::DEBUG::2014-08-11 17:08:49,041::__init__::225::IOProcess::(_processLogs) (540286) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:49,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:49,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:08:49,042::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:08:49,102::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00101145 s, 362 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) (540287) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) (540287) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:49,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540287) Building response >Thread-19::DEBUG::2014-08-11 17:08:49,104::__init__::225::IOProcess::(_processLogs) (540287) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:49,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:49,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:08:49,654::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:08:49,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`ddd1035f-134e-49e4-bfd5-4a56c4ad1ded`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:49,654::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:08:49,684::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:49,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`ddd1035f-134e-49e4-bfd5-4a56c4ad1ded`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:49,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`ddd1035f-134e-49e4-bfd5-4a56c4ad1ded`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:49,685::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:49,685::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:49,685::task::993::Storage.TaskManager.Task::(_decref) Task=`ddd1035f-134e-49e4-bfd5-4a56c4ad1ded`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:08:49,695::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:08:49,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff8af90b-11d5-4998-ac8d-b0b754f7f127`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:08:49,695::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:08:49,696::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3a9d4d30-2de1-4513-baf3-4bc5cf0339a9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:08:49,696::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:08:49,696::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:08:49,696::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3a9d4d30-2de1-4513-baf3-4bc5cf0339a9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:08:49,696::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff8af90b-11d5-4998-ac8d-b0b754f7f127`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:08:49,696::task::993::Storage.TaskManager.Task::(_decref) Task=`ff8af90b-11d5-4998-ac8d-b0b754f7f127`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:08:49,712::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:49,712::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff8af90b-11d5-4998-ac8d-b0b754f7f127`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:49,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff8af90b-11d5-4998-ac8d-b0b754f7f127`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:08:49,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:08:49,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:08:49,713::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:08:49,713::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:08:49,713::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:08:49,713::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:08:49,713::task::993::Storage.TaskManager.Task::(_decref) Task=`ff8af90b-11d5-4998-ac8d-b0b754f7f127`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:08:50,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:50,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125483 s, 81.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:08:50,853::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:08:51,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:51,645::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:51,645::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:51,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:51,645::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:51,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:51,646::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:51,646::__init__::225::IOProcess::(_processLogs) (540288) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:51,646::__init__::225::IOProcess::(_processLogs) (540288) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:51,646::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(540288) Building response >Thread-28::DEBUG::2014-08-11 17:08:51,646::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:08:51,647::__init__::225::IOProcess::(_processLogs) (540288) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:51,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:51,706::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:08:51,707::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000902689 s, 548 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:51,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:08:51,709::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:51,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:51,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:51,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:51,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:51,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:51,713::__init__::225::IOProcess::(_processLogs) (540289) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:51,714::__init__::225::IOProcess::(_processLogs) (540289) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:51,714::__init__::225::IOProcess::(_processLogs) (540289) Building response >Thread-19::DEBUG::2014-08-11 17:08:51,715::__init__::225::IOProcess::(_processLogs) (540289) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:51,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:51,715::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:08:51,716::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) (540290) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:51,717::__init__::225::IOProcess::(_processLogs) (540290) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) (540290) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:51,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) (540291) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) (540291) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) (540291) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:08:51,719::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:08:51,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:51,720::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:51,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:51,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:51,720::__init__::225::IOProcess::(_processLogs) (540292) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:08:51,721::__init__::225::IOProcess::(_processLogs) (540292) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:08:51,721::__init__::225::IOProcess::(_processLogs) (540292) Building response >Thread-19::DEBUG::2014-08-11 17:08:51,721::__init__::225::IOProcess::(_processLogs) (540292) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:51,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:51,721::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:51,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:51,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:51,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:52,100::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:52,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:52,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:08:52,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2279224-1ed0-493a-8419-fbec1118179f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:52,203::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:08:52,203::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101145', 'lastCheck': '3.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902689', 'lastCheck': '0.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:52,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2279224-1ed0-493a-8419-fbec1118179f`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101145', 'lastCheck': '3.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902689', 'lastCheck': '0.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:08:52,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2279224-1ed0-493a-8419-fbec1118179f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:52,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:52,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:52,204::task::993::Storage.TaskManager.Task::(_decref) Task=`a2279224-1ed0-493a-8419-fbec1118179f`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:08:52,224::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:08:52,224::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:08:52,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:52,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135487 s, 75.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:08:54,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:54,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039572 s, 25.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:08:56,395::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:08:56,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:56,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0474686 s, 21.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:57,003::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:57,004::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:08:57,004::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:57,107::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:57,107::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:08:57,107::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:08:57,963::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:08:58,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:08:58,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042897 s, 23.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:59,105::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:59,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:59,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:59,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:08:59,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:59,105::__init__::225::IOProcess::(_processLogs) (540293) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:59,106::__init__::225::IOProcess::(_processLogs) (540293) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:59,106::__init__::225::IOProcess::(_processLogs) (540293) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:59,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:08:59,107::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:08:59,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000838921 s, 436 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) (540294) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:08:59,167::__init__::225::IOProcess::(_processLogs) (540294) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:08:59,168::__init__::225::IOProcess::(_processLogs) (540294) Queuing response >Thread-19::DEBUG::2014-08-11 17:08:59,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:08:59,168::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:08:59,767::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:08:59,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1d9e1f8-4185-4b1e-8c1e-aea2df4d7249`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:08:59,768::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:08:59,853::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:59,853::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1d9e1f8-4185-4b1e-8c1e-aea2df4d7249`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:08:59,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1d9e1f8-4185-4b1e-8c1e-aea2df4d7249`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:08:59,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:08:59,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:08:59,853::task::993::Storage.TaskManager.Task::(_decref) Task=`e1d9e1f8-4185-4b1e-8c1e-aea2df4d7249`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:08:59,865::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:08:59,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba2085c6-03e4-4add-a8da-f4624192ec3a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:08:59,866::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:08:59,866::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d39888bd-2eb9-4ad8-b5fe-ae9dbcf84071`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:08:59,866::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:08:59,866::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:08:59,866::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d39888bd-2eb9-4ad8-b5fe-ae9dbcf84071`::Granted request >Thread-10197::DEBUG::2014-08-11 17:08:59,866::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ba2085c6-03e4-4add-a8da-f4624192ec3a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:08:59,866::task::993::Storage.TaskManager.Task::(_decref) Task=`ba2085c6-03e4-4add-a8da-f4624192ec3a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:08:59,883::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:59,883::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba2085c6-03e4-4add-a8da-f4624192ec3a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:08:59,883::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba2085c6-03e4-4add-a8da-f4624192ec3a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:08:59,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:08:59,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:08:59,884::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:08:59,884::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:08:59,884::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:08:59,884::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:08:59,884::task::993::Storage.TaskManager.Task::(_decref) Task=`ba2085c6-03e4-4add-a8da-f4624192ec3a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:09:00,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:01,057::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505821 s, 20.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:01,721::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:01,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:01,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:01,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:01,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:01,724::__init__::225::IOProcess::(_processLogs) (540295) Finding callback 'statvfs'... >Thread-28::DEBUG::2014-08-11 17:09:01,725::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:09:01,725::__init__::225::IOProcess::(_processLogs) (540295) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:01,784::__init__::225::IOProcess::(_processLogs) (540295) Building response >Thread-19::DEBUG::2014-08-11 17:09:01,786::__init__::225::IOProcess::(_processLogs) (540295) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:01,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:01,788::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:09:01,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00551001 s, 89.8 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:01,806::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:01,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:01,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:01,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:01,809::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:01,810::__init__::225::IOProcess::(_processLogs) (540296) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:01,811::__init__::225::IOProcess::(_processLogs) (540296) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:01,811::__init__::225::IOProcess::(_processLogs) (540296) Building response >Thread-19::DEBUG::2014-08-11 17:09:01,811::__init__::225::IOProcess::(_processLogs) (540296) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:01,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:01,812::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:09:01,813::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:09:01,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:01,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:01,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:01,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:01,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:01,816::__init__::225::IOProcess::(_processLogs) (540297) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:01,816::__init__::225::IOProcess::(_processLogs) (540297) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:01,817::__init__::225::IOProcess::(_processLogs) (540297) Building response >Thread-19::DEBUG::2014-08-11 17:09:01,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:01,818::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:01,819::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:09:01,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:01,820::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:01,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:01,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:01,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:01,822::__init__::225::IOProcess::(_processLogs) (540298) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:01,822::__init__::225::IOProcess::(_processLogs) (540298) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:01,823::__init__::225::IOProcess::(_processLogs) (540298) Building response >Thread-19::DEBUG::2014-08-11 17:09:01,823::__init__::225::IOProcess::(_processLogs) (540298) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:01,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:01,824::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:01,825::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:09:01,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:01,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:01,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:01,827::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:01,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:01,828::__init__::225::IOProcess::(_processLogs) (540299) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:01,828::__init__::225::IOProcess::(_processLogs) (540299) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:01,829::__init__::225::IOProcess::(_processLogs) (540299) Building response >Thread-19::DEBUG::2014-08-11 17:09:01,829::__init__::225::IOProcess::(_processLogs) (540299) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:01,830::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:02,010::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:02,012::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:02,014::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:02,112::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:02,114::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:02,116::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:03,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:03,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014482 s, 70.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:05,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:05,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562329 s, 18.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:09:05,899::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:07,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:07,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:07,022::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:07,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:07,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:07,123::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:07,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:07,350::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0192336 s, 53.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:09:07,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0f368c3-02d9-42c5-b061-de5368f629e0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:07,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:09:07,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838921', 'lastCheck': '8.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00551001', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:07,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0f368c3-02d9-42c5-b061-de5368f629e0`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838921', 'lastCheck': '8.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00551001', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:07,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0f368c3-02d9-42c5-b061-de5368f629e0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:07,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:07,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:07,435::task::993::Storage.TaskManager.Task::(_decref) Task=`f0f368c3-02d9-42c5-b061-de5368f629e0`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:09:07,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:09:07,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) (540300) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:09,169::__init__::225::IOProcess::(_processLogs) (540300) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:09,170::__init__::225::IOProcess::(_processLogs) (540300) Building response >Thread-19::DEBUG::2014-08-11 17:09:09,170::__init__::225::IOProcess::(_processLogs) (540300) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:09,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:09:09,170::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:09:09,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00170004 s, 215 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) (540301) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:09,233::__init__::225::IOProcess::(_processLogs) (540301) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:09,235::__init__::225::IOProcess::(_processLogs) (540301) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:09,235::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:09:09,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:09,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126319 s, 81.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:09:09,922::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:09:09,922::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6176098-f3e4-46d1-a669-b6a11cf6603f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:09,923::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:09:09,959::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:09,959::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6176098-f3e4-46d1-a669-b6a11cf6603f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:09,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6176098-f3e4-46d1-a669-b6a11cf6603f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:09,959::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:09,959::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:09,959::task::993::Storage.TaskManager.Task::(_decref) Task=`a6176098-f3e4-46d1-a669-b6a11cf6603f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:09:09,971::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:09:09,971::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee24c757-96fa-418b-a415-ece9bd774195`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:09:09,971::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:09:09,971::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5e41f11d-2e67-4e75-a08e-c02094f4bda2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:09:09,971::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:09:09,971::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:09:09,971::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5e41f11d-2e67-4e75-a08e-c02094f4bda2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:09:09,972::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ee24c757-96fa-418b-a415-ece9bd774195`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:09:09,972::task::993::Storage.TaskManager.Task::(_decref) Task=`ee24c757-96fa-418b-a415-ece9bd774195`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:09:10,017::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:10,017::task::1191::Storage.TaskManager.Task::(prepare) Task=`ee24c757-96fa-418b-a415-ece9bd774195`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:10,017::task::595::Storage.TaskManager.Task::(_updateState) Task=`ee24c757-96fa-418b-a415-ece9bd774195`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:09:10,017::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:09:10,017::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:09:10,017::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:09:10,017::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:09:10,017::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:09:10,018::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:09:10,018::task::993::Storage.TaskManager.Task::(_decref) Task=`ee24c757-96fa-418b-a415-ece9bd774195`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:09:11,422::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:09:11,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:11,566::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.069978 s, 14.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) (540302) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:11,832::__init__::225::IOProcess::(_processLogs) (540302) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:11,842::__init__::225::IOProcess::(_processLogs) (540302) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:11,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:09:11,843::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:09:11,902::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000417619 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:11,902::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:11,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:11,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:11,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:11,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:11,903::__init__::225::IOProcess::(_processLogs) (540303) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:11,903::__init__::225::IOProcess::(_processLogs) (540303) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:11,903::__init__::225::IOProcess::(_processLogs) (540303) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:11,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) (540304) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) (540304) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) (540304) Building response >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) (540304) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:11,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) (540305) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) (540305) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) (540305) Building response >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) (540305) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:11,906::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:09:11,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:11,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:11,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:11,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:11,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:11,908::__init__::225::IOProcess::(_processLogs) (540306) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:11,908::__init__::225::IOProcess::(_processLogs) (540306) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:11,908::__init__::225::IOProcess::(_processLogs) (540306) Building response >Thread-19::DEBUG::2014-08-11 17:09:11,908::__init__::225::IOProcess::(_processLogs) (540306) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:11,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:11,908::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:12,027::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:12,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:12,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:12,128::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:12,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:12,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:13,574::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:13,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0589508 s, 17.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:15,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:15,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037679 s, 27.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:09:16,022::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:17,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:17,030::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:17,030::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:17,135::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:17,135::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:17,136::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:17,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:17,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471551 s, 21.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:19,236::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:19,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:19,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:19,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:19,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:19,237::__init__::225::IOProcess::(_processLogs) (540307) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:19,237::__init__::225::IOProcess::(_processLogs) (540307) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:19,238::__init__::225::IOProcess::(_processLogs) (540307) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:19,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:09:19,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:09:19,299::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00112559 s, 325 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) (540308) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) (540308) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:19,300::__init__::225::IOProcess::(_processLogs) (540308) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:19,301::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:09:19,919::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:20,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554037 s, 18.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:09:20,076::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:09:20,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`35094969-f3ef-4229-a059-455741fd6cd7`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:20,077::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:09:20,091::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:20,091::task::1191::Storage.TaskManager.Task::(prepare) Task=`35094969-f3ef-4229-a059-455741fd6cd7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:20,091::task::595::Storage.TaskManager.Task::(_updateState) Task=`35094969-f3ef-4229-a059-455741fd6cd7`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:20,091::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:20,091::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:20,091::task::993::Storage.TaskManager.Task::(_decref) Task=`35094969-f3ef-4229-a059-455741fd6cd7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:09:20,102::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:09:20,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`fef42ea2-4dab-4a00-91ae-3fe87b68df69`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:09:20,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:09:20,103::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6e82c046-5ba3-4972-ab0c-7dbe8a7fc399`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:09:20,103::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:09:20,103::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:09:20,103::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6e82c046-5ba3-4972-ab0c-7dbe8a7fc399`::Granted request >Thread-10197::DEBUG::2014-08-11 17:09:20,104::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fef42ea2-4dab-4a00-91ae-3fe87b68df69`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:09:20,104::task::993::Storage.TaskManager.Task::(_decref) Task=`fef42ea2-4dab-4a00-91ae-3fe87b68df69`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:09:20,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:20,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`fef42ea2-4dab-4a00-91ae-3fe87b68df69`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:20,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`fef42ea2-4dab-4a00-91ae-3fe87b68df69`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:09:20,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:09:20,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:09:20,133::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:09:20,133::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:09:20,133::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:09:20,133::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:09:20,133::task::993::Storage.TaskManager.Task::(_decref) Task=`fef42ea2-4dab-4a00-91ae-3fe87b68df69`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:09:20,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`39a54e6b-89dd-42d7-bae1-cea8d6b0ee61`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:09:20,902::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:09:20,902::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:09:20,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:20,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:20,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:20,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:20,903::__init__::225::IOProcess::(_processLogs) (540309) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:09:20,903::__init__::225::IOProcess::(_processLogs) (540309) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:09:20,906::__init__::225::IOProcess::(_processLogs) (540309) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:20,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) (540310) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) (540310) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:09:20,907::__init__::225::IOProcess::(_processLogs) (540310) Building response >Thread-19::DEBUG::2014-08-11 17:09:20,908::__init__::225::IOProcess::(_processLogs) (540310) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:20,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:20,908::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::INFO::2014-08-11 17:09:20,908::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:09:20,908::task::1191::Storage.TaskManager.Task::(prepare) Task=`39a54e6b-89dd-42d7-bae1-cea8d6b0ee61`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:09:20,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`39a54e6b-89dd-42d7-bae1-cea8d6b0ee61`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:09:20,908::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:09:20,908::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10017::DEBUG::2014-08-11 17:09:20,908::task::993::Storage.TaskManager.Task::(_decref) Task=`39a54e6b-89dd-42d7-bae1-cea8d6b0ee61`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:09:20,930::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:09:21,908::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:21,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:21,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:21,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:21,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:21,909::__init__::225::IOProcess::(_processLogs) (540311) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:21,909::__init__::225::IOProcess::(_processLogs) (540311) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:21,909::__init__::225::IOProcess::(_processLogs) (540311) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:21,909::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:09:21,910::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:09:21,969::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000996881 s, 497 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:21,970::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:21,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:21,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:21,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:21,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:21,971::__init__::225::IOProcess::(_processLogs) (540312) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:21,971::__init__::225::IOProcess::(_processLogs) (540312) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:21,971::__init__::225::IOProcess::(_processLogs) (540312) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:21,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) (540313) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:21,972::__init__::225::IOProcess::(_processLogs) (540313) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) (540313) Building response >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) (540313) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:21,973::__init__::225::IOProcess::(_processLogs) (540314) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) (540314) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) (540314) Building response >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) (540314) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:09:21,974::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:09:21,975::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:21,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:21,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:21,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:21,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:21,975::__init__::225::IOProcess::(_processLogs) (540315) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:21,976::__init__::225::IOProcess::(_processLogs) (540315) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:21,976::__init__::225::IOProcess::(_processLogs) (540315) Building response >Thread-19::DEBUG::2014-08-11 17:09:21,976::__init__::225::IOProcess::(_processLogs) (540315) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:21,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:21,976::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:22,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:22,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:22,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:22,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:22,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289932 s, 35.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:09:22,141::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:22,142::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:22,142::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:09:22,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`01ed4892-f131-4700-b0bb-89d77c782a9b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:22,757::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:09:22,757::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112559', 'lastCheck': '3.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000996881', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:22,758::task::1191::Storage.TaskManager.Task::(prepare) Task=`01ed4892-f131-4700-b0bb-89d77c782a9b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112559', 'lastCheck': '3.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000996881', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:22,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`01ed4892-f131-4700-b0bb-89d77c782a9b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:22,758::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:22,758::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:22,758::task::993::Storage.TaskManager.Task::(_decref) Task=`01ed4892-f131-4700-b0bb-89d77c782a9b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:09:22,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:09:22,777::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:24,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:24,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492337 s, 20.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:26,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:26,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281324 s, 36.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:09:26,430::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:27,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:27,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:27,043::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:27,145::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:27,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:27,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:09:28,035::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:09:28,351::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:28,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0565512 s, 18.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:29,302::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:09:29,302::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:29,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:29,302::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:29,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:29,302::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:09:29,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:09:29,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:29,361::__init__::225::IOProcess::(_processLogs) (540316) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:29,362::__init__::225::IOProcess::(_processLogs) (540316) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:29,363::__init__::225::IOProcess::(_processLogs) (540316) Building response >Thread-19::DEBUG::2014-08-11 17:09:29,363::__init__::225::IOProcess::(_processLogs) (540316) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:29,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:29,364::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:09:29,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00749081 s, 48.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:29,385::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) (540317) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:29,386::__init__::225::IOProcess::(_processLogs) (540317) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:29,387::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|(540317) Building response >Thread-19::DEBUG::2014-08-11 17:09:29,387::__init__::225::IOProcess::(_processLogs) (540317) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:29,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:29,387::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:09:30,198::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:09:30,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`e83e92c1-ed0e-483c-9897-a397f50c5e8c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:30,198::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:09:30,222::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:30,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`e83e92c1-ed0e-483c-9897-a397f50c5e8c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:30,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`e83e92c1-ed0e-483c-9897-a397f50c5e8c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:30,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:30,223::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:30,223::task::993::Storage.TaskManager.Task::(_decref) Task=`e83e92c1-ed0e-483c-9897-a397f50c5e8c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:09:30,232::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:09:30,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fb11fc-f7a4-4d04-972c-ebb24664c0c8`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:09:30,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:09:30,233::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dca0a556-8709-4d0e-b4a1-3e7a93af622b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:09:30,233::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:09:30,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:09:30,233::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dca0a556-8709-4d0e-b4a1-3e7a93af622b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:09:30,233::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b6fb11fc-f7a4-4d04-972c-ebb24664c0c8`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:09:30,233::task::993::Storage.TaskManager.Task::(_decref) Task=`b6fb11fc-f7a4-4d04-972c-ebb24664c0c8`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:09:30,255::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:30,255::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6fb11fc-f7a4-4d04-972c-ebb24664c0c8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:30,255::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6fb11fc-f7a4-4d04-972c-ebb24664c0c8`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:09:30,255::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:09:30,255::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:09:30,255::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:09:30,255::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:09:30,255::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:09:30,255::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:09:30,256::task::993::Storage.TaskManager.Task::(_decref) Task=`b6fb11fc-f7a4-4d04-972c-ebb24664c0c8`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:09:30,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:30,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0258365 s, 39.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:31,976::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:09:31,977::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:31,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:31,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:31,978::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:31,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:09:31,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:09:31,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:32,040::__init__::225::IOProcess::(_processLogs) (540318) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:32,042::__init__::225::IOProcess::(_processLogs) (540318) Got request for method 'statvfs' >Thread-28::DEBUG::2014-08-11 17:09:32,043::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00133361 s, 371 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:32,043::__init__::225::IOProcess::(_processLogs) (540318) Building response >Thread-19::DEBUG::2014-08-11 17:09:32,045::__init__::225::IOProcess::(_processLogs) (540318) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:32,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:32,048::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:32,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:09:32,051::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:32,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:32,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:32,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:32,057::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:09:32,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:32,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:32,059::__init__::225::IOProcess::(_processLogs) (540319) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:32,060::__init__::225::IOProcess::(_processLogs) (540319) Got request for method 'statvfs' >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:32,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:09:32,061::__init__::225::IOProcess::(_processLogs) (540319) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:32,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:32,063::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:09:32,064::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:09:32,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:32,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:32,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:32,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:32,066::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:32,066::__init__::225::IOProcess::(_processLogs) (540320) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:32,067::__init__::225::IOProcess::(_processLogs) (540320) Building response >Thread-19::DEBUG::2014-08-11 17:09:32,068::__init__::225::IOProcess::(_processLogs) (540320) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:32,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:32,069::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:32,069::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:09:32,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:32,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:32,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:32,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:32,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:32,072::__init__::225::IOProcess::(_processLogs) (540321) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:32,072::__init__::225::IOProcess::(_processLogs) (540321) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:32,073::__init__::225::IOProcess::(_processLogs) (540321) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:32,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:32,074::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:32,075::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:09:32,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:32,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:32,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:32,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:32,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:32,078::__init__::225::IOProcess::(_processLogs) (540322) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:32,078::__init__::225::IOProcess::(_processLogs) (540322) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:32,086::__init__::225::IOProcess::(_processLogs) (540322) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:32,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:32,087::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:09:32,151::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:32,153::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:32,155::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:32,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:32,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500087 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:34,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:34,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235195 s, 43.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:09:35,938::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:09:36,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:36,889::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0555757 s, 18.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:37,065::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:37,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:37,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:37,161::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:37,161::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:37,162::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:09:37,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5634a52-ef72-4914-a878-c3279f97d719`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:37,990::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:09:37,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00749081', 'lastCheck': '8.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133361', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:37,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5634a52-ef72-4914-a878-c3279f97d719`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00749081', 'lastCheck': '8.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00133361', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:37,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5634a52-ef72-4914-a878-c3279f97d719`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:37,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:37,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:37,990::task::993::Storage.TaskManager.Task::(_decref) Task=`a5634a52-ef72-4914-a878-c3279f97d719`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:09:38,008::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:09:38,009::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:38,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:38,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02883 s, 35.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) (540323) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:39,388::__init__::225::IOProcess::(_processLogs) (540323) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:39,389::__init__::225::IOProcess::(_processLogs) (540323) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:39,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:09:39,390::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:09:39,449::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00107366 s, 341 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:39,450::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:39,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:39,451::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:39,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:39,452::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:39,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:39,454::__init__::225::IOProcess::(_processLogs) (540324) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:39,454::__init__::225::IOProcess::(_processLogs) (540324) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:39,455::__init__::225::IOProcess::(_processLogs) (540324) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:39,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:39,457::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:09:40,647::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:09:40,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf4e6105-7280-4f4a-852d-dcddb5f30de2`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:40,648::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:09:40,662::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:40,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf4e6105-7280-4f4a-852d-dcddb5f30de2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:40,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf4e6105-7280-4f4a-852d-dcddb5f30de2`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:40,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:40,663::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:40,663::task::993::Storage.TaskManager.Task::(_decref) Task=`cf4e6105-7280-4f4a-852d-dcddb5f30de2`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:09:40,673::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:09:40,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`14e06d7f-41d0-4c7b-9237-e27e391a64af`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:09:40,673::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:09:40,674::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4e04d687-4056-4ee6-8746-0be6055ffe3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:09:40,674::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:09:40,674::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:09:40,674::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4e04d687-4056-4ee6-8746-0be6055ffe3f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:09:40,675::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`14e06d7f-41d0-4c7b-9237-e27e391a64af`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:09:40,675::task::993::Storage.TaskManager.Task::(_decref) Task=`14e06d7f-41d0-4c7b-9237-e27e391a64af`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:09:40,692::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:40,692::task::1191::Storage.TaskManager.Task::(prepare) Task=`14e06d7f-41d0-4c7b-9237-e27e391a64af`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:40,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`14e06d7f-41d0-4c7b-9237-e27e391a64af`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:09:40,692::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:09:40,692::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:09:40,692::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:09:40,692::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:09:40,692::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:09:40,693::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:09:40,693::task::993::Storage.TaskManager.Task::(_decref) Task=`14e06d7f-41d0-4c7b-9237-e27e391a64af`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:09:40,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:41,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136899 s, 74.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:09:41,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a067816-2a81-4dd5-b930-20458d01437e`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:09:41,448::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) (540325) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:09:41,449::__init__::225::IOProcess::(_processLogs) (540325) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:09:41,451::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540325) Building response >Thread-19::DEBUG::2014-08-11 17:09:41,451::__init__::225::IOProcess::(_processLogs) (540325) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:41,452::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:41,452::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:09:41,452::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:09:41,452::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:09:41,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:41,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:41,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:41,453::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:09:41,453::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:09:41,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:09:41,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a067816-2a81-4dd5-b930-20458d01437e`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:09:41,454::__init__::225::IOProcess::(_processLogs) (540326) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:09:41,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a067816-2a81-4dd5-b930-20458d01437e`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:09:41,455::__init__::225::IOProcess::(_processLogs) (540326) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:09:41,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:09:41,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:09:41,455::__init__::225::IOProcess::(_processLogs) (540326) Building response >Thread-10102::DEBUG::2014-08-11 17:09:41,455::task::993::Storage.TaskManager.Task::(_decref) Task=`1a067816-2a81-4dd5-b930-20458d01437e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:09:41,456::__init__::225::IOProcess::(_processLogs) (540326) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:41,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:41,456::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:09:41,478::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:42,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:42,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:42,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) (540327) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:42,089::__init__::225::IOProcess::(_processLogs) (540327) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:42,090::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540327) Building response >Thread-19::DEBUG::2014-08-11 17:09:42,090::__init__::225::IOProcess::(_processLogs) (540327) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:42,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:42,091::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:09:42,091::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:09:42,168::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:42,168::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:42,169::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-28::DEBUG::2014-08-11 17:09:42,177::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00222521 s, 222 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) (540328) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:42,178::__init__::225::IOProcess::(_processLogs) (540328) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:42,179::__init__::225::IOProcess::(_processLogs) (540328) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:42,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:42,179::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:09:42,179::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) (540329) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) (540329) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) (540329) Building response >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) (540329) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:42,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:42,181::__init__::225::IOProcess::(_processLogs) (540330) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) (540330) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) (540330) Building response >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) (540330) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:42,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) (540331) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) (540331) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) (540331) Building response >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) (540331) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:42,183::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:09:43,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:43,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541526 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:45,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:45,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01284 s, 79.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:09:46,055::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:47,074::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:47,074::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:47,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:47,174::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:47,175::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:47,175::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:47,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:47,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0517979 s, 19.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:49,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:09:49,459::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:49,459::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:49,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:49,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:49,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:49,460::__init__::225::IOProcess::(_processLogs) (540332) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:49,460::__init__::225::IOProcess::(_processLogs) (540332) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:49,473::__init__::225::IOProcess::(_processLogs) (540332) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:49,473::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:09:49,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:09:49,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00132527 s, 276 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:49,550::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:49,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:49,552::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:49,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:49,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:49,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:49,555::__init__::225::IOProcess::(_processLogs) (540333) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:49,556::__init__::225::IOProcess::(_processLogs) (540333) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:09:49,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0821018 s, 12.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:49,558::__init__::225::IOProcess::(_processLogs) (540333) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:49,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:49,560::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:09:50,725::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:09:50,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`5172e3f5-a4e2-44ad-a92e-afb24929c63c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:50,726::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:09:50,776::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:50,776::task::1191::Storage.TaskManager.Task::(prepare) Task=`5172e3f5-a4e2-44ad-a92e-afb24929c63c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:09:50,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`5172e3f5-a4e2-44ad-a92e-afb24929c63c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:50,776::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:50,776::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:50,776::task::993::Storage.TaskManager.Task::(_decref) Task=`5172e3f5-a4e2-44ad-a92e-afb24929c63c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:09:50,788::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:09:50,788::task::595::Storage.TaskManager.Task::(_updateState) Task=`31df2ed6-aada-49e1-83d0-0d38879ef666`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:09:50,788::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:09:50,788::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c7b9a2c7-39a9-469d-bfb4-00a7fdd2c61b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:09:50,788::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:09:50,788::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:09:50,788::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c7b9a2c7-39a9-469d-bfb4-00a7fdd2c61b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:09:50,789::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`31df2ed6-aada-49e1-83d0-0d38879ef666`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:09:50,789::task::993::Storage.TaskManager.Task::(_decref) Task=`31df2ed6-aada-49e1-83d0-0d38879ef666`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:09:50,812::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:50,812::task::1191::Storage.TaskManager.Task::(prepare) Task=`31df2ed6-aada-49e1-83d0-0d38879ef666`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:09:50,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`31df2ed6-aada-49e1-83d0-0d38879ef666`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:09:50,812::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:09:50,812::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:09:50,812::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:09:50,812::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:09:50,812::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:09:50,812::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:09:50,812::task::993::Storage.TaskManager.Task::(_decref) Task=`31df2ed6-aada-49e1-83d0-0d38879ef666`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:09:50,962::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:09:51,595::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:51,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387627 s, 26.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:52,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:52,081::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:52,081::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:52,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:52,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:52,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:09:52,183::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:52,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:52,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:52,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:52,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:52,184::__init__::225::IOProcess::(_processLogs) (540334) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:52,184::__init__::225::IOProcess::(_processLogs) (540334) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:52,184::__init__::225::IOProcess::(_processLogs) (540334) Queuing response >Thread-28::DEBUG::2014-08-11 17:09:52,185::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:09:52,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:52,243::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:09:52,245::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000902706 s, 548 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) (540335) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) (540335) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:52,246::__init__::225::IOProcess::(_processLogs) (540335) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:52,247::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:09:52,247::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:09:52,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:52,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:52,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:52,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:52,248::__init__::225::IOProcess::(_processLogs) (540336) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:52,248::__init__::225::IOProcess::(_processLogs) (540336) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:52,249::__init__::225::IOProcess::(_processLogs) (540336) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:52,249::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:52,249::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:09:52,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) (540337) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) (540337) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:52,250::__init__::225::IOProcess::(_processLogs) (540337) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:52,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) (540338) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) (540338) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) (540338) Building response >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) (540338) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:52,252::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:09:53,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1211620-8245-41a5-a144-97e45e794155`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:09:53,186::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:09:53,186::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132527', 'lastCheck': '3.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902706', 'lastCheck': '0.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:53,186::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1211620-8245-41a5-a144-97e45e794155`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132527', 'lastCheck': '3.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000902706', 'lastCheck': '0.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:09:53,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1211620-8245-41a5-a144-97e45e794155`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:09:53,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:09:53,187::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:09:53,187::task::993::Storage.TaskManager.Task::(_decref) Task=`d1211620-8245-41a5-a144-97e45e794155`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:09:53,205::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:09:53,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:53,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:53,818::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0587634 s, 17.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:09:55,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:55,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186003 s, 55.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:09:56,539::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:57,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:57,092::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:09:57,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:57,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:57,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:09:57,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:09:57,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:09:58,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498807 s, 20.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:09:58,087::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:09:59,559::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) (540339) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) (540339) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:59,560::__init__::225::IOProcess::(_processLogs) (540339) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:59,561::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:09:59,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:09:59,561::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:09:59,621::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000397704 s, 920 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:09:59,623::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:09:59,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:09:59,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:09:59,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:09:59,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:09:59,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:09:59,626::__init__::225::IOProcess::(_processLogs) (540340) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:09:59,627::__init__::225::IOProcess::(_processLogs) (540340) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:09:59,628::__init__::225::IOProcess::(_processLogs) (540340) Queuing response >Thread-19::DEBUG::2014-08-11 17:09:59,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:09:59,630::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:10:00,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:00,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311165 s, 32.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:00,860::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:10:00,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`23d5ff32-6e29-4b58-9446-a995e886e24e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:00,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:10:00,922::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:00,922::task::1191::Storage.TaskManager.Task::(prepare) Task=`23d5ff32-6e29-4b58-9446-a995e886e24e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:00,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`23d5ff32-6e29-4b58-9446-a995e886e24e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:00,923::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:00,923::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:00,923::task::993::Storage.TaskManager.Task::(_decref) Task=`23d5ff32-6e29-4b58-9446-a995e886e24e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:10:00,929::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:10:00,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e097c86-b627-45cb-b2c4-4c730ddcc8e3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:10:00,930::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:10:00,930::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`208a468f-4ce8-4937-8339-d268b889d12f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:10:00,930::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:10:00,930::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:10:00,930::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`208a468f-4ce8-4937-8339-d268b889d12f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:10:00,931::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e097c86-b627-45cb-b2c4-4c730ddcc8e3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:10:00,931::task::993::Storage.TaskManager.Task::(_decref) Task=`6e097c86-b627-45cb-b2c4-4c730ddcc8e3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:10:00,947::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:00,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e097c86-b627-45cb-b2c4-4c730ddcc8e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:00,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e097c86-b627-45cb-b2c4-4c730ddcc8e3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:10:00,947::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:10:00,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:10:00,947::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:10:00,947::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:10:00,948::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:10:00,948::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:10:00,948::task::993::Storage.TaskManager.Task::(_decref) Task=`6e097c86-b627-45cb-b2c4-4c730ddcc8e3`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:02,105::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:02,109::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:02,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:02,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:10:02,196::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:02,230::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:02,236::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:02,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0563032 s, 18.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:02,254::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:02,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:02,256::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:02,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:02,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:02,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:02,260::__init__::225::IOProcess::(_processLogs) (540341) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:02,261::__init__::225::IOProcess::(_processLogs) (540341) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:02,263::__init__::225::IOProcess::(_processLogs) (540341) Queuing response >Thread-28::DEBUG::2014-08-11 17:10:02,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:10:02,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:02,353::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:10:02,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.002758 s, 179 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:02,356::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:02,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:02,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:02,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:02,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:02,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:02,361::__init__::225::IOProcess::(_processLogs) (540342) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:02,362::__init__::225::IOProcess::(_processLogs) (540342) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:02,363::__init__::225::IOProcess::(_processLogs) (540342) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:02,364::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:02,365::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:10:02,366::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:10:02,367::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:02,368::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:02,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:02,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:02,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:02,371::__init__::225::IOProcess::(_processLogs) (540343) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:02,372::__init__::225::IOProcess::(_processLogs) (540343) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:02,372::__init__::225::IOProcess::(_processLogs) (540343) Building response >Thread-19::DEBUG::2014-08-11 17:10:02,374::__init__::225::IOProcess::(_processLogs) (540343) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:02,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:02,376::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:02,377::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:10:02,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:02,378::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:02,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:02,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:02,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:02,384::__init__::225::IOProcess::(_processLogs) (540344) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:02,385::__init__::225::IOProcess::(_processLogs) (540344) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:02,388::__init__::225::IOProcess::(_processLogs) (540344) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:02,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:02,390::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:02,391::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:10:02,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:02,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:02,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:02,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:02,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:02,396::__init__::225::IOProcess::(_processLogs) (540345) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:02,397::__init__::225::IOProcess::(_processLogs) (540345) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:02,397::__init__::225::IOProcess::(_processLogs) (540345) Building response >Thread-19::DEBUG::2014-08-11 17:10:02,398::__init__::225::IOProcess::(_processLogs) (540345) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:02,399::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:10:04,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:04,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0761519 s, 13.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:10:05,969::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:10:06,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:06,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0787724 s, 13.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:07,117::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:07,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:07,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:07,245::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:07,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:07,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:10:08,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`2158a7b9-3573-4750-b0de-a34e493ff59a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:08,406::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:10:08,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397704', 'lastCheck': '8.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.002758', 'lastCheck': '6.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:08,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`2158a7b9-3573-4750-b0de-a34e493ff59a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000397704', 'lastCheck': '8.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.002758', 'lastCheck': '6.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:08,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`2158a7b9-3573-4750-b0de-a34e493ff59a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:08,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:08,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:08,407::task::993::Storage.TaskManager.Task::(_decref) Task=`2158a7b9-3573-4750-b0de-a34e493ff59a`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:10:08,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:10:08,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:08,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:08,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132227 s, 77.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) (540346) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:09,630::__init__::225::IOProcess::(_processLogs) (540346) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:09,631::__init__::225::IOProcess::(_processLogs) (540346) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:09,632::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:10:09,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:10:09,692::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000302648 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:09,694::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:09,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:09,695::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:09,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:09,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:09,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:09,697::__init__::225::IOProcess::(_processLogs) (540347) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:09,697::__init__::225::IOProcess::(_processLogs) (540347) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:09,698::__init__::225::IOProcess::(_processLogs) (540347) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:09,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:09,700::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:10:10,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:10,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121746 s, 84.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:11,025::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:10:11,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa4a4b68-3c79-453c-a7d0-61bce7597be4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:11,026::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:10:11,040::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:11,040::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa4a4b68-3c79-453c-a7d0-61bce7597be4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:11,040::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa4a4b68-3c79-453c-a7d0-61bce7597be4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:11,040::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:11,040::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:11,040::task::993::Storage.TaskManager.Task::(_decref) Task=`fa4a4b68-3c79-453c-a7d0-61bce7597be4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:10:11,051::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:10:11,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`6930fd1f-57c1-47c7-95fe-58a60a31b8d2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:10:11,051::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:10:11,052::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`da6e1a38-4e16-4142-9e6e-fb2a63dfb476`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:10:11,052::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:10:11,052::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:10:11,052::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`da6e1a38-4e16-4142-9e6e-fb2a63dfb476`::Granted request >Thread-10197::DEBUG::2014-08-11 17:10:11,052::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6930fd1f-57c1-47c7-95fe-58a60a31b8d2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:10:11,052::task::993::Storage.TaskManager.Task::(_decref) Task=`6930fd1f-57c1-47c7-95fe-58a60a31b8d2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:10:11,068::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:11,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`6930fd1f-57c1-47c7-95fe-58a60a31b8d2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:11,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`6930fd1f-57c1-47c7-95fe-58a60a31b8d2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:10:11,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:10:11,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:10:11,069::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:10:11,069::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:10:11,069::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:10:11,069::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:10:11,069::task::993::Storage.TaskManager.Task::(_decref) Task=`6930fd1f-57c1-47c7-95fe-58a60a31b8d2`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:10:11,545::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:12,124::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:12,124::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:12,125::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:12,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:12,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:12,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) (540348) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) (540348) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:12,401::__init__::225::IOProcess::(_processLogs) (540348) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:12,402::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:10:12,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:10:12,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000388645 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:12,461::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:12,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:12,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:12,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:12,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:12,462::__init__::225::IOProcess::(_processLogs) (540349) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:12,462::__init__::225::IOProcess::(_processLogs) (540349) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:12,462::__init__::225::IOProcess::(_processLogs) (540349) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:12,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) (540350) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:12,463::__init__::225::IOProcess::(_processLogs) (540350) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) (540350) Building response >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) (540350) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:12,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) (540351) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) (540351) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) (540351) Building response >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) (540351) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:10:12,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:12,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:12,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:12,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:12,466::__init__::225::IOProcess::(_processLogs) (540352) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:12,466::__init__::225::IOProcess::(_processLogs) (540352) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:12,466::__init__::225::IOProcess::(_processLogs) (540352) Building response >Thread-19::DEBUG::2014-08-11 17:10:12,467::__init__::225::IOProcess::(_processLogs) (540352) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:12,467::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:12,467::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:10:12,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:12,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484078 s, 21.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:10:14,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:15,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520588 s, 19.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:10:16,104::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:10:17,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:17,174::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:17,176::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:17,179::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:17,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309611 s, 33.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:10:17,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:17,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:17,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:19,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:19,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523574 s, 19.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:19,700::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:19,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:19,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:19,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:19,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:19,701::__init__::225::IOProcess::(_processLogs) (540353) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:19,701::__init__::225::IOProcess::(_processLogs) (540353) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:19,701::__init__::225::IOProcess::(_processLogs) (540353) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:19,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:10:19,702::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:10:19,702::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:10:19,763::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00104613 s, 350 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:19,765::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:19,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:19,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:19,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:19,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:19,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:19,768::__init__::225::IOProcess::(_processLogs) (540354) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:19,769::__init__::225::IOProcess::(_processLogs) (540354) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:19,770::__init__::225::IOProcess::(_processLogs) (540354) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:19,771::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:19,772::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:10:20,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c4dc59f-461d-4699-9184-b563497bba27`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:10:20,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:10:20,972::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:10:20,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:20,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:20,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:20,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:20,973::__init__::225::IOProcess::(_processLogs) (540355) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:10:20,973::__init__::225::IOProcess::(_processLogs) (540355) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:10:20,975::__init__::225::IOProcess::(_processLogs) (540355) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:20,976::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:10:20,976::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:10:20,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:20,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:10:20,977::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:10:20,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:10:20,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c4dc59f-461d-4699-9184-b563497bba27`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:10:20,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:10:20,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c4dc59f-461d-4699-9184-b563497bba27`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:10:20,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:10:20,979::__init__::225::IOProcess::(_processLogs) (540356) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:10:20,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:10:20,981::__init__::225::IOProcess::(_processLogs) (540356) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:10:20,981::task::993::Storage.TaskManager.Task::(_decref) Task=`1c4dc59f-461d-4699-9184-b563497bba27`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:10:20,981::__init__::225::IOProcess::(_processLogs) (540356) Building response >Thread-19::DEBUG::2014-08-11 17:10:20,982::__init__::225::IOProcess::(_processLogs) (540356) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:20,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:20,982::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:10:21,003::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:10:21,106::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:10:21,106::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c7ca245-7473-4b5a-9014-62a6a2b6ec46`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:21,106::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:10:21,174::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:21,174::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c7ca245-7473-4b5a-9014-62a6a2b6ec46`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:21,174::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c7ca245-7473-4b5a-9014-62a6a2b6ec46`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:21,174::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:21,174::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:21,174::task::993::Storage.TaskManager.Task::(_decref) Task=`2c7ca245-7473-4b5a-9014-62a6a2b6ec46`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:10:21,187::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:10:21,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`68c3db25-2804-4901-8828-f33ae45ee095`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:10:21,187::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:10:21,188::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`595caf40-4b00-4abf-9fd1-0f775a9f1105`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:10:21,188::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:10:21,188::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:10:21,188::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`595caf40-4b00-4abf-9fd1-0f775a9f1105`::Granted request >Thread-10197::DEBUG::2014-08-11 17:10:21,188::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`68c3db25-2804-4901-8828-f33ae45ee095`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:10:21,188::task::993::Storage.TaskManager.Task::(_decref) Task=`68c3db25-2804-4901-8828-f33ae45ee095`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:10:21,204::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:21,204::task::1191::Storage.TaskManager.Task::(prepare) Task=`68c3db25-2804-4901-8828-f33ae45ee095`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:21,204::task::595::Storage.TaskManager.Task::(_updateState) Task=`68c3db25-2804-4901-8828-f33ae45ee095`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:10:21,204::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:10:21,204::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:10:21,205::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:10:21,205::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:10:21,205::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:10:21,205::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:10:21,205::task::993::Storage.TaskManager.Task::(_decref) Task=`68c3db25-2804-4901-8828-f33ae45ee095`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:10:21,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:21,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0516513 s, 19.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:22,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:22,186::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:22,186::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:22,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:22,261::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:22,261::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:10:22,466::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:22,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:22,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:22,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:22,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:22,467::__init__::225::IOProcess::(_processLogs) (540357) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:22,467::__init__::225::IOProcess::(_processLogs) (540357) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:22,479::__init__::225::IOProcess::(_processLogs) (540357) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:22,480::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:10:22,480::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:10:22,539::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000472581 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:22,540::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:22,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:22,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:22,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:22,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:22,540::__init__::225::IOProcess::(_processLogs) (540358) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:22,541::__init__::225::IOProcess::(_processLogs) (540358) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:22,541::__init__::225::IOProcess::(_processLogs) (540358) Building response >Thread-19::DEBUG::2014-08-11 17:10:22,541::__init__::225::IOProcess::(_processLogs) (540358) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:22,541::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) (540359) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:22,542::__init__::225::IOProcess::(_processLogs) (540359) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) (540359) Building response >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) (540359) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:22,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) (540360) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) (540360) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) (540360) Building response >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) (540360) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:10:22,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:22,545::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:22,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:22,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:22,545::__init__::225::IOProcess::(_processLogs) (540361) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:22,545::__init__::225::IOProcess::(_processLogs) (540361) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:22,545::__init__::225::IOProcess::(_processLogs) (540361) Building response >Thread-19::DEBUG::2014-08-11 17:10:22,546::__init__::225::IOProcess::(_processLogs) (540361) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:22,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:22,546::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:10:23,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:23,573::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422964 s, 24.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:23,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bb5363b-3d50-4f37-8861-bd799103715e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:23,586::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:10:23,586::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104613', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472581', 'lastCheck': '1.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:23,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bb5363b-3d50-4f37-8861-bd799103715e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104613', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000472581', 'lastCheck': '1.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:23,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bb5363b-3d50-4f37-8861-bd799103715e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:23,586::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:23,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:23,587::task::993::Storage.TaskManager.Task::(_decref) Task=`2bb5363b-3d50-4f37-8861-bd799103715e`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:10:23,603::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:10:23,603::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:25,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:25,652::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131993 s, 77.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:10:26,553::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:27,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:27,191::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:27,191::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:27,266::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:27,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:27,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:27,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:27,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497742 s, 20.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:10:28,116::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:10:29,771::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) (540362) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) (540362) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:29,772::__init__::225::IOProcess::(_processLogs) (540362) Queuing response >Thread-27::DEBUG::2014-08-11 17:10:29,773::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:10:29,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:29,832::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:10:29,833::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-27::DEBUG::2014-08-11 17:10:29,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000774347 s, 473 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:29,895::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:29,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:29,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:29,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:29,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:29,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:29,899::__init__::225::IOProcess::(_processLogs) (540363) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:29,899::__init__::225::IOProcess::(_processLogs) (540363) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:29,900::__init__::225::IOProcess::(_processLogs) (540363) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:29,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:29,902::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:10:29,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0339423 s, 30.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:31,267::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:10:31,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`51975ea2-52e3-4eba-a19c-d3861f3e47c3`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:31,268::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:10:31,337::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:31,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`51975ea2-52e3-4eba-a19c-d3861f3e47c3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:31,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`51975ea2-52e3-4eba-a19c-d3861f3e47c3`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:31,337::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:31,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:31,337::task::993::Storage.TaskManager.Task::(_decref) Task=`51975ea2-52e3-4eba-a19c-d3861f3e47c3`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:10:31,348::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:10:31,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`e33c8c69-5546-44fd-bb35-d3ab787a5647`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:10:31,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:10:31,348::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9b8a7726-74d2-4c39-9822-11dfb23bdc9b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:10:31,348::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:10:31,348::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:10:31,349::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9b8a7726-74d2-4c39-9822-11dfb23bdc9b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:10:31,349::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e33c8c69-5546-44fd-bb35-d3ab787a5647`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:10:31,349::task::993::Storage.TaskManager.Task::(_decref) Task=`e33c8c69-5546-44fd-bb35-d3ab787a5647`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:10:31,366::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:31,366::task::1191::Storage.TaskManager.Task::(prepare) Task=`e33c8c69-5546-44fd-bb35-d3ab787a5647`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:31,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`e33c8c69-5546-44fd-bb35-d3ab787a5647`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:10:31,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:10:31,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:10:31,366::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:10:31,366::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:10:31,366::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:10:31,366::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:10:31,367::task::993::Storage.TaskManager.Task::(_decref) Task=`e33c8c69-5546-44fd-bb35-d3ab787a5647`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:10:31,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:32,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0609654 s, 16.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:32,198::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:32,200::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:32,202::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:32,270::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:32,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:32,274::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:10:32,546::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:32,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:32,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:32,548::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:32,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:32,549::__init__::225::IOProcess::(_processLogs) (540364) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:32,549::__init__::225::IOProcess::(_processLogs) (540364) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:32,550::__init__::225::IOProcess::(_processLogs) (540364) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:32,551::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:10:32,552::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:10:32,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00222181 s, 223 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:32,617::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:32,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:32,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:32,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:32,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:32,620::__init__::225::IOProcess::(_processLogs) (540365) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:32,621::__init__::225::IOProcess::(_processLogs) (540365) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:32,621::__init__::225::IOProcess::(_processLogs) (540365) Building response >Thread-19::DEBUG::2014-08-11 17:10:32,621::__init__::225::IOProcess::(_processLogs) (540365) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:32,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:32,622::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:10:32,623::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:10:32,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:32,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:32,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:32,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:32,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:32,626::__init__::225::IOProcess::(_processLogs) (540366) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) (540366) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) (540366) Building response >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) (540366) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:32,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) (540367) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) (540367) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) (540367) Building response >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) (540367) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:10:32,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) (540368) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) (540368) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:32,629::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540368) Building response >Thread-19::DEBUG::2014-08-11 17:10:32,630::__init__::225::IOProcess::(_processLogs) (540368) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:32,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:32,630::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:10:34,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:34,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355774 s, 28.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:10:36,010::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:10:36,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:36,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0214782 s, 47.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:37,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:37,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:37,208::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:37,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:37,281::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:37,281::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:38,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:38,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142818 s, 71.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:38,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`656cdf90-acab-42f0-ada2-2f7b062f18ac`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:38,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:10:38,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774347', 'lastCheck': '8.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00222181', 'lastCheck': '6.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:38,785::task::1191::Storage.TaskManager.Task::(prepare) Task=`656cdf90-acab-42f0-ada2-2f7b062f18ac`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000774347', 'lastCheck': '8.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00222181', 'lastCheck': '6.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:38,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`656cdf90-acab-42f0-ada2-2f7b062f18ac`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:38,785::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:38,785::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:38,785::task::993::Storage.TaskManager.Task::(_decref) Task=`656cdf90-acab-42f0-ada2-2f7b062f18ac`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:10:38,805::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:10:38,805::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:10:39,902::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:39,902::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:39,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:39,903::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:39,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:39,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:39,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:39,903::__init__::225::IOProcess::(_processLogs) (540369) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:39,903::__init__::225::IOProcess::(_processLogs) (540369) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:39,904::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540369) Building response >Thread-19::DEBUG::2014-08-11 17:10:39,904::__init__::225::IOProcess::(_processLogs) (540369) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:39,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:39,904::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:10:39,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:10:39,965::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00137488 s, 266 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:39,966::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:39,967::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:39,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:39,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:39,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:39,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:39,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:39,971::__init__::225::IOProcess::(_processLogs) (540370) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:39,972::__init__::225::IOProcess::(_processLogs) (540370) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:39,972::__init__::225::IOProcess::(_processLogs) (540370) Building response >Thread-19::DEBUG::2014-08-11 17:10:39,973::__init__::225::IOProcess::(_processLogs) (540370) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:39,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:39,974::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:10:40,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:40,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143482 s, 71.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:41,420::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:10:41,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bdd46fa-f23e-4a8e-bf48-22f08ab47a62`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:41,421::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:10:41,473::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:41,474::task::1191::Storage.TaskManager.Task::(prepare) Task=`3bdd46fa-f23e-4a8e-bf48-22f08ab47a62`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:41,474::task::595::Storage.TaskManager.Task::(_updateState) Task=`3bdd46fa-f23e-4a8e-bf48-22f08ab47a62`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:41,474::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:41,474::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:41,474::task::993::Storage.TaskManager.Task::(_decref) Task=`3bdd46fa-f23e-4a8e-bf48-22f08ab47a62`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:10:41,481::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:10:41,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c5e71a6-458b-4cd0-ae65-2996506cba04`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:10:41,481::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:10:41,481::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`294f3764-7410-4811-9065-fe527f2b1434`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:10:41,481::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:10:41,482::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:10:41,482::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`294f3764-7410-4811-9065-fe527f2b1434`::Granted request >Thread-10197::DEBUG::2014-08-11 17:10:41,483::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4c5e71a6-458b-4cd0-ae65-2996506cba04`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:10:41,483::task::993::Storage.TaskManager.Task::(_decref) Task=`4c5e71a6-458b-4cd0-ae65-2996506cba04`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:10:41,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:41,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c5e71a6-458b-4cd0-ae65-2996506cba04`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:41,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c5e71a6-458b-4cd0-ae65-2996506cba04`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:10:41,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:10:41,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:10:41,509::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:10:41,509::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:10:41,509::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:10:41,509::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:10:41,509::task::993::Storage.TaskManager.Task::(_decref) Task=`4c5e71a6-458b-4cd0-ae65-2996506cba04`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:10:41,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`35e12c5c-0ca4-4716-bcfc-81f329c83399`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:10:41,555::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:10:41,555::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) (540371) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:10:41,556::__init__::225::IOProcess::(_processLogs) (540371) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:10:41,560::__init__::225::IOProcess::(_processLogs) DEBUG|(540371) Building response >Thread-19::DEBUG::2014-08-11 17:10:41,560::__init__::225::IOProcess::(_processLogs) (540371) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:41,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:41,561::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:10:41,561::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:41,561::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:10:41,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:41,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:41,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:41,562::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:10:41,562::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:10:41,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:10:41,562::task::1191::Storage.TaskManager.Task::(prepare) Task=`35e12c5c-0ca4-4716-bcfc-81f329c83399`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:10:41,563::__init__::225::IOProcess::(_processLogs) (540372) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:10:41,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`35e12c5c-0ca4-4716-bcfc-81f329c83399`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:10:41,563::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:10:41,563::__init__::225::IOProcess::(_processLogs) (540372) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:10:41,564::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:10:41,564::__init__::225::IOProcess::(_processLogs) (540372) Building response >Thread-10102::DEBUG::2014-08-11 17:10:41,564::task::993::Storage.TaskManager.Task::(_decref) Task=`35e12c5c-0ca4-4716-bcfc-81f329c83399`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:10:41,565::__init__::225::IOProcess::(_processLogs) (540372) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:41,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:41,565::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:10:41,586::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:42,210::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:42,211::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:42,211::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:42,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:42,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:42,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:42,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:42,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125776 s, 81.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:42,630::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:42,630::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:42,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) (540373) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) (540373) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:42,631::__init__::225::IOProcess::(_processLogs) DEBUG|(540373) Building response >Thread-28::DEBUG::2014-08-11 17:10:42,632::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:10:42,632::__init__::225::IOProcess::(_processLogs) (540373) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:42,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:42,691::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:10:42,691::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00044529 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) (540374) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:42,692::__init__::225::IOProcess::(_processLogs) (540374) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:42,693::__init__::225::IOProcess::(_processLogs) (540374) Building response >Thread-19::DEBUG::2014-08-11 17:10:42,693::__init__::225::IOProcess::(_processLogs) (540374) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:42,693::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:10:42,693::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:42,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) (540375) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) (540375) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) (540375) Building response >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) (540375) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:10:42,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) (540376) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) (540376) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) (540376) Building response >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) (540376) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:42,696::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:42,697::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:42,697::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:10:42,697::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:42,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:42,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) (540377) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) (540377) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) (540377) Building response >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) (540377) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:42,698::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:10:44,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:44,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124147 s, 82.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:10:46,183::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:10:46,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:46,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0274155 s, 37.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:47,215::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:47,216::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:47,216::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:47,290::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:47,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:47,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:48,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:48,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122884 s, 83.3 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:10:49,971::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:10:49,972::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:49,972::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:10:49,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:49,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:49,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:49,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:49,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:49,973::__init__::225::IOProcess::(_processLogs) (540378) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:10:49,973::__init__::225::IOProcess::(_processLogs) (540378) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:10:49,973::__init__::225::IOProcess::(_processLogs) (540378) Building response >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) (540378) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) (540379) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:10:49,974::__init__::225::IOProcess::(_processLogs) (540379) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:10:49,975::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540379) Building response >Thread-19::DEBUG::2014-08-11 17:10:49,975::__init__::225::IOProcess::(_processLogs) (540379) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:49,975::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:10:49,975::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:10:49,979::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:10:49,979::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:49,979::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) (540380) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:10:49,980::__init__::225::IOProcess::(_processLogs) (540380) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:10:50,003::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540380) Building response >Thread-19::DEBUG::2014-08-11 17:10:50,003::__init__::225::IOProcess::(_processLogs) (540380) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:50,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:50,004::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:10:50,005::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:10:50,006::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:50,007::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:10:50,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:50,008::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:50,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:50,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:50,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:50,010::__init__::225::IOProcess::(_processLogs) (540381) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:10:50,010::__init__::225::IOProcess::(_processLogs) (540381) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:10:50,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540381) Building response >Thread-19::DEBUG::2014-08-11 17:10:50,028::__init__::225::IOProcess::(_processLogs) (540381) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:50,029::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:10:50,029::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:10:50,029::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-19::DEBUG::2014-08-11 17:10:50,030::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:50,030::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:10:50,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) (540382) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) (540382) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) (540382) Building response >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) (540382) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:50,031::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) (540383) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:10:50,032::__init__::225::IOProcess::(_processLogs) (540383) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:10:50,040::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540383) Building response >Thread-19::DEBUG::2014-08-11 17:10:50,040::__init__::225::IOProcess::(_processLogs) (540383) Queuing response >Thread-27::DEBUG::2014-08-11 17:10:50,040::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:10:50,040::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-27::INFO::2014-08-11 17:10:50,041::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:10:50,041::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-27::INFO::2014-08-11 17:10:50,041::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:50,042::__init__::225::IOProcess::(_processLogs) (540384) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:50,043::__init__::225::IOProcess::(_processLogs) (540384) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:50,049::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540384) Building response >Thread-19::DEBUG::2014-08-11 17:10:50,050::__init__::225::IOProcess::(_processLogs) (540384) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:50,050::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:10:50,050::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:10:50,050::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:10:50,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000582561 s, 628 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:50,112::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:50,113::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:50,114::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:50,115::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:50,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:50,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:50,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:50,118::__init__::225::IOProcess::(_processLogs) (540385) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:50,120::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540385) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:50,121::__init__::225::IOProcess::(_processLogs) (540385) Building response >Thread-19::DEBUG::2014-08-11 17:10:50,122::__init__::225::IOProcess::(_processLogs) (540385) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:50,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:50,123::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:10:50,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:50,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013089 s, 78.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:10:51,018::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:10:51,541::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:10:51,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`341e91b9-5600-4771-ad47-ffeca618d176`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:51,541::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:10:51,554::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:51,555::task::1191::Storage.TaskManager.Task::(prepare) Task=`341e91b9-5600-4771-ad47-ffeca618d176`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:10:51,555::task::595::Storage.TaskManager.Task::(_updateState) Task=`341e91b9-5600-4771-ad47-ffeca618d176`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:51,555::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:51,555::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:51,555::task::993::Storage.TaskManager.Task::(_decref) Task=`341e91b9-5600-4771-ad47-ffeca618d176`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:10:51,564::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:10:51,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`79824d09-53b3-418b-833e-856f27f0bd6e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:10:51,564::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:10:51,564::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0e5e1266-5475-4e4f-937a-a8bddbc7e077`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:10:51,564::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:10:51,564::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:10:51,565::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0e5e1266-5475-4e4f-937a-a8bddbc7e077`::Granted request >Thread-10197::DEBUG::2014-08-11 17:10:51,566::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`79824d09-53b3-418b-833e-856f27f0bd6e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:10:51,566::task::993::Storage.TaskManager.Task::(_decref) Task=`79824d09-53b3-418b-833e-856f27f0bd6e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:10:51,634::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:51,634::task::1191::Storage.TaskManager.Task::(prepare) Task=`79824d09-53b3-418b-833e-856f27f0bd6e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:10:51,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`79824d09-53b3-418b-833e-856f27f0bd6e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:10:51,634::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:10:51,634::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:10:51,635::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:10:51,635::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:10:51,635::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:10:51,635::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:10:51,635::task::993::Storage.TaskManager.Task::(_decref) Task=`79824d09-53b3-418b-833e-856f27f0bd6e`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:52,217::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:52,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:52,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:52,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:52,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:52,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:52,698::__init__::225::IOProcess::(_processLogs) (540386) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:52,699::__init__::225::IOProcess::(_processLogs) (540386) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:52,699::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540386) Building response >Thread-28::DEBUG::2014-08-11 17:10:52,699::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:10:52,699::__init__::225::IOProcess::(_processLogs) (540386) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:52,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:52,758::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:10:52,759::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000838654 s, 590 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) (540387) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:10:52,760::__init__::225::IOProcess::(_processLogs) (540387) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:10:52,761::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540387) Building response >Thread-19::DEBUG::2014-08-11 17:10:52,761::__init__::225::IOProcess::(_processLogs) (540387) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:52,761::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:52,761::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:10:52,761::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) (540388) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) (540388) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:52,762::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540388) Building response >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) (540388) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:52,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) (540389) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) (540389) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540389) Building response >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) (540389) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:10:52,764::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:10:52,765::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:10:52,765::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:10:52,765::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:10:52,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:10:52,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:10:52,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:10:52,766::__init__::225::IOProcess::(_processLogs) (540390) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:10:52,766::__init__::225::IOProcess::(_processLogs) (540390) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:10:52,766::__init__::225::IOProcess::(_processLogs) (540390) Building response >Thread-19::DEBUG::2014-08-11 17:10:52,766::__init__::225::IOProcess::(_processLogs) (540390) Queuing response >Thread-19::DEBUG::2014-08-11 17:10:52,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:10:52,766::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:10:52,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:53,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429837 s, 23.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:10:53,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fa9fc1a-1bfd-4b6d-9aa5-786da69e486a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:10:53,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:10:53,989::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582561', 'lastCheck': '3.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838654', 'lastCheck': '1.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:53,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fa9fc1a-1bfd-4b6d-9aa5-786da69e486a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000582561', 'lastCheck': '3.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000838654', 'lastCheck': '1.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:10:53,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fa9fc1a-1bfd-4b6d-9aa5-786da69e486a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:10:53,989::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:10:53,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:10:53,989::task::993::Storage.TaskManager.Task::(_decref) Task=`8fa9fc1a-1bfd-4b6d-9aa5-786da69e486a`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:10:54,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:10:54,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:55,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:55,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549459 s, 18.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:10:56,594::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:10:57,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:57,227::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:57,230::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:10:57,233::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:10:57,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280354 s, 36.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:10:57,303::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:57,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:10:57,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:10:58,226::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:10:59,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:10:59,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501547 s, 20.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:00,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:00,122::__init__::225::IOProcess::(_processLogs) (540391) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:00,122::__init__::225::IOProcess::(_processLogs) (540391) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:00,122::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540391) Building response >Thread-19::DEBUG::2014-08-11 17:11:00,122::__init__::225::IOProcess::(_processLogs) (540391) Queuing response >Thread-27::DEBUG::2014-08-11 17:11:00,123::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:11:00,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:00,182::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:11:00,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000934727 s, 392 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:00,185::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:00,186::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:00,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:00,187::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:00,187::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:00,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:00,188::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:00,189::__init__::225::IOProcess::(_processLogs) (540392) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:00,190::__init__::225::IOProcess::(_processLogs) (540392) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:00,190::__init__::225::IOProcess::(_processLogs) (540392) Building response >Thread-19::DEBUG::2014-08-11 17:11:00,190::__init__::225::IOProcess::(_processLogs) (540392) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:00,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:00,191::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:11:01,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:01,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291228 s, 35.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:11:01,675::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:11:01,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`293c9db2-4a1c-44bf-ad5c-228c6d069896`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:01,678::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:11:01,711::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:01,711::task::1191::Storage.TaskManager.Task::(prepare) Task=`293c9db2-4a1c-44bf-ad5c-228c6d069896`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:01,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`293c9db2-4a1c-44bf-ad5c-228c6d069896`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:01,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:01,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:01,713::task::993::Storage.TaskManager.Task::(_decref) Task=`293c9db2-4a1c-44bf-ad5c-228c6d069896`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:11:01,724::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:11:01,725::task::595::Storage.TaskManager.Task::(_updateState) Task=`263f1a19-69e0-4ba4-95e8-1a3929f29652`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:11:01,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:11:01,728::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`478b3514-8a36-44a8-8aaa-2db58ae05b2c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:11:01,728::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:11:01,729::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:11:01,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`478b3514-8a36-44a8-8aaa-2db58ae05b2c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:11:01,731::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`263f1a19-69e0-4ba4-95e8-1a3929f29652`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:11:01,732::task::993::Storage.TaskManager.Task::(_decref) Task=`263f1a19-69e0-4ba4-95e8-1a3929f29652`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:11:01,795::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:01,795::task::1191::Storage.TaskManager.Task::(prepare) Task=`263f1a19-69e0-4ba4-95e8-1a3929f29652`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:01,796::task::595::Storage.TaskManager.Task::(_updateState) Task=`263f1a19-69e0-4ba4-95e8-1a3929f29652`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:11:01,796::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:11:01,796::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:11:01,797::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:11:01,798::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:11:01,798::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:11:01,798::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:11:01,799::task::993::Storage.TaskManager.Task::(_decref) Task=`263f1a19-69e0-4ba4-95e8-1a3929f29652`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:02,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:02,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:02,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:02,308::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:02,310::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:02,312::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) (540393) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:02,766::__init__::225::IOProcess::(_processLogs) (540393) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:02,767::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540393) Building response >Thread-19::DEBUG::2014-08-11 17:11:02,768::__init__::225::IOProcess::(_processLogs) (540393) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:02,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:02,768::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:11:02,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:11:02,829::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00142637 s, 347 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:02,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:02,831::__init__::225::IOProcess::(_processLogs) (540394) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:02,831::__init__::225::IOProcess::(_processLogs) (540394) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:02,831::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540394) Building response >Thread-19::DEBUG::2014-08-11 17:11:02,831::__init__::225::IOProcess::(_processLogs) (540394) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:02,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) (540395) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) (540395) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) (540395) Building response >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) (540395) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:02,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) (540396) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) (540396) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) (540396) Building response >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) (540396) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:02,834::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:02,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:02,836::__init__::225::IOProcess::(_processLogs) (540397) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:02,836::__init__::225::IOProcess::(_processLogs) (540397) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:02,836::__init__::225::IOProcess::(_processLogs) (540397) Building response >Thread-19::DEBUG::2014-08-11 17:11:02,836::__init__::225::IOProcess::(_processLogs) (540397) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:02,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:02,836::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:11:03,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:03,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171418 s, 59.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:11:05,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:05,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385432 s, 26.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:11:06,026::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:07,250::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:07,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:07,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:07,317::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:07,318::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:07,318::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:07,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:07,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0149119 s, 68.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:11:09,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`0706bca8-871d-42cd-88ca-f967e562ac77`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:09,284::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:11:09,284::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000934727', 'lastCheck': '9.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142637', 'lastCheck': '6.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:09,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`0706bca8-871d-42cd-88ca-f967e562ac77`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000934727', 'lastCheck': '9.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142637', 'lastCheck': '6.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:09,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`0706bca8-871d-42cd-88ca-f967e562ac77`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:09,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:09,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:09,284::task::993::Storage.TaskManager.Task::(_decref) Task=`0706bca8-871d-42cd-88ca-f967e562ac77`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:11:09,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:11:09,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:09,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:09,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799358 s, 12.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) (540398) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:10,190::__init__::225::IOProcess::(_processLogs) (540398) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:10,191::__init__::225::IOProcess::(_processLogs) (540398) Building response >Thread-19::DEBUG::2014-08-11 17:11:10,191::__init__::225::IOProcess::(_processLogs) (540398) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:10,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:10,191::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:11:10,191::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:11:10,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000915207 s, 400 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:10,254::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:10,254::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:10,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:10,255::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:10,256::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:10,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:10,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:10,256::__init__::225::IOProcess::(_processLogs) (540399) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:10,257::__init__::225::IOProcess::(_processLogs) DEBUG|(540399) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:10,257::__init__::225::IOProcess::(_processLogs) (540399) Building response >Thread-19::DEBUG::2014-08-11 17:11:10,257::__init__::225::IOProcess::(_processLogs) (540399) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:10,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:10,257::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:11:11,620::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:11:11,895::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:11:11,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`1642c981-46fc-4abf-93c7-e8dbd8f68e3e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:11,895::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:11:11,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:11,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0294951 s, 34.7 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:11:11,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:11,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`1642c981-46fc-4abf-93c7-e8dbd8f68e3e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:12,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`1642c981-46fc-4abf-93c7-e8dbd8f68e3e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:12,000::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:12,000::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:12,000::task::993::Storage.TaskManager.Task::(_decref) Task=`1642c981-46fc-4abf-93c7-e8dbd8f68e3e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:11:12,012::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:11:12,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`b352601e-0baa-4993-ab61-e256ee5b29b4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:11:12,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:11:12,013::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`af105f79-f7b3-46d6-9eed-0e7d372b512b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:11:12,013::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:11:12,013::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:11:12,013::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`af105f79-f7b3-46d6-9eed-0e7d372b512b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:11:12,014::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b352601e-0baa-4993-ab61-e256ee5b29b4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:11:12,014::task::993::Storage.TaskManager.Task::(_decref) Task=`b352601e-0baa-4993-ab61-e256ee5b29b4`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:11:12,030::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:12,030::task::1191::Storage.TaskManager.Task::(prepare) Task=`b352601e-0baa-4993-ab61-e256ee5b29b4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:12,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`b352601e-0baa-4993-ab61-e256ee5b29b4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:11:12,030::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:11:12,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:11:12,031::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:11:12,031::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:11:12,031::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:11:12,031::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:11:12,031::task::993::Storage.TaskManager.Task::(_decref) Task=`b352601e-0baa-4993-ab61-e256ee5b29b4`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:12,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:12,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:12,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:12,321::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:12,321::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:12,321::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:11:12,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:12,836::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:12,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:12,836::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:12,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:12,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:12,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:12,837::__init__::225::IOProcess::(_processLogs) (540400) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:12,837::__init__::225::IOProcess::(_processLogs) (540400) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:12,852::__init__::225::IOProcess::(_processLogs) DEBUG|(540400) Building response >Thread-19::DEBUG::2014-08-11 17:11:12,852::__init__::225::IOProcess::(_processLogs) (540400) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:12,852::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:12,852::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:11:12,853::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:11:12,935::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000806301 s, 614 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:12,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:12,935::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:12,935::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) (540401) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) (540401) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:12,936::__init__::225::IOProcess::(_processLogs) DEBUG|(540401) Building response >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) (540401) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:12,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) (540402) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) (540402) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) (540402) Building response >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) (540402) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:12,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:12,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) (540403) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) (540403) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) (540403) Building response >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) (540403) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:12,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:12,941::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:12,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:12,941::__init__::225::IOProcess::(_processLogs) (540404) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:12,941::__init__::225::IOProcess::(_processLogs) (540404) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:12,941::__init__::225::IOProcess::(_processLogs) (540404) Building response >Thread-19::DEBUG::2014-08-11 17:11:12,941::__init__::225::IOProcess::(_processLogs) (540404) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:12,942::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:12,942::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:11:14,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:14,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522476 s, 19.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:11:16,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:11:16,255::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:11:16,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0801934 s, 12.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:17,268::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:17,269::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:17,269::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:17,327::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:17,327::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:17,328::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:18,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:18,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453938 s, 22.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) (540405) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:20,258::__init__::225::IOProcess::(_processLogs) (540405) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:20,259::__init__::225::IOProcess::(_processLogs) DEBUG|(540405) Building response >Thread-19::DEBUG::2014-08-11 17:11:20,259::__init__::225::IOProcess::(_processLogs) (540405) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:20,259::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:11:20,260::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:11:20,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:11:20,323::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000606176 s, 604 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:20,323::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:20,323::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) (540406) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) (540406) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:20,324::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540406) Building response >Thread-19::DEBUG::2014-08-11 17:11:20,325::__init__::225::IOProcess::(_processLogs) (540406) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:20,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:20,325::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:11:20,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:20,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172448 s, 59.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:11:21,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6c504be-ef70-4d54-93fa-6af96bf51de9`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:11:21,029::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:11:21,029::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:21,029::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:11:21,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:21,029::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:21,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:21,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:21,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:21,030::__init__::225::IOProcess::(_processLogs) (540407) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:11:21,030::__init__::225::IOProcess::(_processLogs) (540407) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:11:21,032::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540407) Building response >Thread-19::DEBUG::2014-08-11 17:11:21,032::__init__::225::IOProcess::(_processLogs) (540407) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:21,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:21,032::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:11:21,033::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:21,033::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:11:21,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:21,033::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:21,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:21,034::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:11:21,034::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:11:21,034::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:11:21,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6c504be-ef70-4d54-93fa-6af96bf51de9`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:11:21,035::__init__::225::IOProcess::(_processLogs) (540408) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:11:21,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6c504be-ef70-4d54-93fa-6af96bf51de9`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:11:21,035::__init__::225::IOProcess::(_processLogs) (540408) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:11:21,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:11:21,036::__init__::225::IOProcess::(_processLogs) (540408) Building response >Thread-10017::DEBUG::2014-08-11 17:11:21,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:11:21,036::__init__::225::IOProcess::(_processLogs) (540408) Queuing response >Thread-10017::DEBUG::2014-08-11 17:11:21,036::task::993::Storage.TaskManager.Task::(_decref) Task=`c6c504be-ef70-4d54-93fa-6af96bf51de9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:11:21,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:21,037::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:11:21,059::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:11:22,098::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:11:22,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`c11ea176-8a33-4d2e-9117-62f7194019c7`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:22,099::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:11:22,115::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:22,115::task::1191::Storage.TaskManager.Task::(prepare) Task=`c11ea176-8a33-4d2e-9117-62f7194019c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:22,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`c11ea176-8a33-4d2e-9117-62f7194019c7`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:22,115::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:22,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:22,115::task::993::Storage.TaskManager.Task::(_decref) Task=`c11ea176-8a33-4d2e-9117-62f7194019c7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:11:22,126::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:11:22,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1e7537d-1210-43de-9413-c72e21735657`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:11:22,127::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:11:22,127::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dcd489fa-8748-4b99-8c99-85314f2fb869`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:11:22,127::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:11:22,127::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:11:22,127::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dcd489fa-8748-4b99-8c99-85314f2fb869`::Granted request >Thread-10197::DEBUG::2014-08-11 17:11:22,127::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b1e7537d-1210-43de-9413-c72e21735657`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:11:22,128::task::993::Storage.TaskManager.Task::(_decref) Task=`b1e7537d-1210-43de-9413-c72e21735657`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:11:22,144::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:22,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`b1e7537d-1210-43de-9413-c72e21735657`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:22,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`b1e7537d-1210-43de-9413-c72e21735657`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:11:22,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:11:22,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:11:22,144::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:11:22,144::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:11:22,144::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:11:22,144::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:11:22,144::task::993::Storage.TaskManager.Task::(_decref) Task=`b1e7537d-1210-43de-9413-c72e21735657`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:22,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:22,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:22,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:22,333::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:22,333::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:22,333::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:22,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:22,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0229286 s, 44.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) (540409) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:22,942::__init__::225::IOProcess::(_processLogs) (540409) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:22,943::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540409) Building response >Thread-19::DEBUG::2014-08-11 17:11:22,943::__init__::225::IOProcess::(_processLogs) (540409) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:22,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:22,944::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:11:22,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:11:23,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00142715 s, 347 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) (540410) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:23,005::__init__::225::IOProcess::(_processLogs) (540410) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:23,006::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540410) Building response >Thread-19::DEBUG::2014-08-11 17:11:23,006::__init__::225::IOProcess::(_processLogs) (540410) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:23,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:23,006::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:11:23,007::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:23,007::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:11:23,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:23,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:23,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:23,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) (540411) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) (540411) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) (540411) Building response >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) (540411) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:11:23,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) (540412) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) (540412) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) (540412) Building response >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) (540412) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:23,009::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:23,010::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:11:23,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:23,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:23,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:23,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:23,011::__init__::225::IOProcess::(_processLogs) (540413) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:23,011::__init__::225::IOProcess::(_processLogs) (540413) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:23,011::__init__::225::IOProcess::(_processLogs) (540413) Building response >Thread-19::DEBUG::2014-08-11 17:11:23,011::__init__::225::IOProcess::(_processLogs) (540413) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:23,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:23,011::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:11:24,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b5d6c42-1bcd-4664-9ff5-dd4bf00f56be`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:24,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:11:24,538::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606176', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142715', 'lastCheck': '1.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:24,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b5d6c42-1bcd-4664-9ff5-dd4bf00f56be`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606176', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00142715', 'lastCheck': '1.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:24,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b5d6c42-1bcd-4664-9ff5-dd4bf00f56be`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:24,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:24,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:24,538::task::993::Storage.TaskManager.Task::(_decref) Task=`5b5d6c42-1bcd-4664-9ff5-dd4bf00f56be`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:11:24,583::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:11:24,584::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:24,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:24,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329375 s, 31.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:11:26,627::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:11:26,773::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:26,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0687081 s, 14.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:27,278::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:27,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:27,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:27,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:27,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:27,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:11:28,267::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:11:28,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:28,982::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127121 s, 80.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) (540414) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) (540414) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) (540414) Building response >Thread-19::DEBUG::2014-08-11 17:11:30,326::__init__::225::IOProcess::(_processLogs) (540414) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:30,327::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:11:30,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:11:30,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000739135 s, 495 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:30,388::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:30,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:30,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:30,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:30,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:30,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:30,391::__init__::225::IOProcess::(_processLogs) (540415) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:30,391::__init__::225::IOProcess::(_processLogs) (540415) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:30,392::__init__::225::IOProcess::(_processLogs) (540415) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:30,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:30,394::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:11:30,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:31,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0691717 s, 14.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:11:32,200::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:11:32,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`067b8056-cb47-4016-9b09-e3ae2a5f316a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:32,201::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:11:32,214::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:32,215::task::1191::Storage.TaskManager.Task::(prepare) Task=`067b8056-cb47-4016-9b09-e3ae2a5f316a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:32,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`067b8056-cb47-4016-9b09-e3ae2a5f316a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:32,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:32,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:32,217::task::993::Storage.TaskManager.Task::(_decref) Task=`067b8056-cb47-4016-9b09-e3ae2a5f316a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:11:32,224::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:11:32,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`36852f60-3e36-451b-845b-cd413e964286`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:11:32,226::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:11:32,227::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e3c905b8-e63a-4b7c-9e5d-e31c1e592630`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:11:32,227::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:11:32,228::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:11:32,228::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e3c905b8-e63a-4b7c-9e5d-e31c1e592630`::Granted request >Thread-10197::DEBUG::2014-08-11 17:11:32,229::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`36852f60-3e36-451b-845b-cd413e964286`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:11:32,230::task::993::Storage.TaskManager.Task::(_decref) Task=`36852f60-3e36-451b-845b-cd413e964286`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:11:32,273::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:32,275::task::1191::Storage.TaskManager.Task::(prepare) Task=`36852f60-3e36-451b-845b-cd413e964286`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:32,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`36852f60-3e36-451b-845b-cd413e964286`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:11:32,276::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:11:32,277::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:11:32,278::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:11:32,279::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:11:32,279::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:11:32,279::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:11:32,280::task::993::Storage.TaskManager.Task::(_decref) Task=`36852f60-3e36-451b-845b-cd413e964286`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:32,282::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:32,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:32,287::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:32,346::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:32,348::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:32,350::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) (540416) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:33,011::__init__::225::IOProcess::(_processLogs) (540416) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:33,012::__init__::225::IOProcess::(_processLogs) (540416) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:33,012::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:11:33,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:11:33,073::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00148981 s, 332 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) (540417) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) (540417) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:33,074::__init__::225::IOProcess::(_processLogs) (540417) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:33,075::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:11:33,075::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:11:33,075::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:33,075::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:33,075::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) (540418) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) (540418) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) (540418) Building response >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) (540418) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:33,076::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) (540419) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) (540419) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) (540419) Building response >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) (540419) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:33,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) (540420) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) (540420) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:33,078::__init__::225::IOProcess::(_processLogs) (540420) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:33,079::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:11:33,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:33,198::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152764 s, 67.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:11:35,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:35,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0678816 s, 15.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:11:36,077::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:37,293::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:37,294::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:37,294::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:37,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:11:37,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:37,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:37,399::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:37,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0756331 s, 13.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:11:39,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:39,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0400979 s, 25.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:11:39,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`07d68777-9c21-4d7a-aedb-5974d7232841`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:39,770::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:11:39,770::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739135', 'lastCheck': '9.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00148981', 'lastCheck': '6.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:39,770::task::1191::Storage.TaskManager.Task::(prepare) Task=`07d68777-9c21-4d7a-aedb-5974d7232841`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739135', 'lastCheck': '9.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00148981', 'lastCheck': '6.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:39,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`07d68777-9c21-4d7a-aedb-5974d7232841`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:39,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:39,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:39,771::task::993::Storage.TaskManager.Task::(_decref) Task=`07d68777-9c21-4d7a-aedb-5974d7232841`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:11:39,789::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:11:39,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) (540421) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:40,394::__init__::225::IOProcess::(_processLogs) (540421) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:40,409::__init__::225::IOProcess::(_processLogs) (540421) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:40,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:11:40,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:11:40,469::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00079668 s, 459 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:40,470::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:40,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:40,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:40,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:40,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:40,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:40,474::__init__::225::IOProcess::(_processLogs) (540422) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:40,474::__init__::225::IOProcess::(_processLogs) (540422) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:40,474::__init__::225::IOProcess::(_processLogs) (540422) Building response >Thread-19::DEBUG::2014-08-11 17:11:40,475::__init__::225::IOProcess::(_processLogs) (540422) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:40,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:40,476::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:11:41,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:11:41,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`b63df52b-d246-463a-986b-7e5f76c7a015`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:11:41,647::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) (540423) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:11:41,648::__init__::225::IOProcess::(_processLogs) (540423) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:11:41,649::__init__::225::IOProcess::(_processLogs) DEBUG|(540423) Building response >Thread-19::DEBUG::2014-08-11 17:11:41,650::__init__::225::IOProcess::(_processLogs) (540423) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:41,650::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:41,650::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:11:41,650::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:41,651::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:11:41,651::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-10102::INFO::2014-08-11 17:11:41,651::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:11:41,651::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:11:41,652::task::1191::Storage.TaskManager.Task::(prepare) Task=`b63df52b-d246-463a-986b-7e5f76c7a015`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:11:41,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:11:41,652::task::595::Storage.TaskManager.Task::(_updateState) Task=`b63df52b-d246-463a-986b-7e5f76c7a015`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:11:41,653::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:11:41,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:11:41,653::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:11:41,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:11:41,653::task::993::Storage.TaskManager.Task::(_decref) Task=`b63df52b-d246-463a-986b-7e5f76c7a015`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:11:41,654::__init__::225::IOProcess::(_processLogs) (540424) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:11:41,654::__init__::225::IOProcess::(_processLogs) (540424) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:11:41,654::__init__::225::IOProcess::(_processLogs) (540424) Building response >Thread-19::DEBUG::2014-08-11 17:11:41,654::__init__::225::IOProcess::(_processLogs) (540424) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:41,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:41,654::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:11:41,677::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:11:41,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310223 s, 33.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:42,295::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:42,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:42,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:11:42,319::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:11:42,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9ce9734-fd03-4bdb-add9-68baeea0fa53`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:42,319::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:11:42,343::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:42,343::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9ce9734-fd03-4bdb-add9-68baeea0fa53`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:42,344::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9ce9734-fd03-4bdb-add9-68baeea0fa53`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:42,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:42,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:42,344::task::993::Storage.TaskManager.Task::(_decref) Task=`e9ce9734-fd03-4bdb-add9-68baeea0fa53`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:11:42,355::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:11:42,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`d11b6bb4-23cf-4f0d-b6ec-e0ef6694432c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:11:42,356::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:11:42,356::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b4970882-e59b-42b5-95db-78419f221b4e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:11:42,356::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:11:42,356::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:11:42,356::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b4970882-e59b-42b5-95db-78419f221b4e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:11:42,356::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d11b6bb4-23cf-4f0d-b6ec-e0ef6694432c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:11:42,357::task::993::Storage.TaskManager.Task::(_decref) Task=`d11b6bb4-23cf-4f0d-b6ec-e0ef6694432c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:11:42,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:42,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`d11b6bb4-23cf-4f0d-b6ec-e0ef6694432c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:42,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`d11b6bb4-23cf-4f0d-b6ec-e0ef6694432c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:11:42,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:11:42,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:11:42,379::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:11:42,379::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:11:42,379::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:11:42,379::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:11:42,380::task::993::Storage.TaskManager.Task::(_decref) Task=`d11b6bb4-23cf-4f0d-b6ec-e0ef6694432c`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:11:42,404::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:42,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:42,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:11:43,079::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:43,079::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:43,079::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:43,080::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:43,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:43,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:43,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:43,080::__init__::225::IOProcess::(_processLogs) (540425) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:43,080::__init__::225::IOProcess::(_processLogs) (540425) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:43,083::__init__::225::IOProcess::(_processLogs) DEBUG|(540425) Building response >Thread-19::DEBUG::2014-08-11 17:11:43,083::__init__::225::IOProcess::(_processLogs) (540425) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:43,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:43,083::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:11:43,084::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:11:43,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0012471 s, 397 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:43,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:43,147::__init__::225::IOProcess::(_processLogs) (540426) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:43,147::__init__::225::IOProcess::(_processLogs) (540426) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:43,147::__init__::225::IOProcess::(_processLogs) DEBUG|(540426) Building response >Thread-19::DEBUG::2014-08-11 17:11:43,147::__init__::225::IOProcess::(_processLogs) (540426) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:43,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) (540427) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) (540427) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) (540427) Building response >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) (540427) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:43,149::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) (540428) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) (540428) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) (540428) Building response >Thread-19::DEBUG::2014-08-11 17:11:43,150::__init__::225::IOProcess::(_processLogs) (540428) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:43,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) (540429) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) (540429) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) (540429) Building response >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) (540429) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:43,152::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:11:43,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:43,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188459 s, 54.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:11:45,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:45,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545757 s, 18.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:11:46,285::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:47,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:47,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:47,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:47,411::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:47,411::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:47,412::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:47,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:48,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799402 s, 12.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:11:50,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:50,114::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018622 s, 55.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:50,474::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:50,474::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:50,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) (540430) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) (540430) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:50,475::__init__::225::IOProcess::(_processLogs) DEBUG|(540430) Building response >Thread-19::DEBUG::2014-08-11 17:11:50,476::__init__::225::IOProcess::(_processLogs) (540430) Queuing response >Thread-27::DEBUG::2014-08-11 17:11:50,476::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:11:50,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:50,535::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:11:50,545::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00543669 s, 67.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:50,545::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:50,545::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:50,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:50,545::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:50,545::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:50,546::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:50,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:50,546::__init__::225::IOProcess::(_processLogs) (540431) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:50,546::__init__::225::IOProcess::(_processLogs) (540431) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:50,551::__init__::225::IOProcess::(_processLogs) DEBUG|(540431) Building response >Thread-19::DEBUG::2014-08-11 17:11:50,552::__init__::225::IOProcess::(_processLogs) (540431) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:50,552::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:11:50,552::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:11:51,085::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:11:52,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:52,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122817 s, 83.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:52,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:52,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:52,308::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:52,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:52,416::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:52,416::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:11:52,563::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:11:52,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5ec80b3-e906-470a-a1fc-f433e4994a39`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:52,563::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:11:52,585::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:52,585::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5ec80b3-e906-470a-a1fc-f433e4994a39`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:11:52,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5ec80b3-e906-470a-a1fc-f433e4994a39`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:52,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:52,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:52,585::task::993::Storage.TaskManager.Task::(_decref) Task=`b5ec80b3-e906-470a-a1fc-f433e4994a39`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:11:52,595::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:11:52,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`b00efdd6-818f-4ee0-a3a1-176a8251edb5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:11:52,595::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:11:52,596::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bc49941f-e482-4880-add0-7d03256ecf53`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:11:52,596::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:11:52,596::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:11:52,596::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bc49941f-e482-4880-add0-7d03256ecf53`::Granted request >Thread-10197::DEBUG::2014-08-11 17:11:52,597::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b00efdd6-818f-4ee0-a3a1-176a8251edb5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:11:52,597::task::993::Storage.TaskManager.Task::(_decref) Task=`b00efdd6-818f-4ee0-a3a1-176a8251edb5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:11:52,620::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:52,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`b00efdd6-818f-4ee0-a3a1-176a8251edb5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:11:52,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`b00efdd6-818f-4ee0-a3a1-176a8251edb5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:11:52,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:11:52,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:11:52,621::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:11:52,621::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:11:52,621::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:11:52,621::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:11:52,621::task::993::Storage.TaskManager.Task::(_decref) Task=`b00efdd6-818f-4ee0-a3a1-176a8251edb5`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:11:53,152::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:53,152::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:53,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) (540432) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) (540432) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) DEBUG|(540432) Building response >Thread-19::DEBUG::2014-08-11 17:11:53,153::__init__::225::IOProcess::(_processLogs) (540432) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:53,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:53,154::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:11:53,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:11:53,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000766162 s, 646 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:11:53,214::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:53,214::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:11:53,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:53,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:53,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:53,214::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:53,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:53,215::__init__::225::IOProcess::(_processLogs) (540433) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:11:53,215::__init__::225::IOProcess::(_processLogs) (540433) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:11:53,215::__init__::225::IOProcess::(_processLogs) DEBUG|(540433) Building response >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) (540433) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:53,216::__init__::225::IOProcess::(_processLogs) (540434) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:53,217::__init__::225::IOProcess::(_processLogs) (540434) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:53,217::__init__::225::IOProcess::(_processLogs) DEBUG|(540434) Building response >Thread-19::DEBUG::2014-08-11 17:11:53,217::__init__::225::IOProcess::(_processLogs) (540434) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:53,217::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:53,217::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:53,217::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) (540435) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) (540435) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:53,218::__init__::225::IOProcess::(_processLogs) DEBUG|(540435) Building response >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) (540435) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:11:53,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) (540436) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) (540436) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) (540436) Building response >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) (540436) Queuing response >Thread-19::DEBUG::2014-08-11 17:11:53,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:11:53,221::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:11:54,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:54,274::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158311 s, 64.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:11:55,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d0bb828-fbb3-4ce7-857c-1b7a497d7b22`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:11:55,002::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:11:55,002::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00543669', 'lastCheck': '4.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766162', 'lastCheck': '1.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:55,002::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d0bb828-fbb3-4ce7-857c-1b7a497d7b22`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00543669', 'lastCheck': '4.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000766162', 'lastCheck': '1.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:11:55,002::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d0bb828-fbb3-4ce7-857c-1b7a497d7b22`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:11:55,002::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:11:55,002::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:11:55,002::task::993::Storage.TaskManager.Task::(_decref) Task=`8d0bb828-fbb3-4ce7-857c-1b7a497d7b22`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:11:55,017::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:11:55,018::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:11:56,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:56,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134035 s, 76.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:11:56,684::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:57,309::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:57,310::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:11:57,310::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:57,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:57,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:11:57,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:11:58,343::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:11:58,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:11:58,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307755 s, 33.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:12:00,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:00,555::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:00,556::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:00,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:00,558::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:00,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:00,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:00,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:00,561::__init__::225::IOProcess::(_processLogs) (540437) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:00,561::__init__::225::IOProcess::(_processLogs) (540437) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:00,620::__init__::225::IOProcess::(_processLogs) DEBUG|(540437) Building response >Thread-19::DEBUG::2014-08-11 17:12:00,621::__init__::225::IOProcess::(_processLogs) (540437) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:00,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:00,623::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:12:00,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:00,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.164045 s, 6.2 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:12:00,691::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00358812 s, 102 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:00,692::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:00,693::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:00,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:00,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:00,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:00,694::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:00,695::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:00,695::__init__::225::IOProcess::(_processLogs) (540438) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:00,696::__init__::225::IOProcess::(_processLogs) (540438) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:00,696::__init__::225::IOProcess::(_processLogs) DEBUG|(540438) Building response >Thread-19::DEBUG::2014-08-11 17:12:00,697::__init__::225::IOProcess::(_processLogs) (540438) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:00,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:00,698::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:02,313::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:02,315::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:02,317::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:02,428::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:02,432::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:02,435::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:02,647::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:12:02,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8d9828a-8a0f-40ab-ac60-191f8b1afea8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:02,647::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:12:02,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::INFO::2014-08-11 17:12:02,761::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:02,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8d9828a-8a0f-40ab-ac60-191f8b1afea8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:02,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8d9828a-8a0f-40ab-ac60-191f8b1afea8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:02,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:02,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:02,762::task::993::Storage.TaskManager.Task::(_decref) Task=`f8d9828a-8a0f-40ab-ac60-191f8b1afea8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:12:02,773::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:12:02,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`8269f526-9ee8-4d7b-aa58-5ece0013b5a9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:12:02,773::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:12:02,773::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`40e608b5-3a2d-45f5-b6e4-9219406f0c09`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:12:02,774::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:12:02,774::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:12:02,774::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`40e608b5-3a2d-45f5-b6e4-9219406f0c09`::Granted request >Thread-10197::DEBUG::2014-08-11 17:12:02,774::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8269f526-9ee8-4d7b-aa58-5ece0013b5a9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:12:02,774::task::993::Storage.TaskManager.Task::(_decref) Task=`8269f526-9ee8-4d7b-aa58-5ece0013b5a9`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:12:02,820::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385725 s, 26.5 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:12:02,827::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:02,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`8269f526-9ee8-4d7b-aa58-5ece0013b5a9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:02,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`8269f526-9ee8-4d7b-aa58-5ece0013b5a9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:12:02,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:12:02,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:12:02,828::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:12:02,828::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:12:02,828::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:12:02,828::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:12:02,828::task::993::Storage.TaskManager.Task::(_decref) Task=`8269f526-9ee8-4d7b-aa58-5ece0013b5a9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) (540439) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) (540439) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:03,221::__init__::225::IOProcess::(_processLogs) DEBUG|(540439) Building response >Thread-28::DEBUG::2014-08-11 17:12:03,222::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:03,222::__init__::225::IOProcess::(_processLogs) (540439) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:03,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:03,280::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:12:03,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000340093 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:03,281::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) (540440) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) (540440) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:03,282::__init__::225::IOProcess::(_processLogs) DEBUG|(540440) Building response >Thread-19::DEBUG::2014-08-11 17:12:03,283::__init__::225::IOProcess::(_processLogs) (540440) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:03,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:03,283::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:03,283::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) (540441) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) (540441) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:03,284::__init__::225::IOProcess::(_processLogs) (540441) Building response >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) (540441) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:03,285::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) (540442) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) (540442) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) (540442) Building response >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) (540442) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:03,286::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:03,287::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:12:03,287::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:03,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:03,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:03,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:03,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:03,288::__init__::225::IOProcess::(_processLogs) (540443) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:03,288::__init__::225::IOProcess::(_processLogs) (540443) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:03,288::__init__::225::IOProcess::(_processLogs) (540443) Building response >Thread-19::DEBUG::2014-08-11 17:12:03,288::__init__::225::IOProcess::(_processLogs) (540443) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:03,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:03,288::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:12:04,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:04,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127634 s, 80.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:12:06,093::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:12:06,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:07,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519789 s, 19.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:07,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:07,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:07,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:07,442::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:07,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:07,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:09,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:09,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150129 s, 68.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:12:10,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`874e95b3-9cb7-4e83-867f-c6b1815edd10`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:10,212::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:12:10,212::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00358812', 'lastCheck': '9.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340093', 'lastCheck': '6.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:10,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`874e95b3-9cb7-4e83-867f-c6b1815edd10`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00358812', 'lastCheck': '9.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340093', 'lastCheck': '6.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:10,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`874e95b3-9cb7-4e83-867f-c6b1815edd10`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:10,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:10,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:10,212::task::993::Storage.TaskManager.Task::(_decref) Task=`874e95b3-9cb7-4e83-867f-c6b1815edd10`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:12:10,432::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:10,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:12:10,698::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:10,698::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:10,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:10,698::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:10,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) (540444) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) (540444) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) DEBUG|(540444) Building response >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) (540444) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:10,699::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:12:10,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:12:10,760::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000905056 s, 404 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:10,760::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:10,760::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) (540445) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) (540445) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:10,761::__init__::225::IOProcess::(_processLogs) DEBUG|(540445) Building response >Thread-19::DEBUG::2014-08-11 17:12:10,762::__init__::225::IOProcess::(_processLogs) (540445) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:10,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:10,762::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:12:11,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:11,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558437 s, 18.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:12:11,692::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:12,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:12,331::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:12,331::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:12,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:12,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:12,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:12,921::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:12:12,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`86bc8932-81e7-4f20-bbdd-7cc2014b70d0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:12,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:12:12,935::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:12,935::task::1191::Storage.TaskManager.Task::(prepare) Task=`86bc8932-81e7-4f20-bbdd-7cc2014b70d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:12,935::task::595::Storage.TaskManager.Task::(_updateState) Task=`86bc8932-81e7-4f20-bbdd-7cc2014b70d0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:12,936::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:12,936::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:12,936::task::993::Storage.TaskManager.Task::(_decref) Task=`86bc8932-81e7-4f20-bbdd-7cc2014b70d0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:12:12,942::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:12:12,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9167580-a2d2-4b39-a937-eb845b0f6cc9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:12:12,943::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:12:12,943::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c00293d4-f2ac-4459-90a7-1b3a7ce606a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:12:12,943::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:12:12,943::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:12:12,943::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c00293d4-f2ac-4459-90a7-1b3a7ce606a5`::Granted request >Thread-10197::DEBUG::2014-08-11 17:12:12,943::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e9167580-a2d2-4b39-a937-eb845b0f6cc9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:12:12,943::task::993::Storage.TaskManager.Task::(_decref) Task=`e9167580-a2d2-4b39-a937-eb845b0f6cc9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:12:12,960::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:12,960::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9167580-a2d2-4b39-a937-eb845b0f6cc9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:12,960::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9167580-a2d2-4b39-a937-eb845b0f6cc9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:12:12,960::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:12:12,960::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:12:12,960::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:12:12,960::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:12:12,960::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:12:12,960::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:12:12,961::task::993::Storage.TaskManager.Task::(_decref) Task=`e9167580-a2d2-4b39-a937-eb845b0f6cc9`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:12:13,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:13,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:13,292::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:13,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:13,292::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:13,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:13,293::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:13,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:13,293::__init__::225::IOProcess::(_processLogs) (540446) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:13,293::__init__::225::IOProcess::(_processLogs) (540446) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:13,302::__init__::225::IOProcess::(_processLogs) DEBUG|(540446) Building response >Thread-19::DEBUG::2014-08-11 17:12:13,302::__init__::225::IOProcess::(_processLogs) (540446) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:13,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:13,303::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:12:13,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:12:13,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00103006 s, 481 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:13,367::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Dummy-51::DEBUG::2014-08-11 17:12:13,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0644447 s, 15.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:13,368::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:13,369::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:13,369::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:13,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:13,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:13,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:13,372::__init__::225::IOProcess::(_processLogs) (540447) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:13,373::__init__::225::IOProcess::(_processLogs) (540447) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:13,373::__init__::225::IOProcess::(_processLogs) (540447) Building response >Thread-19::DEBUG::2014-08-11 17:12:13,374::__init__::225::IOProcess::(_processLogs) (540447) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:13,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:13,375::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:13,375::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:12:13,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:13,377::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:13,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:13,378::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:13,379::__init__::225::IOProcess::(_processLogs) (540448) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:13,379::__init__::225::IOProcess::(_processLogs) (540448) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:13,380::__init__::225::IOProcess::(_processLogs) (540448) Building response >Thread-19::DEBUG::2014-08-11 17:12:13,380::__init__::225::IOProcess::(_processLogs) (540448) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:13,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:13,381::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:13,382::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:12:13,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:13,383::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:13,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:13,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:13,385::__init__::225::IOProcess::(_processLogs) (540449) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:13,385::__init__::225::IOProcess::(_processLogs) (540449) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:13,386::__init__::225::IOProcess::(_processLogs) (540449) Building response >Thread-19::DEBUG::2014-08-11 17:12:13,386::__init__::225::IOProcess::(_processLogs) (540449) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:13,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:13,387::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:13,388::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:12:13,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:13,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:13,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:13,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:13,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:13,391::__init__::225::IOProcess::(_processLogs) (540450) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:13,391::__init__::225::IOProcess::(_processLogs) (540450) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:13,392::__init__::225::IOProcess::(_processLogs) (540450) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:13,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:13,393::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:12:15,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:15,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0696646 s, 14.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:12:16,367::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:17,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:17,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:17,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:17,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:17,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:17,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:17,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:17,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0542595 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:12:19,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:19,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300333 s, 34.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) (540451) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:20,763::__init__::225::IOProcess::(_processLogs) (540451) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:20,764::__init__::225::IOProcess::(_processLogs) (540451) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:20,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:12:20,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:12:20,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000709869 s, 516 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:20,824::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:20,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:20,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:20,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:20,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:20,825::__init__::225::IOProcess::(_processLogs) (540452) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:20,825::__init__::225::IOProcess::(_processLogs) (540452) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:20,825::__init__::225::IOProcess::(_processLogs) (540452) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:20,825::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:12:21,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`47816984-a6d3-4f49-9aa5-a4bfca6e0016`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:12:21,114::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) (540453) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:12:21,116::__init__::225::IOProcess::(_processLogs) (540453) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:12:21,141::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540453) Building response >Thread-19::DEBUG::2014-08-11 17:12:21,141::__init__::225::IOProcess::(_processLogs) (540453) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:21,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:21,142::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:12:21,142::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:21,142::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:12:21,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:21,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10017::INFO::2014-08-11 17:12:21,143::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:12:21,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:12:21,144::task::1191::Storage.TaskManager.Task::(prepare) Task=`47816984-a6d3-4f49-9aa5-a4bfca6e0016`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:12:21,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:12:21,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`47816984-a6d3-4f49-9aa5-a4bfca6e0016`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:12:21,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:12:21,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:12:21,145::__init__::225::IOProcess::(_processLogs) (540454) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:12:21,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:12:21,146::__init__::225::IOProcess::(_processLogs) (540454) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:12:21,146::task::993::Storage.TaskManager.Task::(_decref) Task=`47816984-a6d3-4f49-9aa5-a4bfca6e0016`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:12:21,146::__init__::225::IOProcess::(_processLogs) (540454) Building response >Thread-19::DEBUG::2014-08-11 17:12:21,147::__init__::225::IOProcess::(_processLogs) (540454) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:21,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:21,147::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:12:21,196::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:12:21,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:21,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0555942 s, 18.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:22,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:22,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:22,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:22,458::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:22,458::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:22,458::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:23,009::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:12:23,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`47b13c77-5b14-4a89-b973-9d09ae3ab860`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:23,009::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:12:23,047::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:23,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`47b13c77-5b14-4a89-b973-9d09ae3ab860`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:23,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`47b13c77-5b14-4a89-b973-9d09ae3ab860`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:23,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:23,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:23,048::task::993::Storage.TaskManager.Task::(_decref) Task=`47b13c77-5b14-4a89-b973-9d09ae3ab860`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:12:23,060::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:12:23,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d53576e-c303-4976-8623-0b064b6fc8e1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:12:23,060::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:12:23,060::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7f6b4a7a-d879-42cb-9e20-2a3a16693835`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:12:23,061::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:12:23,061::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:12:23,061::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7f6b4a7a-d879-42cb-9e20-2a3a16693835`::Granted request >Thread-10197::DEBUG::2014-08-11 17:12:23,061::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0d53576e-c303-4976-8623-0b064b6fc8e1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:12:23,061::task::993::Storage.TaskManager.Task::(_decref) Task=`0d53576e-c303-4976-8623-0b064b6fc8e1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:12:23,077::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:23,077::task::1191::Storage.TaskManager.Task::(prepare) Task=`0d53576e-c303-4976-8623-0b064b6fc8e1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:23,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`0d53576e-c303-4976-8623-0b064b6fc8e1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:12:23,077::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:12:23,077::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:12:23,078::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:12:23,078::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:12:23,078::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:12:23,078::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:12:23,078::task::993::Storage.TaskManager.Task::(_decref) Task=`0d53576e-c303-4976-8623-0b064b6fc8e1`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:12:23,393::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:23,393::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:23,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:23,393::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:23,393::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) (540455) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) (540455) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) DEBUG|(540455) Building response >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) (540455) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:23,394::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:12:23,395::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:12:23,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:12:23,455::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00125408 s, 395 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) (540456) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) (540456) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:23,456::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540456) Building response >Thread-19::DEBUG::2014-08-11 17:12:23,457::__init__::225::IOProcess::(_processLogs) (540456) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:23,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:23,457::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:23,457::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) (540457) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:23,458::__init__::225::IOProcess::(_processLogs) (540457) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) (540457) Building response >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) (540457) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:23,459::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) (540458) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) (540458) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) (540458) Building response >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) (540458) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:23,460::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:23,461::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:12:23,461::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:23,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:23,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:23,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:23,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:23,462::__init__::225::IOProcess::(_processLogs) (540459) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:23,462::__init__::225::IOProcess::(_processLogs) (540459) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:23,462::__init__::225::IOProcess::(_processLogs) (540459) Building response >Thread-19::DEBUG::2014-08-11 17:12:23,462::__init__::225::IOProcess::(_processLogs) (540459) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:23,462::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:23,462::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:12:23,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:23,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0352429 s, 29.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:12:25,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd90252c-55cb-4c80-893d-2621d6db3ae7`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:25,658::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:12:25,659::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709869', 'lastCheck': '4.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125408', 'lastCheck': '2.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:25,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd90252c-55cb-4c80-893d-2621d6db3ae7`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000709869', 'lastCheck': '4.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00125408', 'lastCheck': '2.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:25,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd90252c-55cb-4c80-893d-2621d6db3ae7`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:25,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:25,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:25,659::task::993::Storage.TaskManager.Task::(_decref) Task=`dd90252c-55cb-4c80-893d-2621d6db3ae7`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:12:25,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:25,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:25,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:26,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456282 s, 22.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:12:26,722::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:27,348::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:27,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:27,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:27,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:27,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:27,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:28,106::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:28,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0568398 s, 18.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:12:28,380::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:12:30,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:30,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245662 s, 41.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:30,826::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:30,826::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:30,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) (540460) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) (540460) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540460) Building response >Thread-19::DEBUG::2014-08-11 17:12:30,827::__init__::225::IOProcess::(_processLogs) (540460) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:30,828::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:12:30,828::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:30,828::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:12:30,888::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000823447 s, 444 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) (540461) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:30,889::__init__::225::IOProcess::(_processLogs) (540461) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:30,890::__init__::225::IOProcess::(_processLogs) DEBUG|(540461) Building response >Thread-19::DEBUG::2014-08-11 17:12:30,891::__init__::225::IOProcess::(_processLogs) (540461) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:30,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:30,891::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:12:32,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:32,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:32,385::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:32,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:32,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0578658 s, 17.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:12:32,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:32,471::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:32,474::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:33,147::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:12:33,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`f27ebfc0-81fc-4d30-bafe-d2511de05035`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:33,147::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:12:33,163::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:33,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`f27ebfc0-81fc-4d30-bafe-d2511de05035`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:33,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`f27ebfc0-81fc-4d30-bafe-d2511de05035`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:33,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:33,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:33,164::task::993::Storage.TaskManager.Task::(_decref) Task=`f27ebfc0-81fc-4d30-bafe-d2511de05035`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:12:33,175::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:12:33,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`849d059c-899d-47ed-bdfe-9830e86670d2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:12:33,175::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:12:33,176::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4e9d5058-24cb-43e2-9a33-cbdada08cefd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:12:33,176::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:12:33,176::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:12:33,176::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4e9d5058-24cb-43e2-9a33-cbdada08cefd`::Granted request >Thread-10197::DEBUG::2014-08-11 17:12:33,176::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`849d059c-899d-47ed-bdfe-9830e86670d2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:12:33,176::task::993::Storage.TaskManager.Task::(_decref) Task=`849d059c-899d-47ed-bdfe-9830e86670d2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:12:33,192::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:33,192::task::1191::Storage.TaskManager.Task::(prepare) Task=`849d059c-899d-47ed-bdfe-9830e86670d2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:33,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`849d059c-899d-47ed-bdfe-9830e86670d2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:12:33,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:12:33,193::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:12:33,193::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:12:33,193::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:12:33,193::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:12:33,193::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:12:33,193::task::993::Storage.TaskManager.Task::(_decref) Task=`849d059c-899d-47ed-bdfe-9830e86670d2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) (540462) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:33,462::__init__::225::IOProcess::(_processLogs) (540462) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:33,463::__init__::225::IOProcess::(_processLogs) DEBUG|(540462) Building response >Thread-19::DEBUG::2014-08-11 17:12:33,463::__init__::225::IOProcess::(_processLogs) (540462) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:33,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:33,463::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:12:33,464::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:12:33,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00211108 s, 234 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:33,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:33,527::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) (540463) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) (540463) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:33,528::__init__::225::IOProcess::(_processLogs) DEBUG|(540463) Building response >Thread-19::DEBUG::2014-08-11 17:12:33,529::__init__::225::IOProcess::(_processLogs) (540463) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:33,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:33,529::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:33,529::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:33,529::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) (540464) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) (540464) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) (540464) Building response >Thread-19::DEBUG::2014-08-11 17:12:33,530::__init__::225::IOProcess::(_processLogs) (540464) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:33,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) (540465) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) (540465) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) (540465) Building response >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) (540465) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:12:33,532::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) (540466) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) (540466) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) DEBUG|(540466) Building response >Thread-19::DEBUG::2014-08-11 17:12:33,533::__init__::225::IOProcess::(_processLogs) (540466) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:33,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:33,534::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:12:34,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:34,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145313 s, 70.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:12:36,204::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:12:36,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:36,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439696 s, 23.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:37,397::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:37,397::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:37,397::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:37,480::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:37,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:37,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:38,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:38,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485399 s, 21.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:12:40,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`163ebbb7-a85e-4306-8e49-64a251d0e64c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:40,832::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:12:40,832::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823447', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00211108', 'lastCheck': '7.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:40,832::task::1191::Storage.TaskManager.Task::(prepare) Task=`163ebbb7-a85e-4306-8e49-64a251d0e64c`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000823447', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00211108', 'lastCheck': '7.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:40,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`163ebbb7-a85e-4306-8e49-64a251d0e64c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:40,832::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:40,832::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:40,832::task::993::Storage.TaskManager.Task::(_decref) Task=`163ebbb7-a85e-4306-8e49-64a251d0e64c`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:12:40,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:40,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:40,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:40,932::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:40,932::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:40,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:40,933::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:40,933::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:40,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:12:40,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:40,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:40,997::__init__::225::IOProcess::(_processLogs) (540467) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:40,998::__init__::225::IOProcess::(_processLogs) (540467) Got request for method 'statvfs' >Thread-27::DEBUG::2014-08-11 17:12:40,999::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000866798 s, 422 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:40,999::__init__::225::IOProcess::(_processLogs) (540467) Building response >Thread-19::DEBUG::2014-08-11 17:12:41,000::__init__::225::IOProcess::(_processLogs) (540467) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:41,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:41,001::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:41,002::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:12:41,003::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:41,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:41,004::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:41,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:41,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:41,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:41,006::__init__::225::IOProcess::(_processLogs) (540468) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:41,007::__init__::225::IOProcess::(_processLogs) (540468) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:12:41,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739362 s, 13.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:41,008::__init__::225::IOProcess::(_processLogs) (540468) Building response >Thread-19::DEBUG::2014-08-11 17:12:41,009::__init__::225::IOProcess::(_processLogs) (540468) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:41,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:41,010::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:12:41,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`98f59350-98f4-4f00-95f4-91d8ee93c563`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:12:41,742::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:12:41,743::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:12:41,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:41,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:41,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:41,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:41,744::__init__::225::IOProcess::(_processLogs) (540469) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:12:41,744::__init__::225::IOProcess::(_processLogs) (540469) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:12:41,744::__init__::225::IOProcess::(_processLogs) (540469) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:41,745::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:41,745::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:12:41,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:41,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:41,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:12:41,746::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:12:41,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:12:41,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`98f59350-98f4-4f00-95f4-91d8ee93c563`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:12:41,747::__init__::225::IOProcess::(_processLogs) (540470) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:12:41,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`98f59350-98f4-4f00-95f4-91d8ee93c563`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:12:41,748::__init__::225::IOProcess::(_processLogs) (540470) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:12:41,748::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:12:41,748::__init__::225::IOProcess::(_processLogs) (540470) Building response >Thread-10102::DEBUG::2014-08-11 17:12:41,749::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:12:41,749::__init__::225::IOProcess::(_processLogs) (540470) Queuing response >Thread-10102::DEBUG::2014-08-11 17:12:41,749::task::993::Storage.TaskManager.Task::(_decref) Task=`98f59350-98f4-4f00-95f4-91d8ee93c563`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:12:41,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:41,750::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:12:41,773::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:42,400::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:42,401::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:42,401::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:42,484::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:42,485::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:42,485::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:43,017::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:43,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498123 s, 20.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:12:43,252::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:12:43,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea56eedb-a10e-4511-869c-0946a4834dc0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:43,252::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:12:43,284::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:43,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea56eedb-a10e-4511-869c-0946a4834dc0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:43,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea56eedb-a10e-4511-869c-0946a4834dc0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:43,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:43,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:43,285::task::993::Storage.TaskManager.Task::(_decref) Task=`ea56eedb-a10e-4511-869c-0946a4834dc0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:12:43,297::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:12:43,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`afcf85f4-8e85-424b-a3a1-921e1a75977c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:12:43,297::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:12:43,297::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e4743531-6dfa-40c3-a5cc-764d1b6955a4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:12:43,297::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:12:43,297::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:12:43,298::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e4743531-6dfa-40c3-a5cc-764d1b6955a4`::Granted request >Thread-10197::DEBUG::2014-08-11 17:12:43,298::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`afcf85f4-8e85-424b-a3a1-921e1a75977c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:12:43,298::task::993::Storage.TaskManager.Task::(_decref) Task=`afcf85f4-8e85-424b-a3a1-921e1a75977c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:12:43,314::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:43,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`afcf85f4-8e85-424b-a3a1-921e1a75977c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:43,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`afcf85f4-8e85-424b-a3a1-921e1a75977c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:12:43,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:12:43,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:12:43,315::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:12:43,315::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:12:43,315::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:12:43,315::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:12:43,315::task::993::Storage.TaskManager.Task::(_decref) Task=`afcf85f4-8e85-424b-a3a1-921e1a75977c`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:12:43,534::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:43,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:43,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:43,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:43,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:43,535::__init__::225::IOProcess::(_processLogs) (540471) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:43,535::__init__::225::IOProcess::(_processLogs) (540471) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:43,537::__init__::225::IOProcess::(_processLogs) (540471) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:43,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:12:43,538::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:12:43,599::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00132093 s, 375 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) (540472) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) (540472) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:43,600::__init__::225::IOProcess::(_processLogs) (540472) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:43,601::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) (540473) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) (540473) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) (540473) Building response >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) (540473) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:43,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) (540474) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) (540474) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) (540474) Building response >Thread-19::DEBUG::2014-08-11 17:12:43,603::__init__::225::IOProcess::(_processLogs) (540474) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) (540475) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:43,604::__init__::225::IOProcess::(_processLogs) (540475) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:43,605::__init__::225::IOProcess::(_processLogs) (540475) Building response >Thread-19::DEBUG::2014-08-11 17:12:43,605::__init__::225::IOProcess::(_processLogs) (540475) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:43,605::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:12:45,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:45,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598624 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:12:46,399::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:12:47,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:47,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526363 s, 19.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:47,407::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:47,407::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:47,408::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:47,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:47,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:47,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:49,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:49,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323098 s, 31.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:51,008::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:51,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:51,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:51,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:51,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:51,009::__init__::225::IOProcess::(_processLogs) (540476) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:51,009::__init__::225::IOProcess::(_processLogs) (540476) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:51,010::__init__::225::IOProcess::(_processLogs) (540476) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:51,010::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:12:51,010::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:12:51,070::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000910182 s, 402 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) (540477) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) (540477) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:51,071::__init__::225::IOProcess::(_processLogs) (540477) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:51,072::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:12:51,211::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:12:51,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:51,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444928 s, 23.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:52,413::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:52,414::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:52,414::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:52,494::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:52,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:52,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:53,371::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:12:53,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a410f71-47c2-4ac7-8063-2b12c196c44d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:53,371::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:12:53,424::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:53,424::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a410f71-47c2-4ac7-8063-2b12c196c44d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:12:53,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a410f71-47c2-4ac7-8063-2b12c196c44d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:53,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:53,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:53,425::task::993::Storage.TaskManager.Task::(_decref) Task=`0a410f71-47c2-4ac7-8063-2b12c196c44d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:12:53,431::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:12:53,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7293805-70db-4141-9e26-d7c5c2c7523b`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:12:53,432::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:12:53,432::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9c8c0d40-f1c0-40b1-b06f-81e799c51124`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:12:53,432::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:12:53,432::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:12:53,432::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9c8c0d40-f1c0-40b1-b06f-81e799c51124`::Granted request >Thread-10197::DEBUG::2014-08-11 17:12:53,433::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7293805-70db-4141-9e26-d7c5c2c7523b`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:12:53,433::task::993::Storage.TaskManager.Task::(_decref) Task=`d7293805-70db-4141-9e26-d7c5c2c7523b`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:12:53,449::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:53,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7293805-70db-4141-9e26-d7c5c2c7523b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:12:53,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7293805-70db-4141-9e26-d7c5c2c7523b`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:12:53,449::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:12:53,450::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:12:53,450::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:12:53,450::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:12:53,450::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:12:53,450::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:12:53,450::task::993::Storage.TaskManager.Task::(_decref) Task=`d7293805-70db-4141-9e26-d7c5c2c7523b`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:12:53,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:12:53,651::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:12:53,652::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) (540478) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) (540478) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,654::__init__::225::IOProcess::(_processLogs) (540479) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:12:53,654::__init__::225::IOProcess::(_processLogs) (540479) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:12:53,654::__init__::225::IOProcess::(_processLogs) (540478) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,654::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:12:53,655::__init__::225::IOProcess::(_processLogs) (540479) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,656::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,657::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:12:53,660::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:12:53,660::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:12:53,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,661::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,661::__init__::225::IOProcess::(_processLogs) (540480) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:12:53,661::__init__::225::IOProcess::(_processLogs) (540480) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:12:53,683::__init__::225::IOProcess::(_processLogs) (540480) Queuing response >Thread-28::DEBUG::2014-08-11 17:12:53,684::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:12:53,684::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:53,686::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:12:53,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,690::__init__::225::IOProcess::(_processLogs) (540481) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:12:53,691::__init__::225::IOProcess::(_processLogs) (540481) Got request for method 'readfile' >Thread-28::DEBUG::2014-08-11 17:12:53,692::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:12:53,692::__init__::225::IOProcess::(_processLogs) (540481) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,695::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:12:53,696::__init__::225::IOProcess::(_processLogs) Message size is 208 >Dummy-51::DEBUG::2014-08-11 17:12:53,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0441681 s, 23.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:53,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,699::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,701::__init__::225::IOProcess::(_processLogs) (540482) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:53,702::__init__::225::IOProcess::(_processLogs) (540482) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:53,702::__init__::225::IOProcess::(_processLogs) (540482) Building response >Thread-19::DEBUG::2014-08-11 17:12:53,703::__init__::225::IOProcess::(_processLogs) (540482) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,704::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:53,705::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:12:53,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,708::__init__::225::IOProcess::(_processLogs) (540483) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:12:53,709::__init__::225::IOProcess::(_processLogs) (540483) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:12:53,710::__init__::225::IOProcess::(_processLogs) (540483) Queuing response >Thread-28::DEBUG::2014-08-11 17:12:53,710::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:12:53,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::INFO::2014-08-11 17:12:53,711::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:12:53,711::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-28::INFO::2014-08-11 17:12:53,711::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:12:53,713::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:53,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,715::__init__::225::IOProcess::(_processLogs) (540484) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:53,716::__init__::225::IOProcess::(_processLogs) (540484) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:53,716::__init__::225::IOProcess::(_processLogs) (540484) Queuing response >Thread-28::DEBUG::2014-08-11 17:12:53,717::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:12:53,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,776::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:12:53,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00450664 s, 110 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:12:53,783::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:12:53,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,785::__init__::225::IOProcess::(_processLogs) (540485) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:12:53,785::__init__::225::IOProcess::(_processLogs) (540485) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:12:53,786::__init__::225::IOProcess::(_processLogs) (540485) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,787::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:12:53,788::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:12:53,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,790::__init__::225::IOProcess::(_processLogs) (540486) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:53,791::__init__::225::IOProcess::(_processLogs) (540486) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:53,791::__init__::225::IOProcess::(_processLogs) (540486) Building response >Thread-19::DEBUG::2014-08-11 17:12:53,792::__init__::225::IOProcess::(_processLogs) (540486) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) (540487) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:53,793::__init__::225::IOProcess::(_processLogs) (540487) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:53,794::__init__::225::IOProcess::(_processLogs) (540487) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,794::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:12:53,794::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:12:53,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:12:53,794::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:12:53,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:12:53,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:12:53,795::__init__::225::IOProcess::(_processLogs) (540488) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:12:53,795::__init__::225::IOProcess::(_processLogs) (540488) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:12:53,795::__init__::225::IOProcess::(_processLogs) (540488) Building response >Thread-19::DEBUG::2014-08-11 17:12:53,795::__init__::225::IOProcess::(_processLogs) (540488) Queuing response >Thread-19::DEBUG::2014-08-11 17:12:53,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:12:53,796::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:12:55,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:55,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488739 s, 21.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:12:56,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`c284ea37-e258-472c-9332-cfa17add0045`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:12:56,267::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:12:56,267::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910182', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00450664', 'lastCheck': '2.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:56,267::task::1191::Storage.TaskManager.Task::(prepare) Task=`c284ea37-e258-472c-9332-cfa17add0045`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000910182', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00450664', 'lastCheck': '2.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:12:56,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`c284ea37-e258-472c-9332-cfa17add0045`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:12:56,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:12:56,268::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:12:56,268::task::993::Storage.TaskManager.Task::(_decref) Task=`c284ea37-e258-472c-9332-cfa17add0045`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:12:56,289::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:12:56,289::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10102::DEBUG::2014-08-11 17:12:56,783::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:57,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:57,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:12:57,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:57,499::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:57,500::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:12:57,500::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:12:57,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:12:58,003::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.034043 s, 30.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:12:58,449::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:13:00,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:00,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013391 s, 76.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) (540489) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:01,073::__init__::225::IOProcess::(_processLogs) (540489) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:01,074::__init__::225::IOProcess::(_processLogs) (540489) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:01,074::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:13:01,075::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:13:01,134::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000327077 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) (540490) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:01,135::__init__::225::IOProcess::(_processLogs) (540490) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:01,136::__init__::225::IOProcess::(_processLogs) (540490) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:01,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:01,137::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:13:02,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:02,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0172935 s, 59.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:02,429::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:02,434::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:02,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:02,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:02,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:02,510::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:03,482::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:13:03,482::task::595::Storage.TaskManager.Task::(_updateState) Task=`5542921b-8afc-4f36-8d6b-a39ecec29208`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:03,483::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:13:03,516::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:03,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`5542921b-8afc-4f36-8d6b-a39ecec29208`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:03,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`5542921b-8afc-4f36-8d6b-a39ecec29208`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:03,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:03,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:03,516::task::993::Storage.TaskManager.Task::(_decref) Task=`5542921b-8afc-4f36-8d6b-a39ecec29208`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:13:03,527::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:13:03,527::task::595::Storage.TaskManager.Task::(_updateState) Task=`73badc26-763f-4126-9f7e-e91ebc97322c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:13:03,527::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:13:03,527::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a5636cda-6786-47b5-b9cf-7dec6b4d4266`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:13:03,527::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:13:03,528::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:13:03,528::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a5636cda-6786-47b5-b9cf-7dec6b4d4266`::Granted request >Thread-10197::DEBUG::2014-08-11 17:13:03,529::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`73badc26-763f-4126-9f7e-e91ebc97322c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:13:03,529::task::993::Storage.TaskManager.Task::(_decref) Task=`73badc26-763f-4126-9f7e-e91ebc97322c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:13:03,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:03,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`73badc26-763f-4126-9f7e-e91ebc97322c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:03,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`73badc26-763f-4126-9f7e-e91ebc97322c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:13:03,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:13:03,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:13:03,546::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:13:03,546::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:13:03,546::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:13:03,546::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:13:03,546::task::993::Storage.TaskManager.Task::(_decref) Task=`73badc26-763f-4126-9f7e-e91ebc97322c`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) (540491) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:03,796::__init__::225::IOProcess::(_processLogs) (540491) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:03,797::__init__::225::IOProcess::(_processLogs) (540491) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:03,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:13:03,797::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:13:03,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000990941 s, 500 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) (540492) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) (540492) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:03,858::__init__::225::IOProcess::(_processLogs) (540492) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:03,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:03,859::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:13:03,859::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:13:03,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:03,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) (540493) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) (540493) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) (540493) Building response >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) (540493) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:03,860::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) (540494) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) (540494) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:03,861::__init__::225::IOProcess::(_processLogs) (540494) Building response >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) (540494) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:03,862::__init__::225::IOProcess::(_processLogs) (540495) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:03,863::__init__::225::IOProcess::(_processLogs) (540495) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:03,863::__init__::225::IOProcess::(_processLogs) (540495) Building response >Thread-19::DEBUG::2014-08-11 17:13:03,863::__init__::225::IOProcess::(_processLogs) (540495) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:03,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:03,863::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:13:04,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:04,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038822 s, 26.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:13:06,223::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:13:06,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:06,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559907 s, 18.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:07,444::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:07,445::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:07,445::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:07,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:07,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:07,518::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:08,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:08,561::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.036125 s, 28.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:13:10,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:10,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125985 s, 81.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:11,137::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:11,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:11,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:11,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:11,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:11,138::__init__::225::IOProcess::(_processLogs) (540496) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:11,138::__init__::225::IOProcess::(_processLogs) (540496) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:11,138::__init__::225::IOProcess::(_processLogs) (540496) Queuing response >Thread-27::DEBUG::2014-08-11 17:13:11,139::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:13:11,139::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:11,198::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:13:11,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000369811 s, 990 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) (540497) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:11,199::__init__::225::IOProcess::(_processLogs) (540497) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:11,200::__init__::225::IOProcess::(_processLogs) DEBUG|(540497) Building response >Thread-19::DEBUG::2014-08-11 17:13:11,200::__init__::225::IOProcess::(_processLogs) (540497) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:11,201::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:11,201::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:13:11,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`83a250a5-72c4-457b-83e5-64e3ed5280a5`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:11,618::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:13:11,618::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369811', 'lastCheck': '0.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990941', 'lastCheck': '7.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:11,618::task::1191::Storage.TaskManager.Task::(prepare) Task=`83a250a5-72c4-457b-83e5-64e3ed5280a5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369811', 'lastCheck': '0.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000990941', 'lastCheck': '7.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:11,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`83a250a5-72c4-457b-83e5-64e3ed5280a5`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:11,619::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:11,619::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:11,619::task::993::Storage.TaskManager.Task::(_decref) Task=`83a250a5-72c4-457b-83e5-64e3ed5280a5`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:13:11,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:11,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10102::DEBUG::2014-08-11 17:13:11,791::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:12,451::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:12,451::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:12,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:12,523::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:12,524::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:12,524::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:12,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:12,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500032 s, 20.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:13:13,813::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:13:13,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`658f1065-0cc1-415d-8dda-0d2ac7ff64df`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:13,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:13:13,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:13,835::task::1191::Storage.TaskManager.Task::(prepare) Task=`658f1065-0cc1-415d-8dda-0d2ac7ff64df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:13,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`658f1065-0cc1-415d-8dda-0d2ac7ff64df`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:13,835::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:13,835::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:13,835::task::993::Storage.TaskManager.Task::(_decref) Task=`658f1065-0cc1-415d-8dda-0d2ac7ff64df`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:13:13,850::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:13:13,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`38503895-a9ec-4ce2-9331-c9493a358a11`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:13:13,850::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:13:13,851::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0f758d34-04a5-4024-8696-706f398b21c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:13:13,851::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:13:13,851::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:13:13,851::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0f758d34-04a5-4024-8696-706f398b21c9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:13:13,851::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`38503895-a9ec-4ce2-9331-c9493a358a11`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:13:13,851::task::993::Storage.TaskManager.Task::(_decref) Task=`38503895-a9ec-4ce2-9331-c9493a358a11`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:13:13,863::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:13,863::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:13,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:13,863::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:13,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:13,864::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:13,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:13,864::__init__::225::IOProcess::(_processLogs) (540498) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:13,864::__init__::225::IOProcess::(_processLogs) (540498) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:13,869::__init__::225::IOProcess::(_processLogs) DEBUG|(540498) Building response >Thread-19::DEBUG::2014-08-11 17:13:13,869::__init__::225::IOProcess::(_processLogs) (540498) Queuing response >Thread-10197::INFO::2014-08-11 17:13:13,870::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-19::DEBUG::2014-08-11 17:13:13,871::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:13:13,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`38503895-a9ec-4ce2-9331-c9493a358a11`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-28::DEBUG::2014-08-11 17:13:13,871::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:13:13,872::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10197::DEBUG::2014-08-11 17:13:13,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`38503895-a9ec-4ce2-9331-c9493a358a11`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:13:13,931::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:13:13,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:13:13,931::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:13:13,931::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:13:13,931::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:13:13,931::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:13:13,932::task::993::Storage.TaskManager.Task::(_decref) Task=`38503895-a9ec-4ce2-9331-c9493a358a11`::ref 0 aborting False >Thread-28::DEBUG::2014-08-11 17:13:13,933::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00101428 s, 488 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:13,933::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) (540499) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) (540499) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) DEBUG|(540499) Building response >Thread-19::DEBUG::2014-08-11 17:13:13,934::__init__::225::IOProcess::(_processLogs) (540499) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:13,935::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:13:13,935::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:13:13,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) (540500) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:13,936::__init__::225::IOProcess::(_processLogs) (540500) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) (540500) Building response >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) (540500) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:13,937::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) (540501) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) (540501) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) (540501) Building response >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) (540501) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:13,938::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:13:13,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:13,939::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:13,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:13,939::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:13,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:13,939::__init__::225::IOProcess::(_processLogs) (540502) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:13,940::__init__::225::IOProcess::(_processLogs) (540502) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:13,940::__init__::225::IOProcess::(_processLogs) (540502) Building response >Thread-19::DEBUG::2014-08-11 17:13:13,940::__init__::225::IOProcess::(_processLogs) (540502) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:13,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:13,940::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:13:14,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:14,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337126 s, 30.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:13:16,466::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:13:16,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:17,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0668836 s, 15.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:17,457::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:17,458::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:17,458::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:17,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:17,526::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:17,526::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:19,058::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:19,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0544832 s, 18.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:13:21,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:13:21,238::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10017::DEBUG::2014-08-11 17:13:21,238::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f19342e-ea99-4e46-b530-82809c5dba28`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:13:21,239::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-10017::INFO::2014-08-11 17:13:21,239::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:13:21,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:21,240::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:21,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:21,240::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:21,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:21,240::__init__::225::IOProcess::(_processLogs) (540503) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:21,240::__init__::225::IOProcess::(_processLogs) (540503) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) (540504) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:13:21,241::__init__::225::IOProcess::(_processLogs) (540504) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:13:21,242::__init__::225::IOProcess::(_processLogs) DEBUG|(540503) Building response >Thread-19::DEBUG::2014-08-11 17:13:21,242::__init__::225::IOProcess::(_processLogs) (540503) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:21,243::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:13:21,243::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:13:21,243::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:13:21,308::__init__::225::IOProcess::(_processLogs) DEBUG|(540504) Building response >Thread-19::DEBUG::2014-08-11 17:13:21,310::__init__::225::IOProcess::(_processLogs) (540504) Queuing response >Thread-27::DEBUG::2014-08-11 17:13:21,310::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000308496 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:21,311::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:21,312::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:13:21,312::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:21,313::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:13:21,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:21,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:21,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:21,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:21,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:21,316::__init__::225::IOProcess::(_processLogs) (540505) Finding callback 'stat'... >Thread-10017::INFO::2014-08-11 17:13:21,316::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:13:21,317::__init__::225::IOProcess::(_processLogs) (540505) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:13:21,318::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f19342e-ea99-4e46-b530-82809c5dba28`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:13:21,318::__init__::225::IOProcess::(_processLogs) (540505) Building response >Thread-10017::DEBUG::2014-08-11 17:13:21,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f19342e-ea99-4e46-b530-82809c5dba28`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:13:21,319::__init__::225::IOProcess::(_processLogs) (540505) Queuing response >Thread-10017::DEBUG::2014-08-11 17:13:21,319::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:13:21,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:13:21,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Dummy-51::DEBUG::2014-08-11 17:13:21,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0822692 s, 12.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:21,321::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:13:21,322::task::993::Storage.TaskManager.Task::(_decref) Task=`7f19342e-ea99-4e46-b530-82809c5dba28`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:13:21,323::__init__::225::IOProcess::(_processLogs) (540505) Finding callback 'stat'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:21,323::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:21,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:21,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:21,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:21,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:21,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:21,327::__init__::225::IOProcess::(_processLogs) (540506) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:21,327::__init__::225::IOProcess::(_processLogs) (540506) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:21,328::__init__::225::IOProcess::(_processLogs) (540505) Finding callback 'stat'...DEBUG|(540506) Building response >Thread-19::DEBUG::2014-08-11 17:13:21,330::__init__::225::IOProcess::(_processLogs) (540506) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:21,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:21,331::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:13:21,345::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:22,464::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:22,464::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:22,464::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:22,529::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:22,530::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:22,530::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:23,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:23,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414296 s, 24.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) (540505) Finding callback 'stat'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:23,940::__init__::225::IOProcess::(_processLogs) (540507) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:23,941::__init__::225::IOProcess::(_processLogs) (540507) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:23,941::__init__::225::IOProcess::(_processLogs) (540507) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:23,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:13:23,942::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:13:23,999::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:13:24,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`0561cb68-6311-4613-a4d0-178b1dc7e7e8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:24,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-28::DEBUG::2014-08-11 17:13:24,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00195236 s, 254 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:24,002::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) (540508) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) (540508) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) (540508) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:24,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:24,004::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:13:24,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:24,004::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:24,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:24,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) (540509) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) (540509) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) (540509) Building response >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) (540509) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:24,005::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) (540510) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) (540510) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) (540510) Building response >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) (540510) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:24,006::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:24,007::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:24,007::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:13:24,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:24,007::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:24,007::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:24,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:24,008::__init__::225::IOProcess::(_processLogs) (540511) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:24,008::__init__::225::IOProcess::(_processLogs) (540511) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:24,008::__init__::225::IOProcess::(_processLogs) (540511) Building response >Thread-19::DEBUG::2014-08-11 17:13:24,008::__init__::225::IOProcess::(_processLogs) (540511) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:24,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:24,008::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::INFO::2014-08-11 17:13:24,059::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:24,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`0561cb68-6311-4613-a4d0-178b1dc7e7e8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:24,059::task::595::Storage.TaskManager.Task::(_updateState) Task=`0561cb68-6311-4613-a4d0-178b1dc7e7e8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:24,059::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:24,059::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:24,059::task::993::Storage.TaskManager.Task::(_decref) Task=`0561cb68-6311-4613-a4d0-178b1dc7e7e8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:13:24,066::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:13:24,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb4c855b-d024-4312-a8fe-324a10bbd6ed`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:13:24,066::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:13:24,066::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`39d79389-5ee2-4064-857b-aace0ec29b64`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:13:24,066::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:13:24,067::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:13:24,067::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`39d79389-5ee2-4064-857b-aace0ec29b64`::Granted request >Thread-10197::DEBUG::2014-08-11 17:13:24,067::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fb4c855b-d024-4312-a8fe-324a10bbd6ed`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:13:24,067::task::993::Storage.TaskManager.Task::(_decref) Task=`fb4c855b-d024-4312-a8fe-324a10bbd6ed`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:13:24,085::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:24,085::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb4c855b-d024-4312-a8fe-324a10bbd6ed`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:24,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb4c855b-d024-4312-a8fe-324a10bbd6ed`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:13:24,085::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:13:24,085::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:13:24,086::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:13:24,086::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:13:24,086::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:13:24,086::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:13:24,086::task::993::Storage.TaskManager.Task::(_decref) Task=`fb4c855b-d024-4312-a8fe-324a10bbd6ed`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:13:25,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:25,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633785 s, 16.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:13:26,800::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:13:27,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2e0fa30-a86f-420e-ae30-d79bf5ad3091`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:27,195::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:13:27,195::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308496', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00195236', 'lastCheck': '3.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:27,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2e0fa30-a86f-420e-ae30-d79bf5ad3091`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000308496', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00195236', 'lastCheck': '3.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:27,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2e0fa30-a86f-420e-ae30-d79bf5ad3091`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:27,196::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:27,196::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:27,196::task::993::Storage.TaskManager.Task::(_decref) Task=`d2e0fa30-a86f-420e-ae30-d79bf5ad3091`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:13:27,210::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:27,210::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:27,467::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:27,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:27,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:27,533::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:27,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:27,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:27,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:27,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490919 s, 20.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:13:28,508::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:13:29,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:29,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152216 s, 67.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:31,330::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) (540512) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) (540512) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:31,331::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540512) Building response >Thread-27::DEBUG::2014-08-11 17:13:31,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:13:31,332::__init__::225::IOProcess::(_processLogs) (540512) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:31,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:31,391::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:13:31,392::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000546575 s, 670 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) (540513) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) (540513) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:31,393::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540513) Building response >Thread-19::DEBUG::2014-08-11 17:13:31,394::__init__::225::IOProcess::(_processLogs) (540513) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:31,394::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:13:31,394::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:13:31,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:31,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547974 s, 18.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:32,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:32,478::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:32,480::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:32,540::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:32,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:32,544::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:33,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:13:34,010::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) (540514) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:34,011::__init__::225::IOProcess::(_processLogs) (540514) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:34,012::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540514) Building response >Thread-19::DEBUG::2014-08-11 17:13:34,012::__init__::225::IOProcess::(_processLogs) (540514) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:34,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:34,012::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:13:34,013::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:34,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.062053 s, 16.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:13:34,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000542581 s, 912 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:34,080::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:34,080::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:34,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:34,081::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:34,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:34,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:34,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:34,084::__init__::225::IOProcess::(_processLogs) (540515) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:34,084::__init__::225::IOProcess::(_processLogs) (540515) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:34,085::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540515) Building response >Thread-19::DEBUG::2014-08-11 17:13:34,086::__init__::225::IOProcess::(_processLogs) (540515) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:34,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:34,087::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:13:34,087::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:34,088::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:13:34,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:34,089::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:34,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:34,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:34,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:34,089::__init__::225::IOProcess::(_processLogs) (540516) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540516) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) (540516) Building response >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) (540516) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:13:34,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) (540517) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) (540517) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) (540517) Building response >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) (540517) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:34,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) (540518) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) (540518) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:34,092::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540518) Building response >Thread-19::DEBUG::2014-08-11 17:13:34,093::__init__::225::IOProcess::(_processLogs) (540518) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:34,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:34,093::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:13:34,117::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:13:34,117::task::595::Storage.TaskManager.Task::(_updateState) Task=`2535df16-3d9e-469a-bd77-c6320dc116d0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:34,117::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:13:34,130::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:34,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`2535df16-3d9e-469a-bd77-c6320dc116d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:34,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`2535df16-3d9e-469a-bd77-c6320dc116d0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:34,130::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:34,130::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:34,130::task::993::Storage.TaskManager.Task::(_decref) Task=`2535df16-3d9e-469a-bd77-c6320dc116d0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:13:34,138::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:13:34,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`c693006a-6f6c-4ecc-b713-4889f07a52c3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:13:34,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:13:34,139::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5ddc4b50-3249-48d6-bd98-664244fc8e2f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:13:34,139::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:13:34,139::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:13:34,139::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5ddc4b50-3249-48d6-bd98-664244fc8e2f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:13:34,139::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c693006a-6f6c-4ecc-b713-4889f07a52c3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:13:34,140::task::993::Storage.TaskManager.Task::(_decref) Task=`c693006a-6f6c-4ecc-b713-4889f07a52c3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:13:34,159::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:34,159::task::1191::Storage.TaskManager.Task::(prepare) Task=`c693006a-6f6c-4ecc-b713-4889f07a52c3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:34,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`c693006a-6f6c-4ecc-b713-4889f07a52c3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:13:34,159::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:13:34,159::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:13:34,159::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:13:34,159::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:13:34,160::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:13:34,160::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:13:34,160::task::993::Storage.TaskManager.Task::(_decref) Task=`c693006a-6f6c-4ecc-b713-4889f07a52c3`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:13:36,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:36,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380171 s, 26.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:13:36,405::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:37,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:37,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:37,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:37,550::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:37,551::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:37,551::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:38,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:38,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013872 s, 73.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:13:40,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:40,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0202219 s, 50.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:41,395::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:41,395::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:41,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:41,395::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) (540519) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) (540519) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540519) Building response >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) (540519) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:41,396::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:13:41,397::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:13:41,397::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:13:41,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000672729 s, 544 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:41,457::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:41,457::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:41,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:41,457::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:41,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:41,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:41,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:41,458::__init__::225::IOProcess::(_processLogs) (540520) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:41,458::__init__::225::IOProcess::(_processLogs) (540520) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:41,458::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540520) Building response >Thread-19::DEBUG::2014-08-11 17:13:41,459::__init__::225::IOProcess::(_processLogs) (540520) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:41,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:41,459::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:13:41,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ecd0dc2-c108-4570-b999-7820fb3bd3b1`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:13:41,844::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:13:41,844::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) (540521) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:13:41,845::__init__::225::IOProcess::(_processLogs) (540521) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540521) Building response >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) (540521) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:13:41,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:41,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:41,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:41,847::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:13:41,847::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:13:41,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:13:41,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ecd0dc2-c108-4570-b999-7820fb3bd3b1`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:13:41,848::__init__::225::IOProcess::(_processLogs) (540522) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:13:41,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ecd0dc2-c108-4570-b999-7820fb3bd3b1`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:13:41,849::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:13:41,849::__init__::225::IOProcess::(_processLogs) (540522) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:13:41,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:13:41,849::__init__::225::IOProcess::(_processLogs) (540522) Building response >Thread-10102::DEBUG::2014-08-11 17:13:41,849::task::993::Storage.TaskManager.Task::(_decref) Task=`8ecd0dc2-c108-4570-b999-7820fb3bd3b1`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:13:41,850::__init__::225::IOProcess::(_processLogs) (540522) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:41,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:41,850::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:13:41,872::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:13:42,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:42,493::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:42,496::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:42,499::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:42,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.040483 s, 25.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:13:42,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:42,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:42,558::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:42,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f91799c-83d1-485e-a419-9d0e22c6ef85`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:42,588::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:13:42,588::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672729', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542581', 'lastCheck': '8.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:42,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f91799c-83d1-485e-a419-9d0e22c6ef85`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000672729', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000542581', 'lastCheck': '8.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:42,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f91799c-83d1-485e-a419-9d0e22c6ef85`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:42,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:42,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:42,588::task::993::Storage.TaskManager.Task::(_decref) Task=`4f91799c-83d1-485e-a419-9d0e22c6ef85`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:13:42,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:42,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) (540523) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:44,094::__init__::225::IOProcess::(_processLogs) (540523) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:44,096::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540523) Building response >Thread-19::DEBUG::2014-08-11 17:13:44,096::__init__::225::IOProcess::(_processLogs) (540523) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:44,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:44,096::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:13:44,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:13:44,158::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00138958 s, 356 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) (540524) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) (540524) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:44,159::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540524) Building response >Thread-19::DEBUG::2014-08-11 17:13:44,160::__init__::225::IOProcess::(_processLogs) (540524) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:44,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:44,160::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:44,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) (540525) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) (540525) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) (540525) Building response >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) (540525) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:13:44,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) (540526) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) (540526) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) (540526) Building response >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) (540526) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:44,163::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:44,164::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:13:44,164::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:44,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:44,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:44,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:44,164::__init__::225::IOProcess::(_processLogs) (540527) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:44,165::__init__::225::IOProcess::(_processLogs) (540527) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:44,165::__init__::225::IOProcess::(_processLogs) (540527) Building response >Thread-19::DEBUG::2014-08-11 17:13:44,165::__init__::225::IOProcess::(_processLogs) (540527) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:44,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:44,165::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:13:44,210::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:13:44,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`38a8d525-0b56-498c-b8b5-9c76dc5ffbdf`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:44,210::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:13:44,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:44,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`38a8d525-0b56-498c-b8b5-9c76dc5ffbdf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:44,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`38a8d525-0b56-498c-b8b5-9c76dc5ffbdf`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:44,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:44,230::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:44,230::task::993::Storage.TaskManager.Task::(_decref) Task=`38a8d525-0b56-498c-b8b5-9c76dc5ffbdf`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:13:44,237::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:13:44,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9ef4838-0df7-4779-9474-fe45c3f74405`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:13:44,237::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:13:44,238::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d8381ba8-2753-4d27-ab6b-fc26315f13d2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:13:44,238::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:13:44,238::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:13:44,238::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d8381ba8-2753-4d27-ab6b-fc26315f13d2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:13:44,238::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b9ef4838-0df7-4779-9474-fe45c3f74405`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:13:44,238::task::993::Storage.TaskManager.Task::(_decref) Task=`b9ef4838-0df7-4779-9474-fe45c3f74405`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:13:44,257::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:44,257::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9ef4838-0df7-4779-9474-fe45c3f74405`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:44,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9ef4838-0df7-4779-9474-fe45c3f74405`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:13:44,257::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:13:44,257::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:13:44,257::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:13:44,257::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:13:44,257::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:13:44,257::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:13:44,258::task::993::Storage.TaskManager.Task::(_decref) Task=`b9ef4838-0df7-4779-9474-fe45c3f74405`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:13:44,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:44,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127474 s, 80.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:13:46,568::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:13:46,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:46,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014964 s, 68.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:47,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:47,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:47,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:47,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:47,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:47,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:48,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:48,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296436 s, 34.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:13:50,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:50,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373977 s, 27.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:51,459::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) (540528) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) (540528) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) (540528) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:51,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:13:51,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:13:51,523::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00240832 s, 152 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:51,524::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:51,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:51,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:51,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:51,524::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:13:51,525::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:13:51,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:51,525::__init__::225::IOProcess::(_processLogs) (540529) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:51,525::__init__::225::IOProcess::(_processLogs) (540529) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:51,526::__init__::225::IOProcess::(_processLogs) (540529) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:51,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:51,526::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:52,510::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:52,511::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:52,511::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:52,569::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:52,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:52,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:13:52,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:52,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411764 s, 24.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) (540530) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:54,165::__init__::225::IOProcess::(_processLogs) (540530) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:54,166::__init__::225::IOProcess::(_processLogs) (540530) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:54,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:13:54,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:13:54,225::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000873061 s, 567 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) (540531) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:13:54,226::__init__::225::IOProcess::(_processLogs) (540531) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:13:54,227::__init__::225::IOProcess::(_processLogs) (540531) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:54,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:54,227::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:13:54,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:54,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:54,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:54,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:54,228::__init__::225::IOProcess::(_processLogs) (540532) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:54,228::__init__::225::IOProcess::(_processLogs) (540532) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) (540532) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:54,229::__init__::225::IOProcess::(_processLogs) (540533) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:54,230::__init__::225::IOProcess::(_processLogs) (540533) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:54,230::__init__::225::IOProcess::(_processLogs) (540533) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:54,230::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:13:54,230::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) (540534) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) (540534) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:13:54,231::__init__::225::IOProcess::(_processLogs) (540534) Building response >Thread-19::DEBUG::2014-08-11 17:13:54,232::__init__::225::IOProcess::(_processLogs) (540534) Queuing response >Thread-19::DEBUG::2014-08-11 17:13:54,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:13:54,232::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:13:54,328::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:13:54,329::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eacd6cd-ba19-46a5-bcdc-4d973f14ba6c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:54,329::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:13:54,379::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:54,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`2eacd6cd-ba19-46a5-bcdc-4d973f14ba6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:13:54,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`2eacd6cd-ba19-46a5-bcdc-4d973f14ba6c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:54,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:54,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:54,380::task::993::Storage.TaskManager.Task::(_decref) Task=`2eacd6cd-ba19-46a5-bcdc-4d973f14ba6c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:13:54,387::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:13:54,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7b63987-cda2-4a01-826d-18987d6bacc6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:13:54,387::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:13:54,387::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c86ca1ed-b3ac-40ae-9784-d1867aebcd61`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:13:54,387::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:13:54,388::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:13:54,388::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c86ca1ed-b3ac-40ae-9784-d1867aebcd61`::Granted request >Thread-10197::DEBUG::2014-08-11 17:13:54,388::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f7b63987-cda2-4a01-826d-18987d6bacc6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:13:54,388::task::993::Storage.TaskManager.Task::(_decref) Task=`f7b63987-cda2-4a01-826d-18987d6bacc6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:13:54,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:54,411::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7b63987-cda2-4a01-826d-18987d6bacc6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:13:54,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7b63987-cda2-4a01-826d-18987d6bacc6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:13:54,411::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:13:54,411::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:13:54,411::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:13:54,411::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:13:54,411::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:13:54,411::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:13:54,411::task::993::Storage.TaskManager.Task::(_decref) Task=`f7b63987-cda2-4a01-826d-18987d6bacc6`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:13:54,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:55,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130012 s, 78.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:13:56,880::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:13:57,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:57,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129605 s, 79.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:57,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:57,516::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:13:57,516::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:57,575::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:57,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:13:57,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:57,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`7311a54e-cbc2-40ff-92e7-08179cd3dc4e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:13:57,812::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:13:57,812::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00240832', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000873061', 'lastCheck': '3.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:57,812::task::1191::Storage.TaskManager.Task::(prepare) Task=`7311a54e-cbc2-40ff-92e7-08179cd3dc4e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00240832', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000873061', 'lastCheck': '3.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:13:57,812::task::595::Storage.TaskManager.Task::(_updateState) Task=`7311a54e-cbc2-40ff-92e7-08179cd3dc4e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:13:57,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:13:57,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:13:57,813::task::993::Storage.TaskManager.Task::(_decref) Task=`7311a54e-cbc2-40ff-92e7-08179cd3dc4e`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:13:57,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:13:57,827::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:13:58,579::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:13:59,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:13:59,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460295 s, 22.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:01,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:01,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0506608 s, 20.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:01,527::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:01,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:01,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:01,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:01,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:01,527::__init__::225::IOProcess::(_processLogs) (540535) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:01,528::__init__::225::IOProcess::(_processLogs) (540535) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:01,528::__init__::225::IOProcess::(_processLogs) (540535) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:01,529::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:14:01,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:14:01,589::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00110789 s, 330 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:01,590::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:01,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:01,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:01,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:01,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:01,591::__init__::225::IOProcess::(_processLogs) (540536) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:01,591::__init__::225::IOProcess::(_processLogs) (540536) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:01,591::__init__::225::IOProcess::(_processLogs) (540536) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:01,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:01,592::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:02,521::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:02,523::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:02,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:02,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:02,584::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:02,585::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:03,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:03,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0325088 s, 31.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:04,231::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:04,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:04,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:04,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:04,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:04,232::__init__::225::IOProcess::(_processLogs) (540537) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:04,232::__init__::225::IOProcess::(_processLogs) (540537) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:04,233::__init__::225::IOProcess::(_processLogs) (540537) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:04,234::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:14:04,234::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:14:04,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000364831 s, 1.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) (540538) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:04,294::__init__::225::IOProcess::(_processLogs) (540538) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:04,295::__init__::225::IOProcess::(_processLogs) (540538) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:04,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:04,295::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:14:04,295::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) (540539) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) (540539) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) (540539) Building response >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) (540539) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:04,296::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) (540540) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:04,297::__init__::225::IOProcess::(_processLogs) (540540) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) (540540) Building response >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) (540540) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:04,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) (540541) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) (540541) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) (540541) Building response >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) (540541) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:04,299::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:14:04,448::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:14:04,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2c39c64-c524-4cd4-ad8a-4d3fb7b64c3d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:04,448::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:14:04,529::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:04,529::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2c39c64-c524-4cd4-ad8a-4d3fb7b64c3d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:04,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2c39c64-c524-4cd4-ad8a-4d3fb7b64c3d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:04,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:04,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:04,529::task::993::Storage.TaskManager.Task::(_decref) Task=`e2c39c64-c524-4cd4-ad8a-4d3fb7b64c3d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:14:04,537::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:14:04,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`044bd512-32e0-46bb-b7b6-aba0fcc70325`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:14:04,538::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:14:04,538::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f9861e80-906f-47d9-b508-2f158c7749c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:14:04,538::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:14:04,539::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:14:04,539::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f9861e80-906f-47d9-b508-2f158c7749c6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:14:04,539::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`044bd512-32e0-46bb-b7b6-aba0fcc70325`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:14:04,540::task::993::Storage.TaskManager.Task::(_decref) Task=`044bd512-32e0-46bb-b7b6-aba0fcc70325`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:14:04,574::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:04,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`044bd512-32e0-46bb-b7b6-aba0fcc70325`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:04,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`044bd512-32e0-46bb-b7b6-aba0fcc70325`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:14:04,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:14:04,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:14:04,575::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:14:04,575::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:14:04,575::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:14:04,575::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:14:04,575::task::993::Storage.TaskManager.Task::(_decref) Task=`044bd512-32e0-46bb-b7b6-aba0fcc70325`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:14:05,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:05,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387638 s, 26.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:14:06,534::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:07,532::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:07,532::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:07,532::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:07,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:14:07,633::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:07,634::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:07,634::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:07,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458817 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:09,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:09,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551259 s, 18.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:11,592::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:11,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:11,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:11,593::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:11,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:11,593::__init__::225::IOProcess::(_processLogs) (540542) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:11,593::__init__::225::IOProcess::(_processLogs) (540542) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:11,593::__init__::225::IOProcess::(_processLogs) (540542) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:11,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:14:11,594::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:14:11,594::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:14:11,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000340019 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) (540543) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) (540543) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:11,654::__init__::225::IOProcess::(_processLogs) (540543) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:11,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:11,655::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:14:11,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:14:11,888::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:14:11,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487946 s, 21.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:12,536::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:12,536::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:12,536::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:12,640::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:12,640::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:12,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:13,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6246667-d07a-4043-97ed-68a7d61da5a0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:13,034::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:14:13,035::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340019', 'lastCheck': '1.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364831', 'lastCheck': '8.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:13,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6246667-d07a-4043-97ed-68a7d61da5a0`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000340019', 'lastCheck': '1.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364831', 'lastCheck': '8.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:13,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6246667-d07a-4043-97ed-68a7d61da5a0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:13,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:13,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:13,035::task::993::Storage.TaskManager.Task::(_decref) Task=`a6246667-d07a-4043-97ed-68a7d61da5a0`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:14:13,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:13,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:13,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:13,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125455 s, 81.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:14,300::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:14,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:14,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:14,300::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:14,300::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:14,300::__init__::225::IOProcess::(_processLogs) (540544) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:14,301::__init__::225::IOProcess::(_processLogs) (540544) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:14,302::__init__::225::IOProcess::(_processLogs) (540544) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:14,303::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:14:14,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:14:14,388::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000366808 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:14,389::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:14,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:14,390::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:14,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:14,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:14,390::__init__::225::IOProcess::(_processLogs) (540545) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) (540545) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) (540545) Building response >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) (540545) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:14:14,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) (540546) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) (540546) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) (540546) Building response >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) (540546) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:14,392::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) (540547) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:14,393::__init__::225::IOProcess::(_processLogs) (540547) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) (540547) Building response >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) (540547) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:14,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) (540548) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) (540548) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) (540548) Building response >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) (540548) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:14,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:14,396::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:14:14,611::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:14:14,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd04c2be-b9d9-4989-8188-c8d943dc1725`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:14,611::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:14:14,668::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:14,669::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd04c2be-b9d9-4989-8188-c8d943dc1725`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:14,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd04c2be-b9d9-4989-8188-c8d943dc1725`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:14,669::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:14,669::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:14,669::task::993::Storage.TaskManager.Task::(_decref) Task=`cd04c2be-b9d9-4989-8188-c8d943dc1725`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:14:14,680::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:14:14,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`a01fbb59-1d7b-498a-9943-12c8f814b4e3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:14:14,681::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:14:14,681::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c14d4998-2a93-4b74-8700-951050f6cb62`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:14:14,681::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:14:14,681::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:14:14,681::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c14d4998-2a93-4b74-8700-951050f6cb62`::Granted request >Thread-10197::DEBUG::2014-08-11 17:14:14,681::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a01fbb59-1d7b-498a-9943-12c8f814b4e3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:14:14,681::task::993::Storage.TaskManager.Task::(_decref) Task=`a01fbb59-1d7b-498a-9943-12c8f814b4e3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:14:14,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:14,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`a01fbb59-1d7b-498a-9943-12c8f814b4e3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:14,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`a01fbb59-1d7b-498a-9943-12c8f814b4e3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:14:14,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:14:14,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:14:14,708::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:14:14,708::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:14:14,708::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:14:14,708::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:14:14,708::task::993::Storage.TaskManager.Task::(_decref) Task=`a01fbb59-1d7b-498a-9943-12c8f814b4e3`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:14:16,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:16,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144026 s, 71.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:14:16,658::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:17,537::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:17,538::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:17,538::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:17,646::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:17,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:17,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:18,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:18,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0659257 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:20,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:20,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0306645 s, 33.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:14:21,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`037d4958-cb26-43d3-8d7c-f16d61ecb8d9`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:14:21,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:14:21,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:21,536::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) (540549) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:14:21,537::__init__::225::IOProcess::(_processLogs) (540549) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:14:21,542::__init__::225::IOProcess::(_processLogs) DEBUG|(540549) Building response >Thread-19::DEBUG::2014-08-11 17:14:21,542::__init__::225::IOProcess::(_processLogs) (540549) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:21,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:21,542::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:14:21,542::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:21,543::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:14:21,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:21,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:21,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:21,543::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:14:21,543::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:14:21,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:14:21,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`037d4958-cb26-43d3-8d7c-f16d61ecb8d9`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:14:21,544::__init__::225::IOProcess::(_processLogs) (540550) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:14:21,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`037d4958-cb26-43d3-8d7c-f16d61ecb8d9`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:14:21,545::__init__::225::IOProcess::(_processLogs) (540550) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:14:21,545::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:14:21,545::__init__::225::IOProcess::(_processLogs) (540550) Building response >Thread-10017::DEBUG::2014-08-11 17:14:21,545::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:14:21,546::__init__::225::IOProcess::(_processLogs) (540550) Queuing response >Thread-10017::DEBUG::2014-08-11 17:14:21,546::task::993::Storage.TaskManager.Task::(_decref) Task=`037d4958-cb26-43d3-8d7c-f16d61ecb8d9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:14:21,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:21,546::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:14:21,566::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:14:21,655::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) (540551) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) (540551) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540551) Building response >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) (540551) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:21,656::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:21,657::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:14:21,657::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:14:21,717::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00110374 s, 332 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) (540552) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:21,718::__init__::225::IOProcess::(_processLogs) (540552) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:21,719::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540552) Building response >Thread-19::DEBUG::2014-08-11 17:14:21,719::__init__::225::IOProcess::(_processLogs) (540552) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:21,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:21,719::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:14:22,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:22,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148104 s, 69.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:22,543::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:22,544::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:22,544::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:22,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:22,653::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:22,653::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:24,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:14:24,396::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:24,454::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:24,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:24,454::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:24,454::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:24,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:24,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:24,455::__init__::225::IOProcess::(_processLogs) (540553) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:24,455::__init__::225::IOProcess::(_processLogs) (540553) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:24,455::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540553) Building response >Thread-28::DEBUG::2014-08-11 17:14:24,456::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:14:24,456::__init__::225::IOProcess::(_processLogs) (540553) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:24,514::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:24,514::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:14:24,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0708003 s, 14.5 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:14:24,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00152493 s, 325 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:24,528::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:24,528::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:24,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:24,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:24,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:24,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:24,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:24,531::__init__::225::IOProcess::(_processLogs) (540554) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:24,532::__init__::225::IOProcess::(_processLogs) (540554) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:24,532::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540554) Building response >Thread-19::DEBUG::2014-08-11 17:14:24,533::__init__::225::IOProcess::(_processLogs) (540554) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:24,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:24,534::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:14:24,535::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:24,536::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:14:24,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:24,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:24,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:24,538::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:24,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:24,539::__init__::225::IOProcess::(_processLogs) (540555) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:24,539::__init__::225::IOProcess::(_processLogs) (540555) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:24,540::__init__::225::IOProcess::(_processLogs) (540555) Building response >Thread-19::DEBUG::2014-08-11 17:14:24,540::__init__::225::IOProcess::(_processLogs) (540555) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:24,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:24,541::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:24,542::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:24,542::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:14:24,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:24,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:24,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:24,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:24,544::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:24,545::__init__::225::IOProcess::(_processLogs) (540556) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:24,545::__init__::225::IOProcess::(_processLogs) (540556) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:24,546::__init__::225::IOProcess::(_processLogs) (540556) Building response >Thread-19::DEBUG::2014-08-11 17:14:24,546::__init__::225::IOProcess::(_processLogs) (540556) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:24,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:24,547::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:24,548::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:24,548::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:14:24,548::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:24,549::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:24,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:24,550::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:24,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:24,551::__init__::225::IOProcess::(_processLogs) (540557) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:24,551::__init__::225::IOProcess::(_processLogs) (540557) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:24,552::__init__::225::IOProcess::(_processLogs) (540557) Building response >Thread-19::DEBUG::2014-08-11 17:14:24,552::__init__::225::IOProcess::(_processLogs) (540557) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:24,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:24,553::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:14:24,764::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:14:24,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`1dc29579-d761-4b37-8ff3-f7f596c9727f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:24,765::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:14:24,827::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:24,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`1dc29579-d761-4b37-8ff3-f7f596c9727f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:24,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`1dc29579-d761-4b37-8ff3-f7f596c9727f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:24,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:24,827::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:24,827::task::993::Storage.TaskManager.Task::(_decref) Task=`1dc29579-d761-4b37-8ff3-f7f596c9727f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:14:24,839::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:14:24,839::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bdab785-53e0-47e6-8bcb-018c9d364ecc`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:14:24,839::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:14:24,839::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1dca6cac-05d0-4433-8b64-9d9a5528e237`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:14:24,840::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:14:24,840::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:14:24,840::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1dca6cac-05d0-4433-8b64-9d9a5528e237`::Granted request >Thread-10197::DEBUG::2014-08-11 17:14:24,840::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2bdab785-53e0-47e6-8bcb-018c9d364ecc`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:14:24,840::task::993::Storage.TaskManager.Task::(_decref) Task=`2bdab785-53e0-47e6-8bcb-018c9d364ecc`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:14:24,860::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:24,860::task::1191::Storage.TaskManager.Task::(prepare) Task=`2bdab785-53e0-47e6-8bcb-018c9d364ecc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:24,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`2bdab785-53e0-47e6-8bcb-018c9d364ecc`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:14:24,860::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:14:24,861::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:14:24,861::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:14:24,861::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:14:24,861::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:14:24,861::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:14:24,861::task::993::Storage.TaskManager.Task::(_decref) Task=`2bdab785-53e0-47e6-8bcb-018c9d364ecc`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:14:26,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:26,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405866 s, 25.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:14:26,896::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:27,550::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:27,550::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:27,551::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:27,659::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:27,659::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:27,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:28,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`65d5bae1-3b3a-4731-8a60-f5b0176b9f5a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:28,201::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:14:28,201::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110374', 'lastCheck': '6.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152493', 'lastCheck': '3.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:28,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`65d5bae1-3b3a-4731-8a60-f5b0176b9f5a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110374', 'lastCheck': '6.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00152493', 'lastCheck': '3.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:28,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`65d5bae1-3b3a-4731-8a60-f5b0176b9f5a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:28,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:28,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:28,201::task::993::Storage.TaskManager.Task::(_decref) Task=`65d5bae1-3b3a-4731-8a60-f5b0176b9f5a`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:14:28,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:28,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:28,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:14:28,725::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:14:28,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0509552 s, 20.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:30,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:30,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301714 s, 33.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:31,720::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:31,721::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:31,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:31,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:31,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:31,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:14:31,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:14:31,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:31,783::__init__::225::IOProcess::(_processLogs) (540558) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:31,784::__init__::225::IOProcess::(_processLogs) (540558) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:31,784::__init__::225::IOProcess::(_processLogs) (540558) Building response >Thread-19::DEBUG::2014-08-11 17:14:31,785::__init__::225::IOProcess::(_processLogs) (540558) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:31,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:31,786::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:14:31,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00160791 s, 228 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:31,788::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:31,788::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:31,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:31,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:31,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:31,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:31,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:31,791::__init__::225::IOProcess::(_processLogs) (540559) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:31,791::__init__::225::IOProcess::(_processLogs) (540559) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:31,792::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540559) Building response >Thread-19::DEBUG::2014-08-11 17:14:31,793::__init__::225::IOProcess::(_processLogs) (540559) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:31,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:31,794::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:32,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:32,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:32,561::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:32,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:32,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:32,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:32,882::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:32,954::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134676 s, 76.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:34,551::__init__::225::IOProcess::(_processLogs) (540560) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:34,552::__init__::225::IOProcess::(_processLogs) (540560) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:34,552::__init__::225::IOProcess::(_processLogs) (540560) Building response >Thread-19::DEBUG::2014-08-11 17:14:34,552::__init__::225::IOProcess::(_processLogs) (540560) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:34,552::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:34,552::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:14:34,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:14:34,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00342796 s, 144 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) (540561) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:34,617::__init__::225::IOProcess::(_processLogs) (540561) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:34,618::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540561) Building response >Thread-19::DEBUG::2014-08-11 17:14:34,618::__init__::225::IOProcess::(_processLogs) (540561) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:34,618::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:14:34,618::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:34,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) (540562) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) (540562) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) (540562) Building response >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) (540562) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:34,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) (540563) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) (540563) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) (540563) Building response >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) (540563) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:34,621::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) (540564) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:34,622::__init__::225::IOProcess::(_processLogs) (540564) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:34,631::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540564) Building response >Thread-19::DEBUG::2014-08-11 17:14:34,631::__init__::225::IOProcess::(_processLogs) (540564) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:34,631::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:14:34,631::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:14:34,929::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:14:34,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`394c6450-baf9-492f-99a3-606a5ad28c96`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:34,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:14:34,944::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:34,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`394c6450-baf9-492f-99a3-606a5ad28c96`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:34,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`394c6450-baf9-492f-99a3-606a5ad28c96`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:34,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:34,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:34,947::task::993::Storage.TaskManager.Task::(_decref) Task=`394c6450-baf9-492f-99a3-606a5ad28c96`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:14:34,961::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Dummy-51::DEBUG::2014-08-11 17:14:34,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10197::DEBUG::2014-08-11 17:14:34,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b927c48-f7d2-435d-8920-d3e94164bb13`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:14:35,079::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:14:35,080::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`55a6c892-49b0-469f-9628-d1dc2df60af0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:14:35,080::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:14:35,080::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:14:35,080::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`55a6c892-49b0-469f-9628-d1dc2df60af0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:14:35,080::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b927c48-f7d2-435d-8920-d3e94164bb13`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:14:35,080::task::993::Storage.TaskManager.Task::(_decref) Task=`4b927c48-f7d2-435d-8920-d3e94164bb13`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:14:35,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0811405 s, 12.6 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:14:35,168::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:35,168::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b927c48-f7d2-435d-8920-d3e94164bb13`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:35,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b927c48-f7d2-435d-8920-d3e94164bb13`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:14:35,168::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:14:35,168::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:14:35,168::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:14:35,169::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:14:35,169::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:14:35,169::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:14:35,169::task::993::Storage.TaskManager.Task::(_decref) Task=`4b927c48-f7d2-435d-8920-d3e94164bb13`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:14:36,573::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:14:37,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:37,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122492 s, 83.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:37,567::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:37,568::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:37,568::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:37,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:37,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:37,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:39,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:39,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307015 s, 33.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:41,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:41,441::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354599 s, 28.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:41,794::__init__::225::IOProcess::(_processLogs) (540565) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:41,795::__init__::225::IOProcess::(_processLogs) (540565) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:41,795::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540565) Building response >Thread-19::DEBUG::2014-08-11 17:14:41,795::__init__::225::IOProcess::(_processLogs) (540565) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:41,795::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:14:41,796::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:14:41,796::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:14:41,857::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000756488 s, 484 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:41,858::__init__::225::IOProcess::(_processLogs) (540566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:41,859::__init__::225::IOProcess::(_processLogs) (540566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:41,859::__init__::225::IOProcess::(_processLogs) (540566) Building response >Thread-19::DEBUG::2014-08-11 17:14:41,859::__init__::225::IOProcess::(_processLogs) (540566) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:41,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:41,859::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:14:41,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`b88563e8-24ee-4ee0-b202-fbc69cebbc17`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:14:41,898::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) (540567) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:14:41,899::__init__::225::IOProcess::(_processLogs) (540567) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:14:41,900::__init__::225::IOProcess::(_processLogs) DEBUG|(540567) Building response >Thread-19::DEBUG::2014-08-11 17:14:41,900::__init__::225::IOProcess::(_processLogs) (540567) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:41,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:41,901::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:14:41,901::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:41,901::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:14:41,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:41,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:41,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:14:41,902::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:14:41,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:14:41,902::task::1191::Storage.TaskManager.Task::(prepare) Task=`b88563e8-24ee-4ee0-b202-fbc69cebbc17`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:14:41,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:14:41,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`b88563e8-24ee-4ee0-b202-fbc69cebbc17`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:14:41,903::__init__::225::IOProcess::(_processLogs) (540568) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:14:41,903::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:14:41,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:14:41,904::__init__::225::IOProcess::(_processLogs) (540568) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:14:41,904::task::993::Storage.TaskManager.Task::(_decref) Task=`b88563e8-24ee-4ee0-b202-fbc69cebbc17`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:14:41,904::__init__::225::IOProcess::(_processLogs) (540568) Building response >Thread-19::DEBUG::2014-08-11 17:14:41,905::__init__::225::IOProcess::(_processLogs) (540568) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:41,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:41,905::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:14:41,926::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:42,574::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:42,574::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:42,574::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:42,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:42,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:42,679::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:43,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcf829b7-c6b1-4bf3-bd32-5925901cc08c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:43,402::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:14:43,402::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756488', 'lastCheck': '1.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00342796', 'lastCheck': '8.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:43,402::task::1191::Storage.TaskManager.Task::(prepare) Task=`dcf829b7-c6b1-4bf3-bd32-5925901cc08c`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756488', 'lastCheck': '1.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00342796', 'lastCheck': '8.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:43,402::task::595::Storage.TaskManager.Task::(_updateState) Task=`dcf829b7-c6b1-4bf3-bd32-5925901cc08c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:43,402::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:43,402::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:43,402::task::993::Storage.TaskManager.Task::(_decref) Task=`dcf829b7-c6b1-4bf3-bd32-5925901cc08c`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:14:43,413::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:43,413::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:43,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:43,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126533 s, 80.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:44,632::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:44,632::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:44,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:44,632::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:44,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:44,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:44,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:44,633::__init__::225::IOProcess::(_processLogs) (540569) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:44,633::__init__::225::IOProcess::(_processLogs) (540569) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:44,634::__init__::225::IOProcess::(_processLogs) DEBUG|(540569) Building response >Thread-19::DEBUG::2014-08-11 17:14:44,634::__init__::225::IOProcess::(_processLogs) (540569) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:44,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:44,634::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:14:44,635::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:14:44,696::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00106766 s, 464 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:44,696::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:44,696::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) (540570) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) (540570) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:44,697::__init__::225::IOProcess::(_processLogs) DEBUG|(540570) Building response >Thread-19::DEBUG::2014-08-11 17:14:44,698::__init__::225::IOProcess::(_processLogs) (540570) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:44,698::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:44,698::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:14:44,698::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:44,698::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:14:44,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) (540571) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) (540571) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) (540571) Building response >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) (540571) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:44,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:44,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) (540572) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) (540572) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) (540572) Building response >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) (540572) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:14:44,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) (540573) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) (540573) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) (540573) Building response >Thread-19::DEBUG::2014-08-11 17:14:44,702::__init__::225::IOProcess::(_processLogs) (540573) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:44,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:44,703::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:14:45,247::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:14:45,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`54898c2f-9401-467c-9691-e8ae35d0a0a0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:45,248::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:14:45,329::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:45,329::task::1191::Storage.TaskManager.Task::(prepare) Task=`54898c2f-9401-467c-9691-e8ae35d0a0a0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:45,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`54898c2f-9401-467c-9691-e8ae35d0a0a0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:45,330::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:45,330::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:45,330::task::993::Storage.TaskManager.Task::(_decref) Task=`54898c2f-9401-467c-9691-e8ae35d0a0a0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:14:45,338::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:14:45,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`f971f792-fb37-4190-b664-356eff3bfe8f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:14:45,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:14:45,339::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`078ab4f8-53c5-4b9a-9aeb-85008dfe4ac7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:14:45,339::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:14:45,339::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:14:45,339::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`078ab4f8-53c5-4b9a-9aeb-85008dfe4ac7`::Granted request >Thread-10197::DEBUG::2014-08-11 17:14:45,339::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f971f792-fb37-4190-b664-356eff3bfe8f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:14:45,339::task::993::Storage.TaskManager.Task::(_decref) Task=`f971f792-fb37-4190-b664-356eff3bfe8f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:14:45,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:45,356::task::1191::Storage.TaskManager.Task::(prepare) Task=`f971f792-fb37-4190-b664-356eff3bfe8f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:45,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`f971f792-fb37-4190-b664-356eff3bfe8f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:14:45,356::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:14:45,356::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:14:45,356::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:14:45,357::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:14:45,357::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:14:45,357::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:14:45,357::task::993::Storage.TaskManager.Task::(_decref) Task=`f971f792-fb37-4190-b664-356eff3bfe8f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:14:45,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:45,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510374 s, 20.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:14:46,799::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:47,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:47,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:47,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:47,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:14:47,706::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:47,706::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:47,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:47,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015404 s, 66.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:49,730::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:49,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0586924 s, 17.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:14:51,593::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:14:51,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:14:51,914::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:51,914::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:51,914::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:51,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:51,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) (540574) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) (540574) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540574) Building response >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) (540574) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:51,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:51,916::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:14:51,916::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:14:51,978::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000742695 s, 493 kB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:14:51,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0634945 s, 16.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:51,980::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:51,980::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:51,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:51,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:51,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:51,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:51,983::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:51,984::__init__::225::IOProcess::(_processLogs) (540575) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:51,985::__init__::225::IOProcess::(_processLogs) (540575) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:51,985::__init__::225::IOProcess::(_processLogs) (540575) Building response >Thread-19::DEBUG::2014-08-11 17:14:51,986::__init__::225::IOProcess::(_processLogs) (540575) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:51,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:51,986::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:52,585::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:52,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:52,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:52,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:52,713::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:52,713::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:53,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:54,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370591 s, 27.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:54,702::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) (540576) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) (540576) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540576) Building response >Thread-19::DEBUG::2014-08-11 17:14:54,703::__init__::225::IOProcess::(_processLogs) (540576) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:54,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:54,704::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:14:54,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:14:54,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00149215 s, 332 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) (540577) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) (540577) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:14:54,765::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540577) Building response >Thread-19::DEBUG::2014-08-11 17:14:54,766::__init__::225::IOProcess::(_processLogs) (540577) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:54,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:54,766::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:14:54,766::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:54,766::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) (540578) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) (540578) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:54,767::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540578) Building response >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) (540578) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:54,768::__init__::225::IOProcess::(_processLogs) (540579) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:54,769::__init__::225::IOProcess::(_processLogs) (540579) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:54,769::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540579) Building response >Thread-19::DEBUG::2014-08-11 17:14:54,769::__init__::225::IOProcess::(_processLogs) (540579) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:54,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:54,769::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:14:54,769::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:14:54,770::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:14:54,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:14:54,770::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:14:54,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:14:54,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:14:54,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:14:54,771::__init__::225::IOProcess::(_processLogs) (540580) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:14:54,771::__init__::225::IOProcess::(_processLogs) (540580) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:14:54,771::__init__::225::IOProcess::(_processLogs) (540580) Building response >Thread-19::DEBUG::2014-08-11 17:14:54,771::__init__::225::IOProcess::(_processLogs) (540580) Queuing response >Thread-19::DEBUG::2014-08-11 17:14:54,771::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:14:54,771::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:14:55,443::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:14:55,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`09f1e561-4320-452e-a0b0-49b2ba4f16d0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:55,444::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:14:55,489::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:55,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`09f1e561-4320-452e-a0b0-49b2ba4f16d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:14:55,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`09f1e561-4320-452e-a0b0-49b2ba4f16d0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:55,517::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:55,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:55,518::task::993::Storage.TaskManager.Task::(_decref) Task=`09f1e561-4320-452e-a0b0-49b2ba4f16d0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:14:55,530::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:14:55,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`78bec983-ab62-409f-b463-e0b5179a8f97`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:14:55,531::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:14:55,531::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6b7d71e6-3051-4d67-a2db-ef6e19ecf858`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:14:55,531::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:14:55,532::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:14:55,532::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6b7d71e6-3051-4d67-a2db-ef6e19ecf858`::Granted request >Thread-10197::DEBUG::2014-08-11 17:14:55,532::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`78bec983-ab62-409f-b463-e0b5179a8f97`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:14:55,532::task::993::Storage.TaskManager.Task::(_decref) Task=`78bec983-ab62-409f-b463-e0b5179a8f97`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:14:55,549::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:55,549::task::1191::Storage.TaskManager.Task::(prepare) Task=`78bec983-ab62-409f-b463-e0b5179a8f97`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:14:55,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`78bec983-ab62-409f-b463-e0b5179a8f97`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:14:55,549::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:14:55,549::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:14:55,550::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:14:55,550::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:14:55,550::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:14:55,550::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:14:55,550::task::993::Storage.TaskManager.Task::(_decref) Task=`78bec983-ab62-409f-b463-e0b5179a8f97`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:14:56,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:56,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0520695 s, 19.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:14:56,983::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:57,590::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:57,590::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:14:57,591::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:57,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:57,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:14:57,720::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:14:58,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:14:58,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424682 s, 24.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:14:58,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`232808d9-5f9a-4591-a030-c2ad8b5a0806`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:14:58,565::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:14:58,565::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742695', 'lastCheck': '6.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149215', 'lastCheck': '3.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:58,565::task::1191::Storage.TaskManager.Task::(prepare) Task=`232808d9-5f9a-4591-a030-c2ad8b5a0806`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000742695', 'lastCheck': '6.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00149215', 'lastCheck': '3.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:14:58,565::task::595::Storage.TaskManager.Task::(_updateState) Task=`232808d9-5f9a-4591-a030-c2ad8b5a0806`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:14:58,565::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:14:58,566::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:14:58,566::task::993::Storage.TaskManager.Task::(_decref) Task=`232808d9-5f9a-4591-a030-c2ad8b5a0806`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:14:58,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:14:58,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:14:58,812::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:15:00,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:00,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141136 s, 72.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:01,985::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:01,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:01,987::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:01,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:01,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:01,989::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:01,990::__init__::225::IOProcess::(_processLogs) (540581) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:01,990::__init__::225::IOProcess::(_processLogs) (540581) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:01,992::__init__::225::IOProcess::(_processLogs) (540581) Queuing response >Thread-27::DEBUG::2014-08-11 17:15:01,992::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:15:01,993::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:02,052::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:15:02,056::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00349601 s, 105 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:02,058::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:02,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:02,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:02,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:02,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:02,061::__init__::225::IOProcess::(_processLogs) (540582) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:02,062::__init__::225::IOProcess::(_processLogs) (540582) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:02,063::__init__::225::IOProcess::(_processLogs) (540582) Building response >Thread-19::DEBUG::2014-08-11 17:15:02,063::__init__::225::IOProcess::(_processLogs) (540582) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:02,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:02,064::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:15:02,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:02,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395069 s, 25.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:02,597::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:02,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:02,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:02,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:02,726::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:02,726::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:04,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:04,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200486 s, 51.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:04,771::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:04,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:04,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:04,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:04,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:04,772::__init__::225::IOProcess::(_processLogs) (540583) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:04,772::__init__::225::IOProcess::(_processLogs) (540583) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:04,772::__init__::225::IOProcess::(_processLogs) (540583) Queuing response >Thread-28::DEBUG::2014-08-11 17:15:04,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:15:04,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:04,831::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:15:04,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000885349 s, 559 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:04,833::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:04,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:04,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:04,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:04,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:04,834::__init__::225::IOProcess::(_processLogs) (540584) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:04,834::__init__::225::IOProcess::(_processLogs) (540584) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:04,835::__init__::225::IOProcess::(_processLogs) (540584) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:04,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:04,835::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:15:04,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) (540585) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) (540585) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) (540585) Building response >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) (540585) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:04,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:04,837::__init__::225::IOProcess::(_processLogs) (540586) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) (540586) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) (540586) Building response >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) (540586) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:04,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) (540587) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) (540587) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) (540587) Building response >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) (540587) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:04,839::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:15:05,667::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:15:05,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f4f2ee4-8fcd-4899-97ef-61ac4edce425`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:05,669::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:15:05,682::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:05,682::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f4f2ee4-8fcd-4899-97ef-61ac4edce425`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:05,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f4f2ee4-8fcd-4899-97ef-61ac4edce425`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:05,682::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:05,683::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:05,683::task::993::Storage.TaskManager.Task::(_decref) Task=`9f4f2ee4-8fcd-4899-97ef-61ac4edce425`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:15:05,689::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:15:05,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed57d90d-f8c5-4e82-811a-ac1712a21448`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:15:05,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:15:05,690::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bdd5cb01-d810-4057-a7b8-3ff80bbd20cf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:15:05,690::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:15:05,690::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:15:05,690::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bdd5cb01-d810-4057-a7b8-3ff80bbd20cf`::Granted request >Thread-10197::DEBUG::2014-08-11 17:15:05,690::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ed57d90d-f8c5-4e82-811a-ac1712a21448`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:15:05,690::task::993::Storage.TaskManager.Task::(_decref) Task=`ed57d90d-f8c5-4e82-811a-ac1712a21448`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:15:05,707::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:05,707::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed57d90d-f8c5-4e82-811a-ac1712a21448`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:05,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed57d90d-f8c5-4e82-811a-ac1712a21448`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:15:05,707::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:15:05,707::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:15:05,707::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:15:05,707::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:15:05,708::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:15:05,708::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:15:05,708::task::993::Storage.TaskManager.Task::(_decref) Task=`ed57d90d-f8c5-4e82-811a-ac1712a21448`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:15:06,601::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:15:06,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:06,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577667 s, 17.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:07,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:07,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:07,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:07,731::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:07,732::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:07,732::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:08,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:08,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291429 s, 35.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:15:10,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:10,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281923 s, 36.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:15:11,991::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:15:12,062::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:12,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) (540588) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) (540588) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) (540588) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:12,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:15:12,064::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:15:12,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00301334 s, 121 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) (540589) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:12,141::__init__::225::IOProcess::(_processLogs) (540589) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:12,143::__init__::225::IOProcess::(_processLogs) (540589) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:12,144::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:12,610::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:12,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:12,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:12,738::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:12,738::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:12,739::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:12,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:13,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0320126 s, 32.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:15:13,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`8806cda4-0f67-44d7-8431-b32f3fc42d8c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:13,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:15:13,768::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00301334', 'lastCheck': '1.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000885349', 'lastCheck': '8.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:13,768::task::1191::Storage.TaskManager.Task::(prepare) Task=`8806cda4-0f67-44d7-8431-b32f3fc42d8c`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00301334', 'lastCheck': '1.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000885349', 'lastCheck': '8.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:13,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`8806cda4-0f67-44d7-8431-b32f3fc42d8c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:13,768::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:13,768::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:13,768::task::993::Storage.TaskManager.Task::(_decref) Task=`8806cda4-0f67-44d7-8431-b32f3fc42d8c`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:15:13,787::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:15:13,787::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:15:14,839::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:14,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:14,839::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:14,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:14,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:14,840::__init__::225::IOProcess::(_processLogs) (540590) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:14,840::__init__::225::IOProcess::(_processLogs) (540590) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:14,840::__init__::225::IOProcess::(_processLogs) (540590) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:14,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:15:14,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:15:14,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00193204 s, 256 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:14,901::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:14,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:14,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:14,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:14,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:14,902::__init__::225::IOProcess::(_processLogs) (540591) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:14,902::__init__::225::IOProcess::(_processLogs) (540591) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:14,902::__init__::225::IOProcess::(_processLogs) (540591) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:14,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) (540592) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:14,903::__init__::225::IOProcess::(_processLogs) (540592) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) (540592) Building response >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) (540592) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:14,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) (540593) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) (540593) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) (540593) Building response >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) (540593) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:14,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:14,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:14,906::__init__::225::IOProcess::(_processLogs) (540594) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:14,906::__init__::225::IOProcess::(_processLogs) (540594) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:14,906::__init__::225::IOProcess::(_processLogs) (540594) Building response >Thread-19::DEBUG::2014-08-11 17:15:14,906::__init__::225::IOProcess::(_processLogs) (540594) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:14,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:14,907::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:15:15,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:15,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138974 s, 73.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:15:15,819::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:15:15,820::task::595::Storage.TaskManager.Task::(_updateState) Task=`022ce57e-9398-4e3d-b7ab-48f3366caedb`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:15,820::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:15:15,871::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:15,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`022ce57e-9398-4e3d-b7ab-48f3366caedb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:15,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`022ce57e-9398-4e3d-b7ab-48f3366caedb`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:15,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:15,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:15,872::task::993::Storage.TaskManager.Task::(_decref) Task=`022ce57e-9398-4e3d-b7ab-48f3366caedb`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:15:15,878::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:15:15,879::task::595::Storage.TaskManager.Task::(_updateState) Task=`2414b016-6744-473c-b9c0-c6ddc69c4ca0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:15:15,879::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:15:15,879::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`214b187c-bf8b-4865-916c-875db8a2e35c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:15:15,879::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:15:15,879::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:15:15,879::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`214b187c-bf8b-4865-916c-875db8a2e35c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:15:15,880::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2414b016-6744-473c-b9c0-c6ddc69c4ca0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:15:15,880::task::993::Storage.TaskManager.Task::(_decref) Task=`2414b016-6744-473c-b9c0-c6ddc69c4ca0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:15:15,896::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:15,896::task::1191::Storage.TaskManager.Task::(prepare) Task=`2414b016-6744-473c-b9c0-c6ddc69c4ca0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:15,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`2414b016-6744-473c-b9c0-c6ddc69c4ca0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:15:15,896::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:15:15,896::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:15:15,896::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:15:15,896::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:15:15,897::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:15:15,897::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:15:15,897::task::993::Storage.TaskManager.Task::(_decref) Task=`2414b016-6744-473c-b9c0-c6ddc69c4ca0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:15:16,900::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:15:17,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:17,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455698 s, 22.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:17,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:17,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:17,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:17,744::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:17,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:17,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:19,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:19,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0151339 s, 67.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:15:21,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:21,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129895 s, 78.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:15:21,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7d13314-7a91-48a6-85e6-79f17346e8d1`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:15:21,603::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) (540595) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:15:21,604::__init__::225::IOProcess::(_processLogs) (540595) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:15:21,609::__init__::225::IOProcess::(_processLogs) DEBUG|(540595) Building response >Thread-19::DEBUG::2014-08-11 17:15:21,609::__init__::225::IOProcess::(_processLogs) (540595) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:21,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:21,609::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:15:21,610::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:21,610::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:15:21,610::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-10017::INFO::2014-08-11 17:15:21,610::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:15:21,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10017::DEBUG::2014-08-11 17:15:21,611::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7d13314-7a91-48a6-85e6-79f17346e8d1`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:15:21,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:15:21,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7d13314-7a91-48a6-85e6-79f17346e8d1`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:15:21,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:15:21,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:15:21,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:15:21,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:15:21,613::__init__::225::IOProcess::(_processLogs) (540596) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:15:21,613::task::993::Storage.TaskManager.Task::(_decref) Task=`c7d13314-7a91-48a6-85e6-79f17346e8d1`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:15:21,613::__init__::225::IOProcess::(_processLogs) (540596) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:15:21,613::__init__::225::IOProcess::(_processLogs) (540596) Building response >Thread-19::DEBUG::2014-08-11 17:15:21,614::__init__::225::IOProcess::(_processLogs) (540596) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:21,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:21,614::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:15:21,636::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) (540597) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) (540597) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:22,145::__init__::225::IOProcess::(_processLogs) DEBUG|(540597) Building response >Thread-19::DEBUG::2014-08-11 17:15:22,146::__init__::225::IOProcess::(_processLogs) (540597) Queuing response >Thread-27::DEBUG::2014-08-11 17:15:22,146::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:15:22,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:22,205::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:15:22,206::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000367946 s, 995 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:22,206::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:22,206::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:22,206::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:22,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:22,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:22,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:22,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:22,207::__init__::225::IOProcess::(_processLogs) (540598) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:22,207::__init__::225::IOProcess::(_processLogs) (540598) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:22,207::__init__::225::IOProcess::(_processLogs) DEBUG|(540598) Building response >Thread-19::DEBUG::2014-08-11 17:15:22,207::__init__::225::IOProcess::(_processLogs) (540598) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:22,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:22,208::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:22,619::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:22,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:22,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:22,750::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:22,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:22,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:23,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:23,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133298 s, 76.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) (540599) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:24,907::__init__::225::IOProcess::(_processLogs) (540599) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:24,908::__init__::225::IOProcess::(_processLogs) DEBUG|(540599) Building response >Thread-19::DEBUG::2014-08-11 17:15:24,908::__init__::225::IOProcess::(_processLogs) (540599) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:24,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:24,908::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:15:24,909::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:15:24,967::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000436048 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:24,968::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:24,968::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:24,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:24,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:24,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:24,969::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:24,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:24,969::__init__::225::IOProcess::(_processLogs) (540600) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:24,969::__init__::225::IOProcess::(_processLogs) (540600) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:24,969::__init__::225::IOProcess::(_processLogs) (540600) Building response >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) (540600) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:24,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) (540601) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) (540601) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) (540601) Building response >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) (540601) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:24,971::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) (540602) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) (540602) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) (540602) Building response >Thread-19::DEBUG::2014-08-11 17:15:24,972::__init__::225::IOProcess::(_processLogs) (540602) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:24,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:24,973::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:24,973::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:24,973::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:15:24,973::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:24,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) (540603) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) (540603) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) (540603) Building response >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) (540603) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:24,974::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:15:25,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:25,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222707 s, 46.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:15:25,923::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:15:25,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5df9569-2b1a-4fc2-b97d-844a68954bf4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:25,924::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:15:25,937::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:25,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5df9569-2b1a-4fc2-b97d-844a68954bf4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:25,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5df9569-2b1a-4fc2-b97d-844a68954bf4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:25,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:25,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:25,938::task::993::Storage.TaskManager.Task::(_decref) Task=`b5df9569-2b1a-4fc2-b97d-844a68954bf4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:15:25,949::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:15:25,949::task::595::Storage.TaskManager.Task::(_updateState) Task=`543a30af-eb1f-4da1-8931-c115dd73857a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:15:25,949::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:15:25,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`37ca3b02-5999-4ab4-bee4-da84a237d517`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:15:25,950::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:15:25,950::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:15:25,950::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`37ca3b02-5999-4ab4-bee4-da84a237d517`::Granted request >Thread-10197::DEBUG::2014-08-11 17:15:25,950::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`543a30af-eb1f-4da1-8931-c115dd73857a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:15:25,950::task::993::Storage.TaskManager.Task::(_decref) Task=`543a30af-eb1f-4da1-8931-c115dd73857a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:15:25,966::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:25,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`543a30af-eb1f-4da1-8931-c115dd73857a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:25,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`543a30af-eb1f-4da1-8931-c115dd73857a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:15:25,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:15:25,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:15:25,967::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:15:25,967::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:15:25,967::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:15:25,967::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:15:25,967::task::993::Storage.TaskManager.Task::(_decref) Task=`543a30af-eb1f-4da1-8931-c115dd73857a`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:15:26,998::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:27,623::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:27,623::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:27,624::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:27,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:27,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247135 s, 41.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:15:27,757::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:27,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:27,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:15:28,971::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:15:28,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f743678-d513-47a9-ae82-ad39a32092ff`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:28,978::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:15:28,979::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367946', 'lastCheck': '6.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436048', 'lastCheck': '4.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:28,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f743678-d513-47a9-ae82-ad39a32092ff`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000367946', 'lastCheck': '6.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000436048', 'lastCheck': '4.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:28,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f743678-d513-47a9-ae82-ad39a32092ff`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:28,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:28,979::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:28,979::task::993::Storage.TaskManager.Task::(_decref) Task=`0f743678-d513-47a9-ae82-ad39a32092ff`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:15:28,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:15:28,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:29,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:29,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024242 s, 42.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:15:31,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:31,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193968 s, 52.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:32,209::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:32,209::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:32,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:32,210::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:32,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-27::DEBUG::2014-08-11 17:15:32,212::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:15:32,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:32,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:32,272::__init__::225::IOProcess::(_processLogs) (540604) Finding callback 'statvfs'... >Thread-27::DEBUG::2014-08-11 17:15:32,273::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000946647 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:32,273::__init__::225::IOProcess::(_processLogs) (540604) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:32,274::__init__::225::IOProcess::(_processLogs) (540604) Building response >Thread-19::DEBUG::2014-08-11 17:15:32,275::__init__::225::IOProcess::(_processLogs) (540604) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:32,275::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:32,276::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:15:32,276::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:32,277::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:32,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:32,278::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:32,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:32,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:32,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:32,281::__init__::225::IOProcess::(_processLogs) (540605) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:32,281::__init__::225::IOProcess::(_processLogs) (540605) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:32,282::__init__::225::IOProcess::(_processLogs) (540605) Building response >Thread-19::DEBUG::2014-08-11 17:15:32,282::__init__::225::IOProcess::(_processLogs) (540605) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:32,282::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:32,283::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:32,627::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:32,628::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:32,628::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:32,763::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:32,764::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:32,764::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:33,956::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:34,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235236 s, 43.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:34,974::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:34,974::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:34,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:34,974::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:34,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) (540606) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) (540606) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540606) Building response >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) (540606) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:34,975::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:15:34,976::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:15:34,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:15:35,036::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000882484 s, 561 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:35,037::__init__::225::IOProcess::(_processLogs) (540607) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:35,038::__init__::225::IOProcess::(_processLogs) (540607) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:35,038::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540607) Building response >Thread-19::DEBUG::2014-08-11 17:15:35,038::__init__::225::IOProcess::(_processLogs) (540607) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:35,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:35,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) (540608) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) (540608) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) (540608) Building response >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) (540608) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:15:35,040::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) (540609) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) (540609) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) (540609) Building response >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) (540609) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:35,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) (540610) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:35,042::__init__::225::IOProcess::(_processLogs) (540610) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:35,043::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540610) Building response >Thread-19::DEBUG::2014-08-11 17:15:35,043::__init__::225::IOProcess::(_processLogs) (540610) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:35,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:35,043::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:15:36,028::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:15:36,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0bcfd03-293a-4337-b2b3-3720f075d952`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:36,028::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:15:36,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::INFO::2014-08-11 17:15:36,118::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:36,119::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0bcfd03-293a-4337-b2b3-3720f075d952`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:36,119::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0bcfd03-293a-4337-b2b3-3720f075d952`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:36,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:36,119::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:36,119::task::993::Storage.TaskManager.Task::(_decref) Task=`b0bcfd03-293a-4337-b2b3-3720f075d952`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:15:36,129::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:15:36,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a472fca-e9ab-4138-9909-34f9d7eb78a4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:15:36,129::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:15:36,130::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`48beb430-e862-4b2f-8df2-da84c620454d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:15:36,130::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:15:36,130::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:15:36,130::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`48beb430-e862-4b2f-8df2-da84c620454d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:15:36,130::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0a472fca-e9ab-4138-9909-34f9d7eb78a4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:15:36,130::task::993::Storage.TaskManager.Task::(_decref) Task=`0a472fca-e9ab-4138-9909-34f9d7eb78a4`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:15:36,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0167361 s, 61.2 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:15:36,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:36,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a472fca-e9ab-4138-9909-34f9d7eb78a4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:36,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a472fca-e9ab-4138-9909-34f9d7eb78a4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:15:36,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:15:36,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:15:36,164::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:15:36,164::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:15:36,164::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:15:36,164::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:15:36,164::task::993::Storage.TaskManager.Task::(_decref) Task=`0a472fca-e9ab-4138-9909-34f9d7eb78a4`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:15:36,708::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:37,630::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:37,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:37,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:37,768::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:37,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:37,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:38,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:38,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0748242 s, 13.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:15:40,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:40,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0661228 s, 15.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:15:42,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`0324875c-4eef-46d3-84a6-92ad1b49a8b5`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:15:42,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:15:42,015::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:42,015::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:15:42,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:42,015::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:42,015::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:42,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:42,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:42,016::__init__::225::IOProcess::(_processLogs) (540611) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:15:42,016::__init__::225::IOProcess::(_processLogs) (540611) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:15:42,017::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540611) Building response >Thread-19::DEBUG::2014-08-11 17:15:42,017::__init__::225::IOProcess::(_processLogs) (540611) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:42,017::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:15:42,017::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:15:42,018::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:42,018::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:15:42,018::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Marshaling message... >Thread-10102::INFO::2014-08-11 17:15:42,018::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:15:42,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:15:42,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`0324875c-4eef-46d3-84a6-92ad1b49a8b5`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:15:42,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:15:42,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`0324875c-4eef-46d3-84a6-92ad1b49a8b5`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:15:42,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:15:42,021::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:15:42,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:15:42,021::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:15:42,022::__init__::225::IOProcess::(_processLogs) (540612) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:15:42,022::task::993::Storage.TaskManager.Task::(_decref) Task=`0324875c-4eef-46d3-84a6-92ad1b49a8b5`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:15:42,023::__init__::225::IOProcess::(_processLogs) (540612) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:15:42,023::__init__::225::IOProcess::(_processLogs) (540612) Building response >Thread-19::DEBUG::2014-08-11 17:15:42,023::__init__::225::IOProcess::(_processLogs) (540612) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:42,023::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:42,024::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:15:42,045::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:15:42,279::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) (540613) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) (540613) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540613) Building response >Thread-19::DEBUG::2014-08-11 17:15:42,280::__init__::225::IOProcess::(_processLogs) (540613) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:42,281::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:15:42,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:15:42,281::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:15:42,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00147407 s, 248 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:42,343::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:42,343::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:42,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) (540614) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) (540614) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:42,344::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540614) Building response >Thread-19::DEBUG::2014-08-11 17:15:42,345::__init__::225::IOProcess::(_processLogs) (540614) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:42,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:42,345::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:15:42,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:42,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0884909 s, 11.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:42,637::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:42,637::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:42,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:42,770::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:42,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:42,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:15:44,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`17f643bd-a3b1-41fb-bc99-cf58a35c7e1b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:44,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:15:44,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00147407', 'lastCheck': '1.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000882484', 'lastCheck': '9.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:44,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`17f643bd-a3b1-41fb-bc99-cf58a35c7e1b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00147407', 'lastCheck': '1.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000882484', 'lastCheck': '9.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:44,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`17f643bd-a3b1-41fb-bc99-cf58a35c7e1b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:44,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:44,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:44,148::task::993::Storage.TaskManager.Task::(_decref) Task=`17f643bd-a3b1-41fb-bc99-cf58a35c7e1b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:15:44,160::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:15:44,160::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:44,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:44,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0660272 s, 15.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:45,044::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:45,044::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:45,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:45,044::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:45,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:45,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:45,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:45,045::__init__::225::IOProcess::(_processLogs) (540615) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:45,045::__init__::225::IOProcess::(_processLogs) (540615) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:45,045::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540615) Building response >Thread-19::DEBUG::2014-08-11 17:15:45,046::__init__::225::IOProcess::(_processLogs) (540615) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:45,046::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:45,046::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:15:45,046::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:15:45,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000376365 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:45,110::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:45,111::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:45,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:45,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:45,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:45,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:45,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:45,114::__init__::225::IOProcess::(_processLogs) (540616) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:45,114::__init__::225::IOProcess::(_processLogs) (540616) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:45,114::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540616) Building response >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) (540616) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:45,115::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) (540617) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) (540617) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) (540617) Building response >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) (540617) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:45,116::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:45,117::__init__::225::IOProcess::(_processLogs) (540618) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) (540618) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) (540618) Building response >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) (540618) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:15:45,118::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) (540619) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) (540619) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) (540619) Building response >Thread-19::DEBUG::2014-08-11 17:15:45,119::__init__::225::IOProcess::(_processLogs) (540619) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:45,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:45,120::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:15:46,224::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:15:46,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`35719bed-4bb3-47f8-b55f-0a49ef2ed629`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:46,225::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:15:46,263::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:46,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`35719bed-4bb3-47f8-b55f-0a49ef2ed629`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:46,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`35719bed-4bb3-47f8-b55f-0a49ef2ed629`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:46,264::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:46,264::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:46,264::task::993::Storage.TaskManager.Task::(_decref) Task=`35719bed-4bb3-47f8-b55f-0a49ef2ed629`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:15:46,276::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:15:46,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`673851a9-1753-4c80-9f44-7b2d709f2372`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:15:46,276::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:15:46,276::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3ffd9c74-d26e-4f8d-9469-f0cb72ed61ec`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:15:46,276::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:15:46,277::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:15:46,277::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3ffd9c74-d26e-4f8d-9469-f0cb72ed61ec`::Granted request >Thread-10197::DEBUG::2014-08-11 17:15:46,277::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`673851a9-1753-4c80-9f44-7b2d709f2372`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:15:46,277::task::993::Storage.TaskManager.Task::(_decref) Task=`673851a9-1753-4c80-9f44-7b2d709f2372`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:15:46,293::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:46,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`673851a9-1753-4c80-9f44-7b2d709f2372`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:46,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`673851a9-1753-4c80-9f44-7b2d709f2372`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:15:46,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:15:46,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:15:46,294::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:15:46,294::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:15:46,294::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:15:46,294::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:15:46,294::task::993::Storage.TaskManager.Task::(_decref) Task=`673851a9-1753-4c80-9f44-7b2d709f2372`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:15:46,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:46,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126832 s, 80.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:15:47,048::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:47,643::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:47,644::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:47,644::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:47,777::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:47,777::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:47,777::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:48,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:48,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0838183 s, 12.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:15:50,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:51,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0692097 s, 14.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:15:51,715::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-27::DEBUG::2014-08-11 17:15:52,345::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:52,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:52,349::__init__::225::IOProcess::(_processLogs) (540620) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:15:52,349::__init__::225::IOProcess::(_processLogs) (540620) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:15:52,349::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540620) Building response >Thread-19::DEBUG::2014-08-11 17:15:52,349::__init__::225::IOProcess::(_processLogs) (540620) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:52,349::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) (540621) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:15:52,350::__init__::225::IOProcess::(_processLogs) (540621) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:15:52,351::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540621) Building response >Thread-19::DEBUG::2014-08-11 17:15:52,351::__init__::225::IOProcess::(_processLogs) (540621) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:52,353::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:15:52,356::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) (540622) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:15:52,357::__init__::225::IOProcess::(_processLogs) (540622) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:15:52,374::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|(540622) Building response >Thread-19::DEBUG::2014-08-11 17:15:52,375::__init__::225::IOProcess::(_processLogs) (540622) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,375::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:15:52,375::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) (540610) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:52,376::__init__::225::IOProcess::(_processLogs) (540623) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:15:52,377::__init__::225::IOProcess::(_processLogs) (540623) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:15:52,377::__init__::225::IOProcess::(_processLogs) (540623) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,377::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:15:52,377::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:15:52,378::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:15:52,378::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,378::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,378::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,378::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:52,378::__init__::225::IOProcess::(_processLogs) (540624) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) (540624) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) (540624) Building response >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) (540624) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:15:52,380::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:15:52,380::__init__::225::IOProcess::(_processLogs) (540625) Finding callback 'glob'... >Thread-27::INFO::2014-08-11 17:15:52,380::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:15:52,380::__init__::225::IOProcess::(_processLogs) (540625) Got request for method 'glob' >Thread-27::INFO::2014-08-11 17:15:52,381::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:15:52,381::__init__::225::IOProcess::(_processLogs) (540625) Building response >Thread-19::DEBUG::2014-08-11 17:15:52,381::__init__::225::IOProcess::(_processLogs) (540625) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:52,382::__init__::225::IOProcess::(_processLogs) (540626) Finding callback 'statvfs'... >Thread-27::DEBUG::2014-08-11 17:15:52,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:15:52,383::__init__::225::IOProcess::(_processLogs) (540626) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:52,441::__init__::225::IOProcess::(_processLogs) (540626) Building response >Thread-19::DEBUG::2014-08-11 17:15:52,441::__init__::225::IOProcess::(_processLogs) (540626) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:52,442::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:15:52,446::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00295911 s, 124 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:52,446::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:52,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:52,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:52,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:52,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:52,447::__init__::225::IOProcess::(_processLogs) (540627) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:52,447::__init__::225::IOProcess::(_processLogs) (540627) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:52,448::__init__::225::IOProcess::(_processLogs) (540627) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:52,448::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:52,650::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:52,650::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:52,650::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:52,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:52,783::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:52,783::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:53,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:53,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0711357 s, 14.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:55,119::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:55,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) (540628) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) (540628) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) (540628) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:55,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:15:55,121::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:15:55,180::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000413606 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:15:55,181::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:15:55,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:55,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:55,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:55,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:55,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:55,184::__init__::225::IOProcess::(_processLogs) (540629) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:15:55,184::__init__::225::IOProcess::(_processLogs) (540629) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:15:55,186::__init__::225::IOProcess::(_processLogs) (540629) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:55,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:55,187::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:15:55,187::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:15:55,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:55,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:55,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:55,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:55,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:55,189::__init__::225::IOProcess::(_processLogs) (540630) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:55,190::__init__::225::IOProcess::(_processLogs) (540630) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:55,190::__init__::225::IOProcess::(_processLogs) (540630) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:55,190::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:55,190::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:55,190::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:15:55,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) (540631) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) (540631) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) (540631) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:55,191::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:15:55,192::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:15:55,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:15:55,192::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:15:55,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:15:55,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:15:55,193::__init__::225::IOProcess::(_processLogs) (540632) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:15:55,193::__init__::225::IOProcess::(_processLogs) (540632) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:15:55,193::__init__::225::IOProcess::(_processLogs) (540632) Building response >Thread-19::DEBUG::2014-08-11 17:15:55,193::__init__::225::IOProcess::(_processLogs) (540632) Queuing response >Thread-19::DEBUG::2014-08-11 17:15:55,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:15:55,193::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:15:55,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:55,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.073254 s, 14.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:15:56,339::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:15:56,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e0efb65-1fad-47be-83d2-afc3ee91037b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:56,339::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Detector thread::DEBUG::2014-08-11 17:15:56,357::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.1.234:32955 >Detector thread::DEBUG::2014-08-11 17:15:56,358::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.1.234:32955 >Detector thread::DEBUG::2014-08-11 17:15:56,358::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.1.234:32955 >Detector thread::DEBUG::2014-08-11 17:15:56,358::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.1.234', 32955) >Thread-10205::INFO::2014-08-11 17:15:56,394::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:56,394::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e0efb65-1fad-47be-83d2-afc3ee91037b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:15:56,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e0efb65-1fad-47be-83d2-afc3ee91037b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:56,394::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:56,394::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:56,394::task::993::Storage.TaskManager.Task::(_decref) Task=`3e0efb65-1fad-47be-83d2-afc3ee91037b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:15:56,403::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:15:56,404::task::595::Storage.TaskManager.Task::(_updateState) Task=`36c6153e-0ce5-4476-9d67-c38bc2e5ff7c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:15:56,404::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:15:56,404::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f8ec3431-1d8a-4e18-b9b5-a30a6e168ee3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:15:56,404::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:15:56,404::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:15:56,404::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f8ec3431-1d8a-4e18-b9b5-a30a6e168ee3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:15:56,404::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`36c6153e-0ce5-4476-9d67-c38bc2e5ff7c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:15:56,405::task::993::Storage.TaskManager.Task::(_decref) Task=`36c6153e-0ce5-4476-9d67-c38bc2e5ff7c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:15:56,447::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:56,448::task::1191::Storage.TaskManager.Task::(prepare) Task=`36c6153e-0ce5-4476-9d67-c38bc2e5ff7c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:15:56,448::task::595::Storage.TaskManager.Task::(_updateState) Task=`36c6153e-0ce5-4476-9d67-c38bc2e5ff7c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:15:56,448::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:15:56,448::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:15:56,448::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:15:56,448::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:15:56,448::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:15:56,448::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:15:56,448::task::993::Storage.TaskManager.Task::(_decref) Task=`36c6153e-0ce5-4476-9d67-c38bc2e5ff7c`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:15:57,052::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:15:57,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:57,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150821 s, 67.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:57,651::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:57,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:15:57,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:57,787::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:57,787::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:15:57,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:15:59,061::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:15:59,369::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7f99e14-952c-4d4b-a654-a2baafd0462d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:15:59,369::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:15:59,369::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00295911', 'lastCheck': '6.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413606', 'lastCheck': '4.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:59,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7f99e14-952c-4d4b-a654-a2baafd0462d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00295911', 'lastCheck': '6.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000413606', 'lastCheck': '4.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:15:59,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7f99e14-952c-4d4b-a654-a2baafd0462d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:15:59,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:15:59,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:15:59,370::task::993::Storage.TaskManager.Task::(_decref) Task=`a7f99e14-952c-4d4b-a654-a2baafd0462d`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:15:59,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:15:59,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:15:59,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:15:59,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130321 s, 78.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:01,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:01,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122967 s, 83.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:02,450::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:02,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:02,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:02,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:02,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:02,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:02,454::__init__::225::IOProcess::(_processLogs) (540633) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:02,454::__init__::225::IOProcess::(_processLogs) (540633) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:02,472::__init__::225::IOProcess::(_processLogs) (540633) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:02,473::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:16:02,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:16:02,535::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000388372 s, 942 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:02,537::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:02,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:02,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:02,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:02,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:02,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:02,541::__init__::225::IOProcess::(_processLogs) (540634) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:02,541::__init__::225::IOProcess::(_processLogs) (540634) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:02,542::__init__::225::IOProcess::(_processLogs) (540634) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:02,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:02,544::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:02,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:02,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:02,658::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:02,793::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:02,794::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:02,794::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:03,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:03,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378335 s, 27.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:05,193::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:05,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:05,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:05,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:05,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:05,193::__init__::225::IOProcess::(_processLogs) (540635) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:05,194::__init__::225::IOProcess::(_processLogs) (540635) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:05,194::__init__::225::IOProcess::(_processLogs) (540635) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:05,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:16:05,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:16:05,195::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:16:05,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00111438 s, 444 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:05,257::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:05,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:05,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:05,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:05,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:05,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:05,260::__init__::225::IOProcess::(_processLogs) (540636) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:05,260::__init__::225::IOProcess::(_processLogs) (540636) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:05,260::__init__::225::IOProcess::(_processLogs) (540636) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:05,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) (540637) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) (540637) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) (540637) Building response >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) (540637) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:16:05,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) (540638) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) (540638) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) (540638) Building response >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) (540638) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:05,263::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) (540639) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:05,264::__init__::225::IOProcess::(_processLogs) (540639) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:05,265::__init__::225::IOProcess::(_processLogs) (540639) Building response >Thread-19::DEBUG::2014-08-11 17:16:05,265::__init__::225::IOProcess::(_processLogs) (540639) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:05,265::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:05,265::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:16:05,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:05,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119885 s, 85.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:16:06,520::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:16:06,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`77e1718d-ba70-4c61-9efa-891a2fbed9f1`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:06,521::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:16:06,582::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:06,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`77e1718d-ba70-4c61-9efa-891a2fbed9f1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:06,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`77e1718d-ba70-4c61-9efa-891a2fbed9f1`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:06,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:06,583::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:06,583::task::993::Storage.TaskManager.Task::(_decref) Task=`77e1718d-ba70-4c61-9efa-891a2fbed9f1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:16:06,594::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:16:06,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8da4a7a-ae2a-4369-bd00-0ecb46feb494`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:16:06,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:16:06,595::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`07941347-942a-4c55-ad59-c63cb678d6c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:16:06,595::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:16:06,595::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:16:06,595::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`07941347-942a-4c55-ad59-c63cb678d6c6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:16:06,595::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d8da4a7a-ae2a-4369-bd00-0ecb46feb494`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:16:06,595::task::993::Storage.TaskManager.Task::(_decref) Task=`d8da4a7a-ae2a-4369-bd00-0ecb46feb494`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:16:06,613::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:06,613::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8da4a7a-ae2a-4369-bd00-0ecb46feb494`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:06,613::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8da4a7a-ae2a-4369-bd00-0ecb46feb494`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:16:06,613::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:16:06,613::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:16:06,613::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:16:06,613::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:16:06,613::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:16:06,613::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:16:06,613::task::993::Storage.TaskManager.Task::(_decref) Task=`d8da4a7a-ae2a-4369-bd00-0ecb46feb494`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:16:06,760::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:07,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:07,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:07,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:07,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:16:07,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:07,833::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:07,833::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:07,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558172 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:09,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:09,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143805 s, 71.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:11,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:16:12,061::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:16:12,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053092 s, 19.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) (540640) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:12,544::__init__::225::IOProcess::(_processLogs) (540640) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:12,546::__init__::225::IOProcess::(_processLogs) (540640) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:12,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:16:12,547::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:16:12,547::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:16:12,633::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00254393 s, 144 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:12,635::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:16:12,635::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:12,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:12,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:12,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:12,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:12,636::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:12,636::__init__::225::IOProcess::(_processLogs) (540641) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:12,636::__init__::225::IOProcess::(_processLogs) (540641) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:12,639::__init__::225::IOProcess::(_processLogs) DEBUG|(540641) Building response >Thread-19::DEBUG::2014-08-11 17:16:12,639::__init__::225::IOProcess::(_processLogs) (540641) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:12,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:12,640::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:12,670::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:12,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:12,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:12,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:12,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:12,837::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:14,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:14,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429909 s, 23.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:16:14,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a4a52ba-eda9-4453-9274-e31c4500af8b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:14,654::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:16:14,655::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00254393', 'lastCheck': '2.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111438', 'lastCheck': '9.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:16:14,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a4a52ba-eda9-4453-9274-e31c4500af8b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00254393', 'lastCheck': '2.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111438', 'lastCheck': '9.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:16:14,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a4a52ba-eda9-4453-9274-e31c4500af8b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:14,655::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:14,655::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:14,655::task::993::Storage.TaskManager.Task::(_decref) Task=`6a4a52ba-eda9-4453-9274-e31c4500af8b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:16:14,667::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:16:14,667::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:15,265::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:15,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:15,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:15,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:15,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:15,266::__init__::225::IOProcess::(_processLogs) (540642) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:15,266::__init__::225::IOProcess::(_processLogs) (540642) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:15,268::__init__::225::IOProcess::(_processLogs) (540642) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:15,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:16:15,268::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:16:15,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000350884 s, 1.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:15,328::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:15,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:15,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:15,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:15,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:15,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:15,332::__init__::225::IOProcess::(_processLogs) (540643) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:15,332::__init__::225::IOProcess::(_processLogs) (540643) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:15,333::__init__::225::IOProcess::(_processLogs) (540643) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:15,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:15,334::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:15,335::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:16:15,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:15,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:15,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) (540644) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) (540644) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) (540644) Building response >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) (540644) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:15,337::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:15,338::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:16:15,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:15,338::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:15,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:15,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:15,338::__init__::225::IOProcess::(_processLogs) (540645) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) (540645) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) (540645) Building response >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) (540645) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:15,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:15,340::__init__::225::IOProcess::(_processLogs) (540646) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:15,340::__init__::225::IOProcess::(_processLogs) (540646) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:15,340::__init__::225::IOProcess::(_processLogs) (540646) Building response >Thread-19::DEBUG::2014-08-11 17:16:15,340::__init__::225::IOProcess::(_processLogs) (540646) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:15,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:15,340::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:16:16,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:16,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462569 s, 22.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:16:16,681::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:16:16,682::task::595::Storage.TaskManager.Task::(_updateState) Task=`c28cf830-1a93-4e8a-956d-c7e83f133a0b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:16,682::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:16:16,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:16,730::task::1191::Storage.TaskManager.Task::(prepare) Task=`c28cf830-1a93-4e8a-956d-c7e83f133a0b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:16,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`c28cf830-1a93-4e8a-956d-c7e83f133a0b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:16,730::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:16,730::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:16,730::task::993::Storage.TaskManager.Task::(_decref) Task=`c28cf830-1a93-4e8a-956d-c7e83f133a0b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:16:16,741::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:16:16,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c127300-f3d8-489e-8b36-f5425c68d391`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:16:16,741::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:16:16,741::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cf49d79d-d75a-48fd-ad7b-46c510a388d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:16:16,741::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:16:16,742::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:16:16,742::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cf49d79d-d75a-48fd-ad7b-46c510a388d7`::Granted request >Thread-10197::DEBUG::2014-08-11 17:16:16,743::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8c127300-f3d8-489e-8b36-f5425c68d391`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:16:16,743::task::993::Storage.TaskManager.Task::(_decref) Task=`8c127300-f3d8-489e-8b36-f5425c68d391`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:16:16,760::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:16,761::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c127300-f3d8-489e-8b36-f5425c68d391`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:16,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c127300-f3d8-489e-8b36-f5425c68d391`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:16:16,761::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:16:16,761::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:16:16,761::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:16:16,761::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:16:16,761::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:16:16,761::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:16:16,761::task::993::Storage.TaskManager.Task::(_decref) Task=`8c127300-f3d8-489e-8b36-f5425c68d391`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:16:17,080::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:17,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:17,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:17,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:17,843::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:17,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:17,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:18,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:18,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0658977 s, 15.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:20,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:20,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142085 s, 72.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:16:21,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`b34943c0-b7f3-405f-b107-252eb0d789b9`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:16:21,772::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) (540647) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:16:21,772::__init__::225::IOProcess::(_processLogs) (540647) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:16:21,779::__init__::225::IOProcess::(_processLogs) (540647) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:21,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:21,779::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:16:21,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:21,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:21,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:21,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::INFO::2014-08-11 17:16:21,780::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:16:21,780::__init__::225::IOProcess::(_processLogs) (540648) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:16:21,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`b34943c0-b7f3-405f-b107-252eb0d789b9`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:16:21,781::__init__::225::IOProcess::(_processLogs) (540648) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:16:21,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`b34943c0-b7f3-405f-b107-252eb0d789b9`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:16:21,781::__init__::225::IOProcess::(_processLogs) (540648) Building response >Thread-10017::DEBUG::2014-08-11 17:16:21,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:16:21,782::__init__::225::IOProcess::(_processLogs) (540648) Queuing response >Thread-10017::DEBUG::2014-08-11 17:16:21,782::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:16:21,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:16:21,783::task::993::Storage.TaskManager.Task::(_decref) Task=`b34943c0-b7f3-405f-b107-252eb0d789b9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:16:21,783::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:16:21,806::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:16:22,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:22,641::__init__::225::IOProcess::(_processLogs) (540649) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:22,642::__init__::225::IOProcess::(_processLogs) (540649) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:22,674::__init__::225::IOProcess::(_processLogs) (540649) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:22,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:16:22,676::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:16:22,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000309924 s, 1.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:22,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:22,739::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:22,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:22,741::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:22,742::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:22,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:22,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:22,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:22,745::__init__::225::IOProcess::(_processLogs) (540650) Finding callback 'statvfs'... >Dummy-51::DEBUG::2014-08-11 17:16:22,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.135013 s, 7.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:22,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:22,746::__init__::225::IOProcess::(_processLogs) (540650) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:22,747::__init__::225::IOProcess::(_processLogs) (540650) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:22,749::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:22,749::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:16:22,847::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:22,848::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:22,848::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:24,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:24,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016668 s, 61.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) (540651) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:25,341::__init__::225::IOProcess::(_processLogs) (540651) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:25,342::__init__::225::IOProcess::(_processLogs) (540651) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:25,342::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:16:25,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:16:25,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00128532 s, 385 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:25,403::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:25,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:25,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:25,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:25,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:25,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:25,406::__init__::225::IOProcess::(_processLogs) (540652) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:25,407::__init__::225::IOProcess::(_processLogs) (540652) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:25,407::__init__::225::IOProcess::(_processLogs) (540652) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:25,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:25,408::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:25,408::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:16:25,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:25,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) (540653) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) (540653) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) (540653) Building response >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) (540653) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:16:25,409::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) (540654) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) (540654) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) (540654) Building response >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) (540654) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:25,410::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:25,411::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:16:25,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:25,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:25,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:25,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:25,411::__init__::225::IOProcess::(_processLogs) (540655) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:25,412::__init__::225::IOProcess::(_processLogs) (540655) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:25,412::__init__::225::IOProcess::(_processLogs) (540655) Building response >Thread-19::DEBUG::2014-08-11 17:16:25,412::__init__::225::IOProcess::(_processLogs) (540655) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:25,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:25,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:16:26,818::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:16:26,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`514be6e5-7602-49d7-b3ca-aa1f8572044a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:26,818::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:16:26,831::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:26,831::task::1191::Storage.TaskManager.Task::(prepare) Task=`514be6e5-7602-49d7-b3ca-aa1f8572044a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:26,831::task::595::Storage.TaskManager.Task::(_updateState) Task=`514be6e5-7602-49d7-b3ca-aa1f8572044a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:26,831::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:26,831::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:26,831::task::993::Storage.TaskManager.Task::(_decref) Task=`514be6e5-7602-49d7-b3ca-aa1f8572044a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:16:26,838::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:16:26,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`98884a27-a67d-404e-a055-36d5f68a37bd`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:16:26,838::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:16:26,839::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6e295912-1515-4d36-8a68-eca8ea4612a1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:16:26,839::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:16:26,839::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:16:26,839::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6e295912-1515-4d36-8a68-eca8ea4612a1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:16:26,839::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`98884a27-a67d-404e-a055-36d5f68a37bd`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:16:26,839::task::993::Storage.TaskManager.Task::(_decref) Task=`98884a27-a67d-404e-a055-36d5f68a37bd`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:16:26,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10197::INFO::2014-08-11 17:16:26,903::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:26,903::task::1191::Storage.TaskManager.Task::(prepare) Task=`98884a27-a67d-404e-a055-36d5f68a37bd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:26,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`98884a27-a67d-404e-a055-36d5f68a37bd`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:16:26,904::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:16:26,904::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:16:26,904::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:16:26,904::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:16:26,904::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:16:26,904::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:16:26,904::task::993::Storage.TaskManager.Task::(_decref) Task=`98884a27-a67d-404e-a055-36d5f68a37bd`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:16:26,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483551 s, 21.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:16:27,069::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:27,754::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:27,755::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:27,755::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:27,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:27,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:27,854::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:28,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:29,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134268 s, 76.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:16:29,103::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:16:30,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5bd85ad-b568-423a-8143-0487f83c8a8c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:30,114::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:16:30,114::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309924', 'lastCheck': '7.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128532', 'lastCheck': '4.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:16:30,114::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5bd85ad-b568-423a-8143-0487f83c8a8c`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000309924', 'lastCheck': '7.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00128532', 'lastCheck': '4.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:16:30,114::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5bd85ad-b568-423a-8143-0487f83c8a8c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:30,115::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:30,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:30,115::task::993::Storage.TaskManager.Task::(_decref) Task=`d5bd85ad-b568-423a-8143-0487f83c8a8c`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:16:30,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:16:30,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:31,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:31,144::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490226 s, 20.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:32,749::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:32,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:32,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:32,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:32,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:32,750::__init__::225::IOProcess::(_processLogs) (540656) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:32,750::__init__::225::IOProcess::(_processLogs) (540656) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:32,750::__init__::225::IOProcess::(_processLogs) (540656) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:32,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:16:32,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:32,809::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:32,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:16:32,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000915223 s, 400 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:32,812::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:32,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:32,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:32,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:32,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:32,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:32,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:32,814::__init__::225::IOProcess::(_processLogs) (540657) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:32,814::__init__::225::IOProcess::(_processLogs) (540657) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:32,815::__init__::225::IOProcess::(_processLogs) (540657) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:32,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:32,815::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:16:32,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:32,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:32,860::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:33,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:33,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451302 s, 22.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:35,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:35,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467727 s, 21.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:35,412::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:35,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:35,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:35,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:35,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:35,413::__init__::225::IOProcess::(_processLogs) (540658) Finding callback 'statvfs'... >Thread-28::DEBUG::2014-08-11 17:16:35,413::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:16:35,413::__init__::225::IOProcess::(_processLogs) (540658) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:35,472::__init__::225::IOProcess::(_processLogs) (540658) Building response >Thread-19::DEBUG::2014-08-11 17:16:35,472::__init__::225::IOProcess::(_processLogs) (540658) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:35,473::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:16:35,474::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00120252 s, 412 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:35,475::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:35,476::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:35,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:35,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:35,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:35,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:35,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:35,479::__init__::225::IOProcess::(_processLogs) (540659) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:35,479::__init__::225::IOProcess::(_processLogs) (540659) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:35,480::__init__::225::IOProcess::(_processLogs) (540659) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:35,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:35,481::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:35,482::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:16:35,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:35,483::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:35,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:35,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) (540660) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) (540660) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) (540660) Building response >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) (540660) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:16:35,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) (540661) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) (540661) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) (540661) Building response >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) (540661) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:35,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) (540662) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:35,486::__init__::225::IOProcess::(_processLogs) (540662) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:35,488::__init__::225::IOProcess::(_processLogs) (540662) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:35,488::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:16:36,814::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:16:37,052::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:16:37,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c2ad59-43d6-4f00-b99f-36bbd19cdcc3`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:37,052::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:16:37,104::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:37,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`59c2ad59-43d6-4f00-b99f-36bbd19cdcc3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:37,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`59c2ad59-43d6-4f00-b99f-36bbd19cdcc3`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:37,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:37,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:37,104::task::993::Storage.TaskManager.Task::(_decref) Task=`59c2ad59-43d6-4f00-b99f-36bbd19cdcc3`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:16:37,111::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:16:37,111::task::595::Storage.TaskManager.Task::(_updateState) Task=`a23090dc-e4f1-4007-9b8d-a57afa997803`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:16:37,112::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:16:37,112::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`265aa34c-32e4-4a56-8232-1e953ebff901`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:16:37,112::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:16:37,112::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:16:37,112::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`265aa34c-32e4-4a56-8232-1e953ebff901`::Granted request >Thread-10197::DEBUG::2014-08-11 17:16:37,112::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a23090dc-e4f1-4007-9b8d-a57afa997803`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:16:37,113::task::993::Storage.TaskManager.Task::(_decref) Task=`a23090dc-e4f1-4007-9b8d-a57afa997803`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:16:37,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:37,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`a23090dc-e4f1-4007-9b8d-a57afa997803`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:37,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`a23090dc-e4f1-4007-9b8d-a57afa997803`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:16:37,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:16:37,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:16:37,134::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:16:37,134::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:16:37,134::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:16:37,134::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:16:37,134::task::993::Storage.TaskManager.Task::(_decref) Task=`a23090dc-e4f1-4007-9b8d-a57afa997803`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:16:37,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:37,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0779871 s, 13.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:37,817::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:37,818::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:37,818::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:37,862::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:37,863::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:37,863::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:39,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:39,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500861 s, 20.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:41,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:41,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332479 s, 30.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:16:42,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`8664e2f7-bf54-4298-a6fa-d35bd214abc9`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:16:42,071::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:16:42,071::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:16:42,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:42,071::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:42,071::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:42,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:42,072::__init__::225::IOProcess::(_processLogs) (540663) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:16:42,072::__init__::225::IOProcess::(_processLogs) (540663) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:16:42,076::__init__::225::IOProcess::(_processLogs) (540663) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:42,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:42,077::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:16:42,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:42,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:42,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:42,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::INFO::2014-08-11 17:16:42,078::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:16:42,078::__init__::225::IOProcess::(_processLogs) (540664) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:16:42,079::task::1191::Storage.TaskManager.Task::(prepare) Task=`8664e2f7-bf54-4298-a6fa-d35bd214abc9`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:16:42,079::__init__::225::IOProcess::(_processLogs) (540664) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:16:42,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`8664e2f7-bf54-4298-a6fa-d35bd214abc9`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:16:42,080::__init__::225::IOProcess::(_processLogs) (540664) Building response >Thread-10102::DEBUG::2014-08-11 17:16:42,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:16:42,080::__init__::225::IOProcess::(_processLogs) (540664) Queuing response >Thread-10102::DEBUG::2014-08-11 17:16:42,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:16:42,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10102::DEBUG::2014-08-11 17:16:42,082::task::993::Storage.TaskManager.Task::(_decref) Task=`8664e2f7-bf54-4298-a6fa-d35bd214abc9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:16:42,082::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:16:42,104::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:16:42,815::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) (540665) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) (540665) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:42,816::__init__::225::IOProcess::(_processLogs) (540665) Queuing response >Thread-27::DEBUG::2014-08-11 17:16:42,817::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:16:42,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:42,876::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:42,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:42,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:16:42,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00205699 s, 178 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:42,882::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:42,883::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:42,883::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:42,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:42,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:42,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:42,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:42,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm::DEBUG::2014-08-11 17:16:42,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:42,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:42,889::__init__::225::IOProcess::(_processLogs) (540666) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:42,890::__init__::225::IOProcess::(_processLogs) (540666) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:42,890::__init__::225::IOProcess::(_processLogs) (540666) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:42,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:42,891::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:16:43,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:43,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0485532 s, 21.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:16:45,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`4da3dd55-3165-45aa-8bc0-25c343db2247`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:45,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:16:45,313::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00205699', 'lastCheck': '2.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120252', 'lastCheck': '9.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:16:45,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`4da3dd55-3165-45aa-8bc0-25c343db2247`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00205699', 'lastCheck': '2.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120252', 'lastCheck': '9.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:16:45,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`4da3dd55-3165-45aa-8bc0-25c343db2247`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:45,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:45,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:45,314::task::993::Storage.TaskManager.Task::(_decref) Task=`4da3dd55-3165-45aa-8bc0-25c343db2247`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:16:45,334::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:16:45,335::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) (540667) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:45,489::__init__::225::IOProcess::(_processLogs) (540667) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:45,490::__init__::225::IOProcess::(_processLogs) (540667) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:45,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:16:45,491::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:16:45,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000392108 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:45,552::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:45,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:45,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:45,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:45,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:45,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:45,554::__init__::225::IOProcess::(_processLogs) (540668) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:45,554::__init__::225::IOProcess::(_processLogs) (540668) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:45,555::__init__::225::IOProcess::(_processLogs) (540668) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:45,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:45,557::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:45,558::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:16:45,558::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:45,558::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:45,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:45,558::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) (540669) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) (540669) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) (540669) Building response >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) (540669) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:16:45,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) (540670) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) (540670) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) (540670) Building response >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) (540670) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:45,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) (540671) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:45,561::__init__::225::IOProcess::(_processLogs) (540671) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:45,562::__init__::225::IOProcess::(_processLogs) (540671) Building response >Thread-19::DEBUG::2014-08-11 17:16:45,562::__init__::225::IOProcess::(_processLogs) (540671) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:45,562::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:45,562::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:16:45,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:45,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292116 s, 35.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:16:47,122::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:16:47,165::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:16:47,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`57483fb5-255c-4827-8242-e0d6c87ea850`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:47,165::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:16:47,201::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:47,201::task::1191::Storage.TaskManager.Task::(prepare) Task=`57483fb5-255c-4827-8242-e0d6c87ea850`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:47,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`57483fb5-255c-4827-8242-e0d6c87ea850`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:47,201::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:47,201::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:47,201::task::993::Storage.TaskManager.Task::(_decref) Task=`57483fb5-255c-4827-8242-e0d6c87ea850`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:16:47,208::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:16:47,208::task::595::Storage.TaskManager.Task::(_updateState) Task=`cce79ad2-3b5a-4229-b573-f72495d40b6a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:16:47,208::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:16:47,209::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5fd7112f-822f-49be-8174-0af14489f439`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:16:47,209::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:16:47,209::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:16:47,209::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5fd7112f-822f-49be-8174-0af14489f439`::Granted request >Thread-10197::DEBUG::2014-08-11 17:16:47,209::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cce79ad2-3b5a-4229-b573-f72495d40b6a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:16:47,209::task::993::Storage.TaskManager.Task::(_decref) Task=`cce79ad2-3b5a-4229-b573-f72495d40b6a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:16:47,225::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:47,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`cce79ad2-3b5a-4229-b573-f72495d40b6a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:47,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`cce79ad2-3b5a-4229-b573-f72495d40b6a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:16:47,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:16:47,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:16:47,225::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:16:47,226::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:16:47,226::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:16:47,226::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:16:47,226::task::993::Storage.TaskManager.Task::(_decref) Task=`cce79ad2-3b5a-4229-b573-f72495d40b6a`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:47,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:47,895::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:47,896::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:47,896::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:47,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:47,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:47,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:48,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173025 s, 59.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:16:50,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:50,170::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507633 s, 20.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:16:51,828::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:16:52,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:52,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150987 s, 67.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:52,891::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) (540672) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) (540672) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:52,892::__init__::225::IOProcess::(_processLogs) (540672) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:52,893::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:16:52,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:52,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:52,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:16:52,955::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000840715 s, 435 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:52,958::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:52,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:52,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:16:52,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:52,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:52,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:52,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:52,963::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:52,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:16:52,963::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:16:52,964::__init__::225::IOProcess::(_processLogs) (540673) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:52,965::__init__::225::IOProcess::(_processLogs) (540673) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:52,966::__init__::225::IOProcess::(_processLogs) (540673) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:52,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:52,967::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:16:54,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:54,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016917 s, 60.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:55,562::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:55,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:55,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:55,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:55,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:55,563::__init__::225::IOProcess::(_processLogs) (540674) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:55,563::__init__::225::IOProcess::(_processLogs) (540674) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:55,563::__init__::225::IOProcess::(_processLogs) (540674) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:55,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:16:55,564::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:16:55,623::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00108924 s, 454 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:16:55,624::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:16:55,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:55,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:55,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:55,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:55,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:55,627::__init__::225::IOProcess::(_processLogs) (540675) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:16:55,628::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:16:55,629::__init__::225::IOProcess::(_processLogs) (540675) Building response >Thread-19::DEBUG::2014-08-11 17:16:55,629::__init__::225::IOProcess::(_processLogs) (540675) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:55,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) (540676) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:55,630::__init__::225::IOProcess::(_processLogs) (540676) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|(540676) Building response >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) (540676) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:16:55,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) (540677) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) (540677) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|(540677) Building response >Thread-19::DEBUG::2014-08-11 17:16:55,632::__init__::225::IOProcess::(_processLogs) (540677) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:16:55,633::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) (540678) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) (540678) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) (540678) Building response >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) (540678) Queuing response >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:16:55,634::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:16:56,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:56,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0480897 s, 21.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:16:57,125::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:16:57,279::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:16:57,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`7816ecc2-c873-4ff3-aba3-ec21a69bb96f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:16:57,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:16:57,343::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:57,343::task::1191::Storage.TaskManager.Task::(prepare) Task=`7816ecc2-c873-4ff3-aba3-ec21a69bb96f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:16:57,343::task::595::Storage.TaskManager.Task::(_updateState) Task=`7816ecc2-c873-4ff3-aba3-ec21a69bb96f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:16:57,344::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:16:57,344::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:16:57,344::task::993::Storage.TaskManager.Task::(_decref) Task=`7816ecc2-c873-4ff3-aba3-ec21a69bb96f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:16:57,356::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:16:57,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff84daaf-7ef8-4fb3-97a1-9549c38b65b2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:16:57,356::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:16:57,356::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9af58336-4f6a-4881-a88f-29ceecadd373`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:16:57,357::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:16:57,357::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:16:57,357::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9af58336-4f6a-4881-a88f-29ceecadd373`::Granted request >Thread-10197::DEBUG::2014-08-11 17:16:57,357::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ff84daaf-7ef8-4fb3-97a1-9549c38b65b2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:16:57,357::task::993::Storage.TaskManager.Task::(_decref) Task=`ff84daaf-7ef8-4fb3-97a1-9549c38b65b2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:16:57,374::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:57,374::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff84daaf-7ef8-4fb3-97a1-9549c38b65b2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:16:57,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff84daaf-7ef8-4fb3-97a1-9549c38b65b2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:16:57,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:16:57,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:16:57,374::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:16:57,374::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:16:57,374::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:16:57,375::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:16:57,375::task::993::Storage.TaskManager.Task::(_decref) Task=`ff84daaf-7ef8-4fb3-97a1-9549c38b65b2`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:16:57,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:57,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:57,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:57,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:16:57,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:16:57,980::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:16:58,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:16:58,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129827 s, 78.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:16:59,135::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:17:00,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`d24f5ec0-f959-48c2-9584-183ad7f0e533`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:00,499::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:17:00,500::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000840715', 'lastCheck': '7.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108924', 'lastCheck': '4.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:17:00,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`d24f5ec0-f959-48c2-9584-183ad7f0e533`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000840715', 'lastCheck': '7.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108924', 'lastCheck': '4.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:17:00,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`d24f5ec0-f959-48c2-9584-183ad7f0e533`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:00,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:00,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:00,500::task::993::Storage.TaskManager.Task::(_decref) Task=`d24f5ec0-f959-48c2-9584-183ad7f0e533`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:17:00,519::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:17:00,519::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:00,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:00,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554892 s, 18.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:17:02,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:02,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0886105 s, 11.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:02,967::__init__::225::IOProcess::(_processLogs) (540679) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:02,968::__init__::225::IOProcess::(_processLogs) (540679) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:02,968::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|(540679) Building response >Thread-19::DEBUG::2014-08-11 17:17:02,969::__init__::225::IOProcess::(_processLogs) (540679) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:02,969::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:17:02,970::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:17:02,970::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:17:03,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000348964 s, 1.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:17:03,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:03,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:03,033::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:03,034::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:03,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:03,036::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:03,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:03,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:03,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:03,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:03,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:03,040::__init__::225::IOProcess::(_processLogs) (540680) Finding callback 'statvfs'... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:03,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:03,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:03,041::__init__::225::IOProcess::(_processLogs) (540680) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:03,043::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|(540680) Building response >Thread-19::DEBUG::2014-08-11 17:17:03,044::__init__::225::IOProcess::(_processLogs) (540680) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:03,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:03,044::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:17:04,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:04,888::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126803 s, 80.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) (540681) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:05,635::__init__::225::IOProcess::(_processLogs) (540681) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:05,636::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|(540681) Building response >Thread-19::DEBUG::2014-08-11 17:17:05,636::__init__::225::IOProcess::(_processLogs) (540681) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:05,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:05,636::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:17:05,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:17:05,697::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000713357 s, 694 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:05,698::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:05,699::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:05,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:05,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:05,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:05,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:05,701::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:05,702::__init__::225::IOProcess::(_processLogs) (540682) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:05,702::__init__::225::IOProcess::(_processLogs) (540682) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) (540682) Building response >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) (540682) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:05,703::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) (540683) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) (540683) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) (540683) Building response >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) (540683) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:05,704::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) (540684) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) (540684) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:05,705::__init__::225::IOProcess::(_processLogs) (540684) Building response >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) (540684) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) (540675) Got request for method 'statvfs'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:05,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) (540685) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) (540685) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) (540685) Building response >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) (540685) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:05,708::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:17:06,836::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:17:06,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:07,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0482235 s, 21.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:17:07,399::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:17:07,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9528087-1844-44d2-9e50-8fceed0def23`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:07,400::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:17:07,434::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:07,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`d9528087-1844-44d2-9e50-8fceed0def23`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:07,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`d9528087-1844-44d2-9e50-8fceed0def23`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:07,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:07,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:07,434::task::993::Storage.TaskManager.Task::(_decref) Task=`d9528087-1844-44d2-9e50-8fceed0def23`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:17:07,446::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:17:07,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`d609af81-28c4-49c4-aec9-1ac21ca0bb20`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:17:07,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:17:07,447::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`19b6b6b2-c71d-46bf-a9f0-9af451432065`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:17:07,447::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:17:07,447::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:17:07,447::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`19b6b6b2-c71d-46bf-a9f0-9af451432065`::Granted request >Thread-10197::DEBUG::2014-08-11 17:17:07,447::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d609af81-28c4-49c4-aec9-1ac21ca0bb20`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:17:07,447::task::993::Storage.TaskManager.Task::(_decref) Task=`d609af81-28c4-49c4-aec9-1ac21ca0bb20`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:17:07,463::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:07,463::task::1191::Storage.TaskManager.Task::(prepare) Task=`d609af81-28c4-49c4-aec9-1ac21ca0bb20`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:07,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`d609af81-28c4-49c4-aec9-1ac21ca0bb20`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:17:07,464::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:17:07,464::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:17:07,464::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:17:07,464::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:17:07,464::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:17:07,464::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:17:07,464::task::993::Storage.TaskManager.Task::(_decref) Task=`d609af81-28c4-49c4-aec9-1ac21ca0bb20`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:17:08,049::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:08,050::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:08,052::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:08,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:08,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:08,055::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:09,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:09,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211271 s, 48.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:17:11,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:11,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.033206 s, 30.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:17:12,133::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:17:13,044::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) (540686) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) (540686) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) (540686) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:13,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:17:13,046::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:13,105::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:13,106::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:17:13,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000663017 s, 552 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:13,108::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:13,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:13,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:13,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:13,111::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:13,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:13,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:13,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:13,114::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:13,114::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:13,115::__init__::225::IOProcess::(_processLogs) (540687) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:13,116::__init__::225::IOProcess::(_processLogs) (540687) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:13,117::__init__::225::IOProcess::(_processLogs) (540687) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:13,118::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:13,118::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:17:13,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:13,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0702038 s, 14.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:17:15,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:15,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143571 s, 71.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:15,708::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:15,709::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:15,709::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:15,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:15,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:15,709::__init__::225::IOProcess::(_processLogs) (540688) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:15,709::__init__::225::IOProcess::(_processLogs) (540688) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:15,710::__init__::225::IOProcess::(_processLogs) (540688) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:15,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:17:15,710::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:17:15,771::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00098743 s, 501 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:15,773::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:15,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:15,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10205::DEBUG::2014-08-11 17:17:15,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d9f73e4-9fb3-4820-bd9f-c8d95aaa7dc0`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:17:15,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10205::INFO::2014-08-11 17:17:15,777::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2014-08-11 17:17:15,778::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10205::INFO::2014-08-11 17:17:15,779::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663017', 'lastCheck': '2.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713357', 'lastCheck': '10.1', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:17:15,779::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10205::DEBUG::2014-08-11 17:17:15,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`2d9f73e4-9fb3-4820-bd9f-c8d95aaa7dc0`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663017', 'lastCheck': '2.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000713357', 'lastCheck': '10.1', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:17:15,780::__init__::225::IOProcess::(_processLogs) (540689) Finding callback 'statvfs'... >Thread-10205::DEBUG::2014-08-11 17:17:15,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`2d9f73e4-9fb3-4820-bd9f-c8d95aaa7dc0`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:17:15,781::__init__::225::IOProcess::(_processLogs) (540689) Got request for method 'statvfs' >Thread-10205::DEBUG::2014-08-11 17:17:15,782::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:15,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:17:15,783::__init__::225::IOProcess::(_processLogs) (540689) Queuing response >Thread-10205::DEBUG::2014-08-11 17:17:15,785::task::993::Storage.TaskManager.Task::(_decref) Task=`2d9f73e4-9fb3-4820-bd9f-c8d95aaa7dc0`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:17:15,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:15,786::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:17:15,788::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:17:15,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:15,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:15,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:15,791::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:15,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:15,792::__init__::225::IOProcess::(_processLogs) (540690) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:15,792::__init__::225::IOProcess::(_processLogs) (540690) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:15,793::__init__::225::IOProcess::(_processLogs) (540690) Building response >Thread-19::DEBUG::2014-08-11 17:17:15,793::__init__::225::IOProcess::(_processLogs) (540690) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:15,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:15,795::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:15,796::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:15,797::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:17:15,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) (540691) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) (540691) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:15,798::__init__::225::IOProcess::(_processLogs) (540691) Building response >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) DEBUG|(540691) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:15,799::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) (540692) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) (540692) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) (540692) Building response >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) (540692) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:15,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:15,801::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:17:15,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:17:15,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:17:17,207::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:17:17,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:17:17,528::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:17:17,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`d41badf0-a6e6-4574-9011-fd96aef91e67`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:17,529::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:17:17,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0199738 s, 51.3 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:17:17,564::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:17,564::task::1191::Storage.TaskManager.Task::(prepare) Task=`d41badf0-a6e6-4574-9011-fd96aef91e67`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:17,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`d41badf0-a6e6-4574-9011-fd96aef91e67`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:17,564::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:17,564::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:17,564::task::993::Storage.TaskManager.Task::(_decref) Task=`d41badf0-a6e6-4574-9011-fd96aef91e67`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:17:17,571::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:17:17,571::task::595::Storage.TaskManager.Task::(_updateState) Task=`bce88be8-99b5-4b31-b024-bdc7bfd1c11c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:17:17,572::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:17:17,572::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0bf63b59-4505-4310-813f-5c0bee4d1700`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:17:17,572::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:17:17,572::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:17:17,572::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0bf63b59-4505-4310-813f-5c0bee4d1700`::Granted request >Thread-10197::DEBUG::2014-08-11 17:17:17,572::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bce88be8-99b5-4b31-b024-bdc7bfd1c11c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:17:17,572::task::993::Storage.TaskManager.Task::(_decref) Task=`bce88be8-99b5-4b31-b024-bdc7bfd1c11c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:17:17,591::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:17,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`bce88be8-99b5-4b31-b024-bdc7bfd1c11c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:17,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`bce88be8-99b5-4b31-b024-bdc7bfd1c11c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:17:17,591::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:17:17,591::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:17:17,591::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:17:17,591::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:17:17,591::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:17:17,591::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:17:17,591::task::993::Storage.TaskManager.Task::(_decref) Task=`bce88be8-99b5-4b31-b024-bdc7bfd1c11c`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:18,120::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:18,121::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:18,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:18,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:18,124::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:18,124::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:19,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:19,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016427 s, 62.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:17:21,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:21,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0293809 s, 34.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:17:21,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`e651e8a8-90ed-4407-aae2-4ec3ea4a1899`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:17:21,838::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:17:21,838::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:21,838::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:17:21,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:21,839::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:21,839::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:21,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:21,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:21,839::__init__::225::IOProcess::(_processLogs) (540693) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:17:21,839::__init__::225::IOProcess::(_processLogs) (540693) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:17:21,840::__init__::225::IOProcess::(_processLogs) DEBUG|(540693) Building response >Thread-19::DEBUG::2014-08-11 17:17:21,840::__init__::225::IOProcess::(_processLogs) (540693) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:21,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:21,841::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:17:21,841::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:21,841::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:17:21,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:21,841::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:17:21,841::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:17:21,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:17:21,842::task::1191::Storage.TaskManager.Task::(prepare) Task=`e651e8a8-90ed-4407-aae2-4ec3ea4a1899`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:17:21,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`e651e8a8-90ed-4407-aae2-4ec3ea4a1899`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:17:21,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:17:21,843::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:17:21,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:17:21,843::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:17:21,844::__init__::225::IOProcess::(_processLogs) (540694) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:17:21,844::task::993::Storage.TaskManager.Task::(_decref) Task=`e651e8a8-90ed-4407-aae2-4ec3ea4a1899`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:17:21,844::__init__::225::IOProcess::(_processLogs) (540694) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:17:21,844::__init__::225::IOProcess::(_processLogs) (540694) Building response >Thread-19::DEBUG::2014-08-11 17:17:21,845::__init__::225::IOProcess::(_processLogs) (540694) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:21,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:21,845::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:17:21,865::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:17:23,118::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:23,118::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:23,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:23,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:23,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:23,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:23,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:23,119::__init__::225::IOProcess::(_processLogs) (540695) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:23,119::__init__::225::IOProcess::(_processLogs) (540695) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:23,121::__init__::225::IOProcess::(_processLogs) (540695) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:23,122::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:17:23,122::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:17:23,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:23,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:17:23,184::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00092034 s, 398 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:17:23,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:23,186::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:23,186::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:23,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:23,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:23,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:23,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:23,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:23,190::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:23,191::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:23,192::__init__::225::IOProcess::(_processLogs) (540696) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:23,193::__init__::225::IOProcess::(_processLogs) (540696) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:23,193::__init__::225::IOProcess::(_processLogs) (540696) Building response >Thread-19::DEBUG::2014-08-11 17:17:23,193::__init__::225::IOProcess::(_processLogs) (540696) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:23,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:23,194::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:17:23,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:23,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484971 s, 21.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:25,800::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:25,801::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:25,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:25,801::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-28::DEBUG::2014-08-11 17:17:25,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:17:25,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:25,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-51::DEBUG::2014-08-11 17:17:25,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:17:25,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-28::DEBUG::2014-08-11 17:17:25,865::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000952799 s, 520 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:25,925::__init__::225::IOProcess::(_processLogs) (540697) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:25,927::__init__::225::IOProcess::(_processLogs) (540697) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:25,927::__init__::225::IOProcess::(_processLogs) (540697) Building response >Thread-19::DEBUG::2014-08-11 17:17:25,928::__init__::225::IOProcess::(_processLogs) (540697) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:25,928::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:25,929::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:17:25,929::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:25,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:25,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:25,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:25,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:25,932::__init__::225::IOProcess::(_processLogs) (540698) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:25,932::__init__::225::IOProcess::(_processLogs) (540698) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:25,938::__init__::225::IOProcess::(_processLogs) (540698) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:25,938::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:25,940::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:17:25,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:25,941::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:25,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:25,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:25,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:25,943::__init__::225::IOProcess::(_processLogs) (540699) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:25,944::__init__::225::IOProcess::(_processLogs) (540699) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:25,944::__init__::225::IOProcess::(_processLogs) (540699) Building response >Thread-19::DEBUG::2014-08-11 17:17:25,945::__init__::225::IOProcess::(_processLogs) (540699) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:25,945::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:25,946::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:25,946::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:25,947::__init__::225::IOProcess::(_processLogs) Message size is 203 >Dummy-51::DEBUG::2014-08-11 17:17:25,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0224182 s, 45.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:25,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:25,948::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:25,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:25,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:25,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:25,951::__init__::225::IOProcess::(_processLogs) (540700) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:25,951::__init__::225::IOProcess::(_processLogs) (540700) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:25,952::__init__::225::IOProcess::(_processLogs) (540700) Building response >Thread-19::DEBUG::2014-08-11 17:17:25,952::__init__::225::IOProcess::(_processLogs) (540700) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:25,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:25,953::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:25,954::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:17:25,954::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:25,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:25,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:25,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:25,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:25,957::__init__::225::IOProcess::(_processLogs) (540701) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:25,957::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:25,958::__init__::225::IOProcess::(_processLogs) (540701) Building response >Thread-19::DEBUG::2014-08-11 17:17:25,958::__init__::225::IOProcess::(_processLogs) (540701) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:25,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:25,959::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:17:27,141::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:17:27,656::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:17:27,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`e66f0c2f-1d76-47de-91f9-2ba0c5c6aba2`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:27,656::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:17:27,676::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:27,676::task::1191::Storage.TaskManager.Task::(prepare) Task=`e66f0c2f-1d76-47de-91f9-2ba0c5c6aba2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:27,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`e66f0c2f-1d76-47de-91f9-2ba0c5c6aba2`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:27,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:27,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:27,676::task::993::Storage.TaskManager.Task::(_decref) Task=`e66f0c2f-1d76-47de-91f9-2ba0c5c6aba2`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:17:27,683::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:17:27,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f027632-c6be-4b8a-88c7-58bdae011157`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:17:27,683::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:17:27,683::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d84eebde-0dde-4dbc-b5e5-5916643b41c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:17:27,683::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:17:27,684::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:17:27,684::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d84eebde-0dde-4dbc-b5e5-5916643b41c8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:17:27,684::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f027632-c6be-4b8a-88c7-58bdae011157`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:17:27,684::task::993::Storage.TaskManager.Task::(_decref) Task=`8f027632-c6be-4b8a-88c7-58bdae011157`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:17:27,700::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:27,700::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f027632-c6be-4b8a-88c7-58bdae011157`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:27,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f027632-c6be-4b8a-88c7-58bdae011157`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:17:27,700::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:17:27,700::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:17:27,701::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:17:27,701::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:17:27,701::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:17:27,701::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:17:27,701::task::993::Storage.TaskManager.Task::(_decref) Task=`8f027632-c6be-4b8a-88c7-58bdae011157`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:17:27,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:28,078::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0439388 s, 23.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:17:28,199::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:28,199::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:28,201::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:28,201::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:28,203::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:28,204::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:17:29,218::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:17:30,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:30,157::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123813 s, 82.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:17:30,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf8739f9-ec78-4561-98e9-e260a4ef0d03`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:30,954::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:17:30,954::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00092034', 'lastCheck': '7.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000952799', 'lastCheck': '5.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:17:30,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf8739f9-ec78-4561-98e9-e260a4ef0d03`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00092034', 'lastCheck': '7.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000952799', 'lastCheck': '5.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:17:30,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf8739f9-ec78-4561-98e9-e260a4ef0d03`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:30,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:30,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:30,955::task::993::Storage.TaskManager.Task::(_decref) Task=`cf8739f9-ec78-4561-98e9-e260a4ef0d03`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:17:30,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:17:30,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:32,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:32,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173089 s, 59.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) (540702) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:33,194::__init__::225::IOProcess::(_processLogs) (540702) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:33,195::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|(540702) Building response >Thread-19::DEBUG::2014-08-11 17:17:33,195::__init__::225::IOProcess::(_processLogs) (540702) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:33,195::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:17:33,196::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:17:33,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:17:33,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000354241 s, 1.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:33,257::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:33,257::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:33,258::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:33,260::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:33,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:33,261::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:33,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:33,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:33,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:33,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:33,265::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:33,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:33,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:33,267::__init__::225::IOProcess::(_processLogs) (540703) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:33,268::__init__::225::IOProcess::(_processLogs) (540703) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:33,270::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|(540703) Building response >Thread-19::DEBUG::2014-08-11 17:17:33,270::__init__::225::IOProcess::(_processLogs) (540703) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:33,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:33,271::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:17:34,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:34,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0576511 s, 17.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:35,958::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) (540704) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:35,959::__init__::225::IOProcess::(_processLogs) (540704) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:35,960::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|(540704) Building response >Thread-19::DEBUG::2014-08-11 17:17:35,960::__init__::225::IOProcess::(_processLogs) (540704) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:35,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:35,960::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:17:35,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:17:36,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000997137 s, 496 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:36,021::__init__::225::IOProcess::(_processLogs) (540701) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:17:36,021::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:36,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:36,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:36,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:36,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:36,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:36,022::__init__::225::IOProcess::(_processLogs) (540705) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:36,022::__init__::225::IOProcess::(_processLogs) (540705) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:36,022::__init__::225::IOProcess::(_processLogs) (540705) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:36,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) (540706) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) (540706) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) (540706) Building response >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) (540706) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:17:36,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) (540707) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) (540707) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) (540707) Building response >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) (540707) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:36,025::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) (540708) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) (540708) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:36,026::__init__::225::IOProcess::(_processLogs) (540708) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:36,027::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:17:36,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:36,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147211 s, 69.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:17:36,932::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:17:37,748::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:17:37,749::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c86b425-b5c2-4679-b44f-c9ca3542d9cf`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:37,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:17:37,762::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:37,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c86b425-b5c2-4679-b44f-c9ca3542d9cf`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:37,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c86b425-b5c2-4679-b44f-c9ca3542d9cf`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:37,763::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:37,763::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:37,763::task::993::Storage.TaskManager.Task::(_decref) Task=`1c86b425-b5c2-4679-b44f-c9ca3542d9cf`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:17:37,774::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:17:37,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d61e31f-e240-4dee-ab52-8d8ba109280b`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:17:37,774::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:17:37,775::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e924cfb5-ca84-4b68-9b92-cceb7daff948`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:17:37,775::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:17:37,775::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:17:37,775::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e924cfb5-ca84-4b68-9b92-cceb7daff948`::Granted request >Thread-10197::DEBUG::2014-08-11 17:17:37,775::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5d61e31f-e240-4dee-ab52-8d8ba109280b`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:17:37,775::task::993::Storage.TaskManager.Task::(_decref) Task=`5d61e31f-e240-4dee-ab52-8d8ba109280b`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:17:37,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:37,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d61e31f-e240-4dee-ab52-8d8ba109280b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:37,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d61e31f-e240-4dee-ab52-8d8ba109280b`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:17:37,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:17:37,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:17:37,793::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:17:37,794::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:17:37,794::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:17:37,794::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:17:37,794::task::993::Storage.TaskManager.Task::(_decref) Task=`5d61e31f-e240-4dee-ab52-8d8ba109280b`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:17:38,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:38,273::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:38,273::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:38,274::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:38,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:38,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:38,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:38,643::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0637861 s, 16.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:17:40,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:40,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0856627 s, 12.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:17:42,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`29126207-3607-450b-8ead-9bb2e0311d73`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:17:42,146::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) (540709) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:17:42,147::__init__::225::IOProcess::(_processLogs) (540709) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:17:42,152::__init__::225::IOProcess::(_processLogs) (540709) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:42,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:42,153::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:17:42,153::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:17:42,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:42,154::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:17:42,154::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:17:42,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:17:42,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`29126207-3607-450b-8ead-9bb2e0311d73`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:17:42,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:17:42,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`29126207-3607-450b-8ead-9bb2e0311d73`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:17:42,155::__init__::225::IOProcess::(_processLogs) (540710) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:17:42,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:17:42,156::__init__::225::IOProcess::(_processLogs) (540710) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:17:42,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:17:42,156::__init__::225::IOProcess::(_processLogs) (540710) Building response >Thread-10102::DEBUG::2014-08-11 17:17:42,157::task::993::Storage.TaskManager.Task::(_decref) Task=`29126207-3607-450b-8ead-9bb2e0311d73`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:17:42,157::__init__::225::IOProcess::(_processLogs) (540710) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:42,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:42,157::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:17:42,179::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:17:42,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:42,908::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0376852 s, 27.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:43,271::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:43,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:43,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:43,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:43,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:43,272::__init__::225::IOProcess::(_processLogs) (540711) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:43,272::__init__::225::IOProcess::(_processLogs) (540711) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:43,272::__init__::225::IOProcess::(_processLogs) (540711) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:43,272::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:17:43,273::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:17:43,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000663009 s, 552 kB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:43,335::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:43,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:43,336::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:43,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:43,339::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:43,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:43,340::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:43,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:43,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:43,342::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:43,343::__init__::225::IOProcess::(_processLogs) (540712) Finding callback 'statvfs'... >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:43,344::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:43,344::__init__::225::IOProcess::(_processLogs) (540712) Got request for method 'statvfs' >GuestMonitor-vm::DEBUG::2014-08-11 17:17:43,344::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:43,346::__init__::225::IOProcess::(_processLogs) (540712) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:43,347::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:43,347::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:17:44,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:44,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128986 s, 79.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:46,027::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) (540713) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) (540713) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) (540713) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:46,028::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:17:46,029::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:17:46,088::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000362082 s, 1.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:46,089::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:46,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:46,089::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:46,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:46,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) (540714) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) (540714) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) (540714) Building response >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) (540714) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:17:46,090::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) (540715) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) (540715) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) (540715) Building response >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) (540715) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:46,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:46,092::__init__::225::IOProcess::(_processLogs) (540716) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) (540716) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) (540716) Building response >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) (540716) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:46,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) (540717) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) (540717) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) (540717) Building response >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) (540717) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:46,094::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:17:46,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf811607-895c-4459-a8d0-0735e7650c8e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:46,153::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:17:46,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663009', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362082', 'lastCheck': '0.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:17:46,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf811607-895c-4459-a8d0-0735e7650c8e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000663009', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362082', 'lastCheck': '0.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:17:46,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf811607-895c-4459-a8d0-0735e7650c8e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:46,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:46,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:46,154::task::993::Storage.TaskManager.Task::(_decref) Task=`cf811607-895c-4459-a8d0-0735e7650c8e`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:17:46,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:17:46,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:46,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:47,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121422 s, 84.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:17:47,267::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:17:47,866::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [6c840493] >Thread-10205::DEBUG::2014-08-11 17:17:47,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9260021-f180-4efe-abe4-527d0abf184a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:47,866::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:17:47,898::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:47,898::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9260021-f180-4efe-abe4-527d0abf184a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:47,898::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9260021-f180-4efe-abe4-527d0abf184a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:47,898::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:47,898::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:47,898::task::993::Storage.TaskManager.Task::(_decref) Task=`a9260021-f180-4efe-abe4-527d0abf184a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:17:47,907::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [6c840493] >Thread-10197::DEBUG::2014-08-11 17:17:47,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`b342f8b7-855c-4ba4-8a29-8d5ed13f1f94`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:17:47,907::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:17:47,908::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ecaeab44-47fe-4dda-96fa-8a88479c2b2a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:17:47,908::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:17:47,908::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:17:47,908::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ecaeab44-47fe-4dda-96fa-8a88479c2b2a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:17:47,908::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b342f8b7-855c-4ba4-8a29-8d5ed13f1f94`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:17:47,908::task::993::Storage.TaskManager.Task::(_decref) Task=`b342f8b7-855c-4ba4-8a29-8d5ed13f1f94`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:17:47,924::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:47,924::task::1191::Storage.TaskManager.Task::(prepare) Task=`b342f8b7-855c-4ba4-8a29-8d5ed13f1f94`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:47,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`b342f8b7-855c-4ba4-8a29-8d5ed13f1f94`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:17:47,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:17:47,925::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:17:47,925::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:17:47,925::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:17:47,925::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:17:47,925::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:17:47,925::task::993::Storage.TaskManager.Task::(_decref) Task=`b342f8b7-855c-4ba4-8a29-8d5ed13f1f94`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:17:48,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:48,350::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:48,350::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:48,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:48,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:48,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:17:49,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:49,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507417 s, 20.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:17:51,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:51,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0324089 s, 31.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:17:51,949::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:17:53,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) (540718) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:53,349::__init__::225::IOProcess::(_processLogs) (540718) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:53,350::__init__::225::IOProcess::(_processLogs) (540718) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:53,350::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:17:53,350::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:17:53,414::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:53,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:17:53,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00076907 s, 476 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:17:53,419::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:53,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:53,421::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:53,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:53,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:53,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:17:53,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:53,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:17:53,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:53,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:53,429::__init__::225::IOProcess::(_processLogs) (540719) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:53,430::__init__::225::IOProcess::(_processLogs) (540719) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:17:53,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0798643 s, 12.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:53,430::__init__::225::IOProcess::(_processLogs) (540719) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:53,432::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:53,432::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:17:55,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:55,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206534 s, 49.6 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:17:56,094::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) (540720) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:17:56,096::__init__::225::IOProcess::(_processLogs) (540720) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:17:56,097::__init__::225::IOProcess::(_processLogs) (540720) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,098::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:17:56,099::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:17:56,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,103::__init__::225::IOProcess::(_processLogs) (540721) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:17:56,104::__init__::225::IOProcess::(_processLogs) (540721) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:17:56,105::__init__::225::IOProcess::(_processLogs) (540721) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,106::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:17:56,108::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) (540722) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:17:56,109::__init__::225::IOProcess::(_processLogs) (540722) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:17:56,121::__init__::225::IOProcess::(_processLogs) (540722) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,121::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-28::DEBUG::2014-08-11 17:17:56,121::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:17:56,121::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:17:56,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,122::__init__::225::IOProcess::(_processLogs) (540723) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:17:56,122::__init__::225::IOProcess::(_processLogs) (540723) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:17:56,123::__init__::225::IOProcess::(_processLogs) (540723) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,124::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,124::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-28::DEBUG::2014-08-11 17:17:56,124::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:17:56,124::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:17:56,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) (540724) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) (540724) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) (540724) Building response >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) (540724) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) (540725) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:17:56,126::__init__::225::IOProcess::(_processLogs) (540725) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:17:56,127::__init__::225::IOProcess::(_processLogs) (540725) Queuing response >Thread-28::DEBUG::2014-08-11 17:17:56,127::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:17:56,127::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-28::INFO::2014-08-11 17:17:56,128::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-28::INFO::2014-08-11 17:17:56,128::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:17:56,128::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:56,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,129::__init__::225::IOProcess::(_processLogs) (540726) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:56,129::__init__::225::IOProcess::(_processLogs) (540726) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:56,129::__init__::225::IOProcess::(_processLogs) (540726) Queuing response >Thread-28::DEBUG::2014-08-11 17:17:56,129::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:17:56,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,188::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:17:56,190::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000634727 s, 780 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:17:56,190::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:17:56,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:17:56,190::__init__::225::IOProcess::(_processLogs) (540727) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) (540727) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) (540727) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) (540728) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) (540728) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) (540728) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:17:56,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) (540729) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) (540729) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) (540729) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,193::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:17:56,194::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:17:56,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:17:56,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:17:56,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:17:56,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:17:56,194::__init__::225::IOProcess::(_processLogs) (540730) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:17:56,195::__init__::225::IOProcess::(_processLogs) (540730) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:17:56,195::__init__::225::IOProcess::(_processLogs) (540730) Building response >Thread-19::DEBUG::2014-08-11 17:17:56,195::__init__::225::IOProcess::(_processLogs) (540730) Queuing response >Thread-19::DEBUG::2014-08-11 17:17:56,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:17:56,195::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:17:57,214::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:17:57,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:57,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145096 s, 70.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:17:57,995::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:17:57,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`b97e11aa-632a-449f-bd97-803891190546`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:17:57,996::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:17:58,048::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:58,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`b97e11aa-632a-449f-bd97-803891190546`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:17:58,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`b97e11aa-632a-449f-bd97-803891190546`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:17:58,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:17:58,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:17:58,048::task::993::Storage.TaskManager.Task::(_decref) Task=`b97e11aa-632a-449f-bd97-803891190546`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:17:58,054::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:17:58,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca3c9487-3367-4748-98f3-533a625ec42a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:17:58,055::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:17:58,055::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`db90739f-8fa5-4582-b9fa-734ba98e760e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:17:58,055::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:17:58,055::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:17:58,055::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`db90739f-8fa5-4582-b9fa-734ba98e760e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:17:58,056::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca3c9487-3367-4748-98f3-533a625ec42a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:17:58,056::task::993::Storage.TaskManager.Task::(_decref) Task=`ca3c9487-3367-4748-98f3-533a625ec42a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:17:58,139::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:58,139::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca3c9487-3367-4748-98f3-533a625ec42a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:17:58,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca3c9487-3367-4748-98f3-533a625ec42a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:17:58,139::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:17:58,139::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:17:58,139::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:17:58,139::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:17:58,140::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:17:58,140::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:17:58,140::task::993::Storage.TaskManager.Task::(_decref) Task=`ca3c9487-3367-4748-98f3-533a625ec42a`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:17:58,434::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:58,435::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:58,436::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:58,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:17:58,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:17:58,440::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:17:59,281::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:17:59,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:17:59,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545231 s, 18.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:18:01,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`98934407-a3b8-4985-9635-ffe1564017f8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:01,437::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:18:01,437::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076907', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634727', 'lastCheck': '5.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:01,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`98934407-a3b8-4985-9635-ffe1564017f8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00076907', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000634727', 'lastCheck': '5.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:01,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`98934407-a3b8-4985-9635-ffe1564017f8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:01,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:01,437::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:01,437::task::993::Storage.TaskManager.Task::(_decref) Task=`98934407-a3b8-4985-9635-ffe1564017f8`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:18:01,448::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:01,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:18:01,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:01,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0524765 s, 19.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:03,432::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:03,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:03,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:03,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:03,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:03,433::__init__::225::IOProcess::(_processLogs) (540731) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:03,433::__init__::225::IOProcess::(_processLogs) (540731) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:03,433::__init__::225::IOProcess::(_processLogs) (540731) Queuing response >Thread-27::DEBUG::2014-08-11 17:18:03,433::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:03,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:03,493::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:03,497::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:03,497::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:18:03,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000357812 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:03,499::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:03,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:03,501::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:03,501::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:03,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:03,502::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:03,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:03,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:03,505::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:03,505::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:03,505::__init__::225::IOProcess::(_processLogs) (540732) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:03,506::__init__::225::IOProcess::(_processLogs) (540732) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:03,508::__init__::225::IOProcess::(_processLogs) (540732) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:03,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:03,508::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:03,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:04,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.043253 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:18:06,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:06,190::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523806 s, 19.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:06,196::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:06,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:06,197::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:06,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:06,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:06,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:06,199::__init__::225::IOProcess::(_processLogs) (540733) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:06,199::__init__::225::IOProcess::(_processLogs) (540733) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:06,204::__init__::225::IOProcess::(_processLogs) (540733) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:06,204::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:18:06,205::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:18:06,266::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0018278 s, 271 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:06,267::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:06,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:06,267::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:06,267::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:06,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:06,268::__init__::225::IOProcess::(_processLogs) (540734) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:06,268::__init__::225::IOProcess::(_processLogs) (540734) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:06,268::__init__::225::IOProcess::(_processLogs) (540734) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:06,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:06,269::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:18:06,269::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:06,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:06,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:06,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:06,269::__init__::225::IOProcess::(_processLogs) (540735) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) (540735) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) (540735) Building response >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) (540735) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:06,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) (540736) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) (540736) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) (540736) Building response >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) (540736) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:06,271::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) (540737) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) (540737) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:06,272::__init__::225::IOProcess::(_processLogs) (540737) Building response >Thread-19::DEBUG::2014-08-11 17:18:06,273::__init__::225::IOProcess::(_processLogs) (540737) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:06,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:06,273::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:18:06,957::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:18:08,203::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:18:08,262::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:18:08,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1f52d4e-92b9-4f89-8710-018067120552`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:08,263::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:18:08,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0338692 s, 30.2 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:18:08,303::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:08,303::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1f52d4e-92b9-4f89-8710-018067120552`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:08,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1f52d4e-92b9-4f89-8710-018067120552`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:08,304::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:08,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:08,305::task::993::Storage.TaskManager.Task::(_decref) Task=`c1f52d4e-92b9-4f89-8710-018067120552`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:18:08,316::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:18:08,317::task::595::Storage.TaskManager.Task::(_updateState) Task=`60fb084b-8ef1-4c0c-921c-5b35859efee5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:18:08,317::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:18:08,317::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`18cc17a8-f924-426c-a562-41bb59190fe2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:18:08,317::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:18:08,317::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:18:08,317::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`18cc17a8-f924-426c-a562-41bb59190fe2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:18:08,317::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`60fb084b-8ef1-4c0c-921c-5b35859efee5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:18:08,318::task::993::Storage.TaskManager.Task::(_decref) Task=`60fb084b-8ef1-4c0c-921c-5b35859efee5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:18:08,335::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:08,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`60fb084b-8ef1-4c0c-921c-5b35859efee5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:08,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`60fb084b-8ef1-4c0c-921c-5b35859efee5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:18:08,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:18:08,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:18:08,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:18:08,336::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:18:08,336::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:18:08,336::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:18:08,336::task::993::Storage.TaskManager.Task::(_decref) Task=`60fb084b-8ef1-4c0c-921c-5b35859efee5`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:18:08,511::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:08,512::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:08,513::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:08,513::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:08,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:08,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:18:10,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:10,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483644 s, 21.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:18:12,269::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:18:12,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:12,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0252473 s, 40.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) (540738) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:13,509::__init__::225::IOProcess::(_processLogs) (540738) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:13,510::__init__::225::IOProcess::(_processLogs) (540738) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:13,510::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:18:13,511::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:18:13,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:13,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:18:13,573::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00058559 s, 625 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:13,575::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:13,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:13,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:13,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:13,577::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:13,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:13,579::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:13,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:13,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:13,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:13,581::__init__::225::IOProcess::(_processLogs) (540739) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:13,582::__init__::225::IOProcess::(_processLogs) (540739) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:13,583::__init__::225::IOProcess::(_processLogs) (540739) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:13,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:13,584::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:14,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:14,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153716 s, 66.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) (540740) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:16,273::__init__::225::IOProcess::(_processLogs) (540740) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:16,274::__init__::225::IOProcess::(_processLogs) (540740) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:16,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:18:16,274::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:18:16,333::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000899063 s, 551 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:16,334::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:16,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:16,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:16,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:16,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:16,335::__init__::225::IOProcess::(_processLogs) (540741) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:16,335::__init__::225::IOProcess::(_processLogs) (540741) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:16,335::__init__::225::IOProcess::(_processLogs) (540741) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:16,335::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:16,335::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:18:16,336::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:18:16,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:16,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:16,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:16,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:16,336::__init__::225::IOProcess::(_processLogs) (540742) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) (540742) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) (540742) Building response >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) (540742) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:18:16,337::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) (540743) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) (540743) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) (540743) Building response >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) (540743) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:16,338::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:18:16,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:16,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:16,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:16,339::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:16,339::__init__::225::IOProcess::(_processLogs) (540744) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:16,340::__init__::225::IOProcess::(_processLogs) (540744) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:16,340::__init__::225::IOProcess::(_processLogs) (540744) Building response >Thread-19::DEBUG::2014-08-11 17:18:16,340::__init__::225::IOProcess::(_processLogs) (540744) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:16,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:16,340::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:18:16,599::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:18:16,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`4265a7c3-02ee-405b-bd11-7f37e540e75d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:16,659::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:18:16,659::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058559', 'lastCheck': '3.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899063', 'lastCheck': '0.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:16,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`4265a7c3-02ee-405b-bd11-7f37e540e75d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00058559', 'lastCheck': '3.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899063', 'lastCheck': '0.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:16,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`4265a7c3-02ee-405b-bd11-7f37e540e75d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:16,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:16,659::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:16,659::task::993::Storage.TaskManager.Task::(_decref) Task=`4265a7c3-02ee-405b-bd11-7f37e540e75d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:18:16,673::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144081 s, 71.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:18:16,681::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:16,681::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:18:17,333::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:18:18,451::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:18:18,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`b69eb852-1030-42cc-baeb-dc6b3d11aad8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:18,452::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:18:18,538::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:18,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`b69eb852-1030-42cc-baeb-dc6b3d11aad8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:18,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`b69eb852-1030-42cc-baeb-dc6b3d11aad8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:18,539::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:18,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:18,539::task::993::Storage.TaskManager.Task::(_decref) Task=`b69eb852-1030-42cc-baeb-dc6b3d11aad8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:18:18,551::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:18:18,551::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a9221d4-e7a8-44a1-a987-b2b756f1f93b`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:18:18,551::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:18:18,553::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`76122ba6-c8fe-4119-a830-f284003bcad2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:18:18,553::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:18:18,553::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:18:18,553::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`76122ba6-c8fe-4119-a830-f284003bcad2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:18:18,553::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9a9221d4-e7a8-44a1-a987-b2b756f1f93b`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:18:18,553::task::993::Storage.TaskManager.Task::(_decref) Task=`9a9221d4-e7a8-44a1-a987-b2b756f1f93b`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:18:18,576::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:18,576::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a9221d4-e7a8-44a1-a987-b2b756f1f93b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:18,576::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a9221d4-e7a8-44a1-a987-b2b756f1f93b`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:18:18,576::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:18:18,576::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:18:18,576::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:18:18,576::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:18:18,577::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:18:18,577::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:18:18,577::task::993::Storage.TaskManager.Task::(_decref) Task=`9a9221d4-e7a8-44a1-a987-b2b756f1f93b`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:18,585::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:18,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:18,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:18,587::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:18,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:18,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:18:18,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:18,777::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363833 s, 28.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:18:20,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:20,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0490876 s, 20.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:18:21,959::task::595::Storage.TaskManager.Task::(_updateState) Task=`93cb27a0-4458-44e8-9f66-43223b1986ce`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:18:21,959::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:18:21,959::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:18:21,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:21,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:21,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:21,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:21,960::__init__::225::IOProcess::(_processLogs) (540745) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:18:21,960::__init__::225::IOProcess::(_processLogs) (540745) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:18:21,963::__init__::225::IOProcess::(_processLogs) (540745) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:21,963::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:21,964::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:18:21,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:21,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:18:21,964::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:18:21,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:18:21,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`93cb27a0-4458-44e8-9f66-43223b1986ce`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:18:21,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:18:21,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`93cb27a0-4458-44e8-9f66-43223b1986ce`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:18:21,966::__init__::225::IOProcess::(_processLogs) (540746) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:18:21,966::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:18:21,966::__init__::225::IOProcess::(_processLogs) (540746) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:18:21,966::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:18:21,967::__init__::225::IOProcess::(_processLogs) (540746) Building response >Thread-10017::DEBUG::2014-08-11 17:18:21,967::task::993::Storage.TaskManager.Task::(_decref) Task=`93cb27a0-4458-44e8-9f66-43223b1986ce`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:18:21,967::__init__::225::IOProcess::(_processLogs) (540746) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:21,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:21,968::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:18:21,988::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:18:22,900::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:22,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318687 s, 32.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:23,584::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:23,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:23,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:23,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:23,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:23,585::__init__::225::IOProcess::(_processLogs) (540747) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:23,585::__init__::225::IOProcess::(_processLogs) (540747) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:23,585::__init__::225::IOProcess::(_processLogs) (540747) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:23,585::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:18:23,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:18:23,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:18:23,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000359416 s, 1.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:23,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:23,649::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:23,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:23,652::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:23,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:23,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:23,653::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:23,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:23,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:23,656::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:23,657::__init__::225::IOProcess::(_processLogs) (540748) Finding callback 'statvfs'... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:23,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:23,658::__init__::225::IOProcess::(_processLogs) (540748) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:23,660::__init__::225::IOProcess::(_processLogs) (540748) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:23,660::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:23,661::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:24,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:25,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044986 s, 22.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:26,340::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:26,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:26,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:26,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:26,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:26,341::__init__::225::IOProcess::(_processLogs) (540749) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:26,341::__init__::225::IOProcess::(_processLogs) (540749) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:26,342::__init__::225::IOProcess::(_processLogs) (540749) Queuing response >Thread-28::DEBUG::2014-08-11 17:18:26,342::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:26,342::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:26,459::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:18:26,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00067899 s, 729 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:26,460::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) (540750) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) (540750) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:26,461::__init__::225::IOProcess::(_processLogs) (540750) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:26,462::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:18:26,462::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:18:26,462::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:26,462::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:26,462::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:26,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) (540751) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) (540751) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) (540751) Building response >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) (540751) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:26,463::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) (540752) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) (540752) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) (540752) Building response >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) (540752) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:26,464::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:26,465::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:18:26,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:26,465::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:26,465::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:26,465::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:26,465::__init__::225::IOProcess::(_processLogs) (540753) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:26,466::__init__::225::IOProcess::(_processLogs) (540753) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:26,466::__init__::225::IOProcess::(_processLogs) (540753) Building response >Thread-19::DEBUG::2014-08-11 17:18:26,466::__init__::225::IOProcess::(_processLogs) (540753) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:26,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:26,466::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:18:27,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:27,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421506 s, 24.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:18:27,276::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:18:28,603::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:18:28,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ecc2b36-cdc0-4767-b132-2c7b6b827c6c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:28,603::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:18:28,657::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:28,657::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ecc2b36-cdc0-4767-b132-2c7b6b827c6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:28,657::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ecc2b36-cdc0-4767-b132-2c7b6b827c6c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:28,657::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:28,657::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:28,657::task::993::Storage.TaskManager.Task::(_decref) Task=`0ecc2b36-cdc0-4767-b132-2c7b6b827c6c`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:28,663::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:28,663::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:28,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:28,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:28,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:28,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:18:28,668::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:18:28,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`5764ac39-84aa-45b1-b732-b0a55a5862b1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:18:28,668::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:18:28,669::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ee055eff-4b3d-47f2-8b6b-a5d521bc3eb5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:18:28,669::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:18:28,669::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:18:28,669::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ee055eff-4b3d-47f2-8b6b-a5d521bc3eb5`::Granted request >Thread-10197::DEBUG::2014-08-11 17:18:28,669::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5764ac39-84aa-45b1-b732-b0a55a5862b1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:18:28,669::task::993::Storage.TaskManager.Task::(_decref) Task=`5764ac39-84aa-45b1-b732-b0a55a5862b1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:18:28,697::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:28,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`5764ac39-84aa-45b1-b732-b0a55a5862b1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:28,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`5764ac39-84aa-45b1-b732-b0a55a5862b1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:18:28,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:18:28,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:18:28,697::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:18:28,697::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:18:28,697::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:18:28,697::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:18:28,698::task::993::Storage.TaskManager.Task::(_decref) Task=`5764ac39-84aa-45b1-b732-b0a55a5862b1`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:18:29,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:29,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415171 s, 24.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:18:29,345::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:18:31,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:31,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0267645 s, 38.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:18:31,869::task::595::Storage.TaskManager.Task::(_updateState) Task=`81a1a6f9-4340-4453-8995-5d05ed6c9234`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:31,870::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:18:31,871::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359416', 'lastCheck': '8.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067899', 'lastCheck': '5.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:31,871::task::1191::Storage.TaskManager.Task::(prepare) Task=`81a1a6f9-4340-4453-8995-5d05ed6c9234`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000359416', 'lastCheck': '8.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00067899', 'lastCheck': '5.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:31,871::task::595::Storage.TaskManager.Task::(_updateState) Task=`81a1a6f9-4340-4453-8995-5d05ed6c9234`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:31,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:31,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:31,873::task::993::Storage.TaskManager.Task::(_decref) Task=`81a1a6f9-4340-4453-8995-5d05ed6c9234`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:18:31,901::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:31,903::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:18:33,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:33,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0786109 s, 13.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:33,661::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:33,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:33,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:33,662::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:33,662::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:33,662::__init__::225::IOProcess::(_processLogs) (540754) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:33,662::__init__::225::IOProcess::(_processLogs) (540754) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:33,662::__init__::225::IOProcess::(_processLogs) (540754) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:33,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:18:33,663::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:33,663::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:18:33,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:33,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:18:33,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00103145 s, 355 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:33,727::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:33,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:33,728::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:33,729::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:33,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:33,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:33,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:33,732::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:33,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:33,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:33,734::__init__::225::IOProcess::(_processLogs) (540755) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:33,735::__init__::225::IOProcess::(_processLogs) (540755) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:33,737::__init__::225::IOProcess::(_processLogs) (540755) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:33,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:33,737::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:35,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:35,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120964 s, 84.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:36,466::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:36,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:36,466::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:36,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:36,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:36,467::__init__::225::IOProcess::(_processLogs) (540756) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:36,467::__init__::225::IOProcess::(_processLogs) (540756) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:36,467::__init__::225::IOProcess::(_processLogs) (540756) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:36,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:18:36,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:36,468::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:18:36,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000371434 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:36,527::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:36,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:36,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:36,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:36,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:36,528::__init__::225::IOProcess::(_processLogs) (540757) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:36,528::__init__::225::IOProcess::(_processLogs) (540757) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:36,528::__init__::225::IOProcess::(_processLogs) (540757) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:36,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) (540758) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) (540758) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) (540758) Building response >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) (540758) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:36,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) (540759) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) (540759) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) (540759) Building response >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) (540759) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:36,531::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) (540760) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) (540760) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) (540760) Building response >Thread-19::DEBUG::2014-08-11 17:18:36,532::__init__::225::IOProcess::(_processLogs) (540760) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:36,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:36,533::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:18:36,996::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:18:37,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:37,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422787 s, 24.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:38,740::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:38,741::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:38,741::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:38,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`16330f72-f5a9-4c49-83b0-579a1081aa60`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:38,744::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >GuestMonitor-vm::DEBUG::2014-08-11 17:18:38,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:38,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:38,749::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:38,749::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::INFO::2014-08-11 17:18:38,791::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:38,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`16330f72-f5a9-4c49-83b0-579a1081aa60`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:38,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`16330f72-f5a9-4c49-83b0-579a1081aa60`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:38,791::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:38,791::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:38,791::task::993::Storage.TaskManager.Task::(_decref) Task=`16330f72-f5a9-4c49-83b0-579a1081aa60`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:18:38,802::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:18:38,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`83e1a90a-d3bb-428f-9edb-bb383c9b4a6f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:18:38,803::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:18:38,803::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2055cc05-0871-499c-a1b9-46c0ca1fadd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:18:38,803::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:18:38,803::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:18:38,803::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2055cc05-0871-499c-a1b9-46c0ca1fadd4`::Granted request >Thread-10197::DEBUG::2014-08-11 17:18:38,803::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`83e1a90a-d3bb-428f-9edb-bb383c9b4a6f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:18:38,804::task::993::Storage.TaskManager.Task::(_decref) Task=`83e1a90a-d3bb-428f-9edb-bb383c9b4a6f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:18:38,855::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:38,855::task::1191::Storage.TaskManager.Task::(prepare) Task=`83e1a90a-d3bb-428f-9edb-bb383c9b4a6f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:38,855::task::595::Storage.TaskManager.Task::(_updateState) Task=`83e1a90a-d3bb-428f-9edb-bb383c9b4a6f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:18:38,855::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:18:38,855::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:18:38,855::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:18:38,855::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:18:38,855::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:18:38,856::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:18:38,856::task::993::Storage.TaskManager.Task::(_decref) Task=`83e1a90a-d3bb-428f-9edb-bb383c9b4a6f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:18:39,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:39,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015264 s, 67.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:18:41,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:42,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0665535 s, 15.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:18:42,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3aca058-ac20-41da-90b2-82574a9dc1b5`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:18:42,278::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) (540761) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:18:42,279::__init__::225::IOProcess::(_processLogs) (540761) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:18:42,280::__init__::225::IOProcess::(_processLogs) DEBUG|(540761) Building response >Thread-19::DEBUG::2014-08-11 17:18:42,280::__init__::225::IOProcess::(_processLogs) (540761) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:42,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:42,280::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:18:42,281::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:42,281::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:18:42,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10102::INFO::2014-08-11 17:18:42,282::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:18:42,282::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10102::DEBUG::2014-08-11 17:18:42,282::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3aca058-ac20-41da-90b2-82574a9dc1b5`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:18:42,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:18:42,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3aca058-ac20-41da-90b2-82574a9dc1b5`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:18:42,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:18:42,283::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:18:42,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:18:42,283::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:18:42,284::__init__::225::IOProcess::(_processLogs) (540762) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:18:42,284::task::993::Storage.TaskManager.Task::(_decref) Task=`d3aca058-ac20-41da-90b2-82574a9dc1b5`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:18:42,285::__init__::225::IOProcess::(_processLogs) (540762) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:18:42,285::__init__::225::IOProcess::(_processLogs) (540762) Building response >Thread-19::DEBUG::2014-08-11 17:18:42,285::__init__::225::IOProcess::(_processLogs) (540762) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:42,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:42,285::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:18:42,306::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) (540763) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:43,738::__init__::225::IOProcess::(_processLogs) (540763) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:43,739::__init__::225::IOProcess::(_processLogs) DEBUG|(540763) Building response >Thread-19::DEBUG::2014-08-11 17:18:43,739::__init__::225::IOProcess::(_processLogs) (540763) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:43,739::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:18:43,740::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:43,740::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:43,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:18:43,803::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000331024 s, 1.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:18:43,804::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:43,806::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:43,807::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:43,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:43,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:43,809::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:43,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:43,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:43,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:43,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:43,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:43,813::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:43,813::__init__::225::IOProcess::(_processLogs) (540764) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:43,814::__init__::225::IOProcess::(_processLogs) (540764) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:43,815::__init__::225::IOProcess::(_processLogs) DEBUG|(540764) Building response >Thread-19::DEBUG::2014-08-11 17:18:43,816::__init__::225::IOProcess::(_processLogs) (540764) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:43,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:43,816::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:44,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:44,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012896 s, 79.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:18:46,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:46,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395232 s, 25.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:46,533::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:46,533::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:46,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) (540765) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) (540765) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:46,534::__init__::225::IOProcess::(_processLogs) DEBUG|(540765) Building response >Thread-19::DEBUG::2014-08-11 17:18:46,535::__init__::225::IOProcess::(_processLogs) (540765) Queuing response >Thread-28::DEBUG::2014-08-11 17:18:46,535::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:46,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:46,594::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:18:46,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00084983 s, 582 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) (540766) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:46,597::__init__::225::IOProcess::(_processLogs) (540766) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:46,598::__init__::225::IOProcess::(_processLogs) DEBUG|(540766) Building response >Thread-19::DEBUG::2014-08-11 17:18:46,598::__init__::225::IOProcess::(_processLogs) (540766) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:46,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:46,598::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:46,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) (540767) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) (540767) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) (540767) Building response >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) (540767) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:18:46,600::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) (540768) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) (540768) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) (540768) Building response >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) (540768) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:46,601::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:46,602::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:46,602::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:18:46,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:46,602::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:46,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) (540769) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) (540769) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) (540769) Building response >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) (540769) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:46,603::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:18:47,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea2b9c83-3a2a-458c-94d6-4bbeca26a88a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:47,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:18:47,104::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331024', 'lastCheck': '3.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084983', 'lastCheck': '0.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:47,104::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea2b9c83-3a2a-458c-94d6-4bbeca26a88a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000331024', 'lastCheck': '3.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084983', 'lastCheck': '0.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:18:47,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea2b9c83-3a2a-458c-94d6-4bbeca26a88a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:47,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:47,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:47,104::task::993::Storage.TaskManager.Task::(_decref) Task=`ea2b9c83-3a2a-458c-94d6-4bbeca26a88a`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:18:47,115::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:47,116::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:18:47,404::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:18:48,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:48,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633035 s, 16.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:48,820::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:48,822::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:48,822::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:48,824::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:48,825::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:48,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:18:48,921::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:18:48,921::task::595::Storage.TaskManager.Task::(_updateState) Task=`90c54515-d7fb-43d5-af63-ce5450edf810`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:48,921::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:18:48,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:48,979::task::1191::Storage.TaskManager.Task::(prepare) Task=`90c54515-d7fb-43d5-af63-ce5450edf810`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:48,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`90c54515-d7fb-43d5-af63-ce5450edf810`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:48,979::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:48,979::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:48,979::task::993::Storage.TaskManager.Task::(_decref) Task=`90c54515-d7fb-43d5-af63-ce5450edf810`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:18:48,985::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:18:48,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea4466b1-9f7b-4a94-8ddc-54a10a07d70f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:18:48,986::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:18:48,986::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8dd31bfe-4506-4272-b57a-8b4f75f8933f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:18:48,986::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:18:48,986::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:18:48,986::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8dd31bfe-4506-4272-b57a-8b4f75f8933f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:18:48,987::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ea4466b1-9f7b-4a94-8ddc-54a10a07d70f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:18:48,987::task::993::Storage.TaskManager.Task::(_decref) Task=`ea4466b1-9f7b-4a94-8ddc-54a10a07d70f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:18:49,009::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:49,009::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea4466b1-9f7b-4a94-8ddc-54a10a07d70f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:49,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea4466b1-9f7b-4a94-8ddc-54a10a07d70f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:18:49,009::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:18:49,009::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:18:49,010::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:18:49,010::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:18:49,010::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:18:49,010::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:18:49,010::task::993::Storage.TaskManager.Task::(_decref) Task=`ea4466b1-9f7b-4a94-8ddc-54a10a07d70f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:18:50,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:50,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444899 s, 23.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:18:52,030::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:18:52,440::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:52,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0638154 s, 16.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:53,816::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:53,816::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) (540770) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) (540770) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) DEBUG|(540770) Building response >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) (540770) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:53,817::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:18:53,818::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:18:53,818::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:53,879::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:18:53,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000708905 s, 516 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:18:53,880::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:53,882::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:53,883::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:53,884::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:53,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:53,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:53,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:53,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:53,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:53,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:53,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:18:53,889::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:18:53,889::__init__::225::IOProcess::(_processLogs) (540771) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:53,890::__init__::225::IOProcess::(_processLogs) (540771) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:53,891::__init__::225::IOProcess::(_processLogs) DEBUG|(540771) Building response >Thread-19::DEBUG::2014-08-11 17:18:53,892::__init__::225::IOProcess::(_processLogs) (540771) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:53,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:53,892::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:54,592::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:18:54,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123792 s, 82.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:56,603::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:56,603::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:56,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:56,603::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:56,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:56,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:56,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:56,604::__init__::225::IOProcess::(_processLogs) (540772) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:56,604::__init__::225::IOProcess::(_processLogs) (540772) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:56,604::__init__::225::IOProcess::(_processLogs) DEBUG|(540772) Building response >Thread-19::DEBUG::2014-08-11 17:18:56,604::__init__::225::IOProcess::(_processLogs) (540772) Queuing response >Thread-28::DEBUG::2014-08-11 17:18:56,605::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:18:56,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:56,663::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:18:56,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:18:56,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00551619 s, 89.7 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) (540773) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:18:56,786::__init__::225::IOProcess::(_processLogs) (540773) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:18:56,787::__init__::225::IOProcess::(_processLogs) (540773) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:56,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) (540774) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:56,788::__init__::225::IOProcess::(_processLogs) (540774) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:56,794::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540774) Building response >Thread-19::DEBUG::2014-08-11 17:18:56,794::__init__::225::IOProcess::(_processLogs) (540774) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:56,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:56,795::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:56,795::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:56,795::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:18:56,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:56,795::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:56,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:56,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:56,796::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:56,796::__init__::225::IOProcess::(_processLogs) (540775) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:56,796::__init__::225::IOProcess::(_processLogs) (540775) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:56,797::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540775) Building response >Thread-19::DEBUG::2014-08-11 17:18:56,797::__init__::225::IOProcess::(_processLogs) (540775) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:56,798::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:18:56,798::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:18:56,798::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:18:56,798::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:18:56,798::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) (540776) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) (540776) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) (540776) Building response >Thread-19::DEBUG::2014-08-11 17:18:56,799::__init__::225::IOProcess::(_processLogs) (540776) Queuing response >Thread-19::DEBUG::2014-08-11 17:18:56,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:18:56,800::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:18:56,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0667564 s, 15.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:18:57,314::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:18:58,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:18:58,921::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:58,921::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:58,923::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:58,924::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:18:58,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:18:58,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:18:58,938::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180044 s, 56.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:18:59,067::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:18:59,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b6a84e-d263-42ca-9a49-93eecb246ae9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:18:59,067::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:18:59,124::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:59,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`94b6a84e-d263-42ca-9a49-93eecb246ae9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:18:59,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`94b6a84e-d263-42ca-9a49-93eecb246ae9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:18:59,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:18:59,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:18:59,125::task::993::Storage.TaskManager.Task::(_decref) Task=`94b6a84e-d263-42ca-9a49-93eecb246ae9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:18:59,136::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:18:59,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`308c21ed-55bb-46be-bc8b-b519bab6820d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:18:59,136::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:18:59,136::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cde5b248-7240-4739-a51b-61b25a3c900c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:18:59,136::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:18:59,137::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:18:59,137::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cde5b248-7240-4739-a51b-61b25a3c900c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:18:59,137::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`308c21ed-55bb-46be-bc8b-b519bab6820d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:18:59,137::task::993::Storage.TaskManager.Task::(_decref) Task=`308c21ed-55bb-46be-bc8b-b519bab6820d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:18:59,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:59,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`308c21ed-55bb-46be-bc8b-b519bab6820d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:18:59,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`308c21ed-55bb-46be-bc8b-b519bab6820d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:18:59,163::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:18:59,163::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:18:59,163::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:18:59,163::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:18:59,164::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:18:59,164::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:18:59,164::task::993::Storage.TaskManager.Task::(_decref) Task=`308c21ed-55bb-46be-bc8b-b519bab6820d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:18:59,416::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:19:00,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:01,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125498 s, 81.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:19:02,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5058bd3-6a3f-4c3d-96d0-9410bd59ab0a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:02,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:19:02,364::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708905', 'lastCheck': '8.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00551619', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:02,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`f5058bd3-6a3f-4c3d-96d0-9410bd59ab0a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000708905', 'lastCheck': '8.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00551619', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:02,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`f5058bd3-6a3f-4c3d-96d0-9410bd59ab0a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:02,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:02,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:02,367::task::993::Storage.TaskManager.Task::(_decref) Task=`f5058bd3-6a3f-4c3d-96d0-9410bd59ab0a`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:19:02,399::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:02,403::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:19:03,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:03,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0502175 s, 20.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) (540777) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) (540777) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:03,893::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540777) Building response >Thread-27::DEBUG::2014-08-11 17:19:03,894::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:19:03,894::__init__::225::IOProcess::(_processLogs) (540777) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:03,953::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:03,956::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:19:03,957::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00179743 s, 204 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:19:03,957::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:03,957::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:03,959::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:03,960::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:03,961::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:19:03,962::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:03,962::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:03,962::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:03,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:03,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:03,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:19:03,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:03,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:03,966::__init__::225::IOProcess::(_processLogs) (540778) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:03,967::__init__::225::IOProcess::(_processLogs) (540778) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:03,969::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540778) Building response >Thread-19::DEBUG::2014-08-11 17:19:03,969::__init__::225::IOProcess::(_processLogs) (540778) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:03,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:03,970::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:19:05,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:05,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0450757 s, 22.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:06,799::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) (540779) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) (540779) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540779) Building response >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) (540779) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:06,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:06,801::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:19:06,801::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:19:06,860::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000372824 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) (540780) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:06,861::__init__::225::IOProcess::(_processLogs) (540780) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:06,862::__init__::225::IOProcess::(_processLogs) (540780) Building response >Thread-19::DEBUG::2014-08-11 17:19:06,862::__init__::225::IOProcess::(_processLogs) (540780) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:06,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:06,862::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:06,863::__init__::225::IOProcess::(_processLogs) (540781) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) (540781) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) (540781) Building response >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) (540781) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:06,864::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) (540782) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) (540782) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) (540782) Building response >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) (540782) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:06,865::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:06,866::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:19:06,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:06,866::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:06,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) (540783) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) (540783) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) (540783) Building response >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) (540783) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:06,867::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:19:07,039::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:07,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:07,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122695 s, 83.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:19:08,969::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:08,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:08,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:08,974::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:08,974::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:08,975::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:09,205::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:19:09,205::task::595::Storage.TaskManager.Task::(_updateState) Task=`43c2ae81-a08a-4466-9905-d4747c8fbabd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:09,205::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:19:09,241::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:09,241::task::1191::Storage.TaskManager.Task::(prepare) Task=`43c2ae81-a08a-4466-9905-d4747c8fbabd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:09,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`43c2ae81-a08a-4466-9905-d4747c8fbabd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:09,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:09,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:09,241::task::993::Storage.TaskManager.Task::(_decref) Task=`43c2ae81-a08a-4466-9905-d4747c8fbabd`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:19:09,253::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:19:09,253::task::595::Storage.TaskManager.Task::(_updateState) Task=`6584315f-fa62-4824-9de1-6b64f43319bf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:19:09,253::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:19:09,254::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`59d0d949-e286-4cd8-83ed-fa536544fa92`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:19:09,254::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:19:09,254::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:19:09,254::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`59d0d949-e286-4cd8-83ed-fa536544fa92`::Granted request >Thread-10197::DEBUG::2014-08-11 17:19:09,254::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6584315f-fa62-4824-9de1-6b64f43319bf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:19:09,254::task::993::Storage.TaskManager.Task::(_decref) Task=`6584315f-fa62-4824-9de1-6b64f43319bf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:19:09,270::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:09,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`6584315f-fa62-4824-9de1-6b64f43319bf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:09,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`6584315f-fa62-4824-9de1-6b64f43319bf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:19:09,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:19:09,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:19:09,271::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:19:09,271::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:19:09,271::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:19:09,271::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:19:09,271::task::993::Storage.TaskManager.Task::(_decref) Task=`6584315f-fa62-4824-9de1-6b64f43319bf`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:19:09,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:09,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123815 s, 82.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:19:11,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:11,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220138 s, 46.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:19:12,321::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:13,500::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:13,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047044 s, 21.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:13,970::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:13,970::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:13,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:13,970::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:13,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) (540784) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) (540784) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540784) Building response >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) (540784) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:13,971::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:19:13,972::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:19:13,972::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:19:14,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:14,033::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:14,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:14,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:14,037::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:14,038::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:19:14,041::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00834542 s, 43.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:14,041::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:14,041::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:14,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:14,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:14,041::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:14,041::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:14,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:14,042::__init__::225::IOProcess::(_processLogs) (540785) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:14,042::__init__::225::IOProcess::(_processLogs) (540785) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:14,044::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540785) Building response >Thread-19::DEBUG::2014-08-11 17:19:14,044::__init__::225::IOProcess::(_processLogs) (540785) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:14,044::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:19:14,044::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:19:15,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:15,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552655 s, 18.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:16,867::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:16,867::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:16,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:16,867::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:16,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:16,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) (540786) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) (540786) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540786) Building response >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) (540786) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:16,868::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:19:16,869::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:19:16,928::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00070069 s, 706 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:16,928::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) (540787) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) (540787) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:16,929::__init__::225::IOProcess::(_processLogs) (540787) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:16,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:16,930::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:19:16,930::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:19:16,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) (540788) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) (540788) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) (540788) Building response >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) (540788) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:16,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:16,932::__init__::225::IOProcess::(_processLogs) (540789) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) (540789) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) (540789) Building response >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) (540789) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:16,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:16,934::__init__::225::IOProcess::(_processLogs) (540790) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:16,934::__init__::225::IOProcess::(_processLogs) (540790) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:16,934::__init__::225::IOProcess::(_processLogs) (540790) Building response >Thread-19::DEBUG::2014-08-11 17:19:16,934::__init__::225::IOProcess::(_processLogs) (540790) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:16,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:16,934::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:19:17,475::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:19:17,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f4e9605-e2d3-4448-b4e9-b6cc5ce06526`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:17,708::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:19:17,709::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00834542', 'lastCheck': '3.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070069', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:17,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f4e9605-e2d3-4448-b4e9-b6cc5ce06526`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00834542', 'lastCheck': '3.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00070069', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:17,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f4e9605-e2d3-4448-b4e9-b6cc5ce06526`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:17,709::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:17,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:17,709::task::993::Storage.TaskManager.Task::(_decref) Task=`8f4e9605-e2d3-4448-b4e9-b6cc5ce06526`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:19:17,727::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:17,728::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:19:17,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:17,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282755 s, 36.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:19:19,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:19,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:19,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:19,044::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:19,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:19,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:19,351::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:19:19,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`5df28c8e-374e-4efe-89ae-a3f3c6a4c882`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:19,352::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:19:19,391::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:19,392::task::1191::Storage.TaskManager.Task::(prepare) Task=`5df28c8e-374e-4efe-89ae-a3f3c6a4c882`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:19,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`5df28c8e-374e-4efe-89ae-a3f3c6a4c882`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:19,392::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:19,392::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:19,392::task::993::Storage.TaskManager.Task::(_decref) Task=`5df28c8e-374e-4efe-89ae-a3f3c6a4c882`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:19:19,399::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:19:19,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ea86dc8-4d91-4318-a093-fbc134d32caa`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:19:19,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:19:19,401::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`92c6163e-ea6e-43b4-af9b-3e91a3e5dd3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:19:19,401::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:19:19,401::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:19:19,401::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`92c6163e-ea6e-43b4-af9b-3e91a3e5dd3f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:19:19,401::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8ea86dc8-4d91-4318-a093-fbc134d32caa`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:19:19,401::task::993::Storage.TaskManager.Task::(_decref) Task=`8ea86dc8-4d91-4318-a093-fbc134d32caa`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:19:19,418::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:19,418::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ea86dc8-4d91-4318-a093-fbc134d32caa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:19,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ea86dc8-4d91-4318-a093-fbc134d32caa`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:19:19,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:19:19,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:19:19,418::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:19:19,418::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:19:19,418::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:19:19,418::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:19:19,419::task::993::Storage.TaskManager.Task::(_decref) Task=`8ea86dc8-4d91-4318-a093-fbc134d32caa`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:19:19,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:19,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525962 s, 19.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:19:21,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:22,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256246 s, 40.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:19:22,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5f3a130-2da8-4a06-ac5e-0ec04a7c202d`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:19:22,042::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:19:22,043::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:19:22,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:22,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:22,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:22,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:22,046::__init__::225::IOProcess::(_processLogs) (540791) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:19:22,047::__init__::225::IOProcess::(_processLogs) (540791) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:19:22,048::__init__::225::IOProcess::(_processLogs) (540791) Building response >Thread-19::DEBUG::2014-08-11 17:19:22,048::__init__::225::IOProcess::(_processLogs) (540791) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:22,049::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:22,049::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:19:22,050::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:19:22,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:22,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:22,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:22,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:22,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:22,053::__init__::225::IOProcess::(_processLogs) (540792) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:19:22,053::__init__::225::IOProcess::(_processLogs) (540792) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:19:22,054::__init__::225::IOProcess::(_processLogs) (540792) Queuing response >Thread-10017::INFO::2014-08-11 17:19:22,054::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:19:22,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:19:22,056::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5f3a130-2da8-4a06-ac5e-0ec04a7c202d`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:19:22,056::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:19:22,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5f3a130-2da8-4a06-ac5e-0ec04a7c202d`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:19:22,057::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:19:22,057::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10017::DEBUG::2014-08-11 17:19:22,058::task::993::Storage.TaskManager.Task::(_decref) Task=`a5f3a130-2da8-4a06-ac5e-0ec04a7c202d`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:19:22,078::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:19:24,045::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:24,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) (540793) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) (540793) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:24,046::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540793) Building response >Thread-27::DEBUG::2014-08-11 17:19:24,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:19:24,047::__init__::225::IOProcess::(_processLogs) (540793) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:24,108::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:19:24,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:19:24,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:19:24,111::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000711482 s, 514 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:24,111::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:24,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:24,173::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:24,174::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:24,175::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:19:24,176::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:24,176::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:24,177::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:24,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:24,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:24,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:24,180::__init__::225::IOProcess::(_processLogs) (540794) Finding callback 'statvfs'... >GuestMonitor-vm::DEBUG::2014-08-11 17:19:24,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:24,181::__init__::225::IOProcess::(_processLogs) (540794) Got request for method 'statvfs' >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:24,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:24,183::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540794) Building response >Thread-19::DEBUG::2014-08-11 17:19:24,185::__init__::225::IOProcess::(_processLogs) (540794) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:24,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:24,186::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:19:24,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0555911 s, 18.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:19:26,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:26,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0315352 s, 32.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) (540795) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) (540795) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:26,935::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540795) Building response >Thread-19::DEBUG::2014-08-11 17:19:26,936::__init__::225::IOProcess::(_processLogs) (540795) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:26,936::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:19:26,936::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:19:26,936::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:19:26,995::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000422906 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:26,996::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:26,996::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:26,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:26,996::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:26,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:26,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:26,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:26,997::__init__::225::IOProcess::(_processLogs) (540796) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:26,997::__init__::225::IOProcess::(_processLogs) (540796) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:26,997::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540796) Building response >Thread-19::DEBUG::2014-08-11 17:19:26,998::__init__::225::IOProcess::(_processLogs) (540796) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:26,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:26,998::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:19:26,998::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:26,998::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:19:26,998::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) (540797) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) (540797) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) (540797) Building response >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) (540797) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:26,999::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) (540798) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:27,000::__init__::225::IOProcess::(_processLogs) (540798) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) (540798) Building response >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) (540798) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:27,001::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) (540799) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) (540799) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) (540799) Building response >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) (540799) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:27,002::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:19:27,329::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:28,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:28,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481101 s, 21.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:19:29,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:29,190::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:29,190::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:29,191::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:29,191::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:29,192::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:29,461::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:19:29,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fe0139e-4630-446e-8e1b-08a8a348ce20`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:29,462::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:19:29,476::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:29,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`5fe0139e-4630-446e-8e1b-08a8a348ce20`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:29,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`5fe0139e-4630-446e-8e1b-08a8a348ce20`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:29,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:29,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:29,477::task::993::Storage.TaskManager.Task::(_decref) Task=`5fe0139e-4630-446e-8e1b-08a8a348ce20`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:19:29,484::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:19:29,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`415d16e5-03d9-49f5-b1cf-26217e4e6e2c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:19:29,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:19:29,485::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2e84eea3-1d8a-4bb2-b1ef-15a2ec7f0651`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:19:29,485::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:19:29,485::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:19:29,485::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2e84eea3-1d8a-4bb2-b1ef-15a2ec7f0651`::Granted request >Thread-10197::DEBUG::2014-08-11 17:19:29,485::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`415d16e5-03d9-49f5-b1cf-26217e4e6e2c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:19:29,485::task::993::Storage.TaskManager.Task::(_decref) Task=`415d16e5-03d9-49f5-b1cf-26217e4e6e2c`::ref 1 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:19:29,487::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10197::INFO::2014-08-11 17:19:29,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:29,509::task::1191::Storage.TaskManager.Task::(prepare) Task=`415d16e5-03d9-49f5-b1cf-26217e4e6e2c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:29,509::task::595::Storage.TaskManager.Task::(_updateState) Task=`415d16e5-03d9-49f5-b1cf-26217e4e6e2c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:19:29,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:19:29,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:19:29,509::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:19:29,509::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:19:29,509::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:19:29,509::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:19:29,509::task::993::Storage.TaskManager.Task::(_decref) Task=`415d16e5-03d9-49f5-b1cf-26217e4e6e2c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:19:30,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:30,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378253 s, 27.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:19:32,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:32,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476109 s, 21.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:19:32,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f85e384-f9df-44cc-ac20-790135e7b0d9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:32,953::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:19:32,953::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711482', 'lastCheck': '8.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422906', 'lastCheck': '6.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:32,953::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f85e384-f9df-44cc-ac20-790135e7b0d9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000711482', 'lastCheck': '8.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000422906', 'lastCheck': '6.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:32,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f85e384-f9df-44cc-ac20-790135e7b0d9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:32,953::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:32,953::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:32,953::task::993::Storage.TaskManager.Task::(_decref) Task=`6f85e384-f9df-44cc-ac20-790135e7b0d9`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:19:32,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:32,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:34,185::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:34,185::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:34,185::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:34,185::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:34,185::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:34,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:34,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:34,186::__init__::225::IOProcess::(_processLogs) (540800) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:34,186::__init__::225::IOProcess::(_processLogs) (540800) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:34,186::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(540800) Building response >Thread-19::DEBUG::2014-08-11 17:19:34,186::__init__::225::IOProcess::(_processLogs) (540800) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:34,186::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:19:34,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:19:34,187::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:19:34,249::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:34,250::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:34,254::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:19:34,256::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00476554 s, 76.8 kB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:34,257::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:34,259::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:34,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:19:34,262::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:34,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:34,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:34,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:34,267::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:34,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:34,269::__init__::225::IOProcess::(_processLogs) (540801) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:34,269::__init__::225::IOProcess::(_processLogs) (540801) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:34,279::__init__::225::IOProcess::(_processLogs) (540801) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:34,280::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:19:34,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:34,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176156 s, 58.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:19:36,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:36,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0761243 s, 13.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:37,002::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) (540802) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) (540802) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:37,003::__init__::225::IOProcess::(_processLogs) DEBUG|(540802) Building response >Thread-19::DEBUG::2014-08-11 17:19:37,004::__init__::225::IOProcess::(_processLogs) (540802) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:37,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:37,004::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:19:37,004::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:19:37,065::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00133793 s, 370 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:37,065::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:37,065::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:37,065::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) (540803) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) (540803) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:37,066::__init__::225::IOProcess::(_processLogs) DEBUG|(540803) Building response >Thread-19::DEBUG::2014-08-11 17:19:37,067::__init__::225::IOProcess::(_processLogs) (540803) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:37,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:37,067::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:19:37,067::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:37,067::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:19:37,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) (540804) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) (540804) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) (540804) Building response >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) (540804) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:37,068::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:37,069::__init__::225::IOProcess::(_processLogs) (540805) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) (540805) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) (540805) Building response >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) (540805) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:37,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:37,071::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:37,071::__init__::225::IOProcess::(_processLogs) (540806) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:37,071::__init__::225::IOProcess::(_processLogs) (540806) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:37,071::__init__::225::IOProcess::(_processLogs) DEBUG|(540806) Building response >Thread-19::DEBUG::2014-08-11 17:19:37,071::__init__::225::IOProcess::(_processLogs) (540806) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:37,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:37,072::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:19:37,116::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:38,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:39,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501133 s, 20.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:39,270::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:39,270::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:39,270::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:39,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:39,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:39,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:39,591::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:19:39,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`a57c69db-c458-4cdf-96ce-9b5636b44ded`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:39,591::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:19:39,622::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:39,622::task::1191::Storage.TaskManager.Task::(prepare) Task=`a57c69db-c458-4cdf-96ce-9b5636b44ded`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:39,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`a57c69db-c458-4cdf-96ce-9b5636b44ded`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:39,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:39,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:39,623::task::993::Storage.TaskManager.Task::(_decref) Task=`a57c69db-c458-4cdf-96ce-9b5636b44ded`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:19:39,635::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:19:39,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`e702d3d8-07ea-4a5b-b9a9-b4b7c1fef825`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:19:39,635::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:19:39,636::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b291e29f-1145-460d-b891-bc9c71377122`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:19:39,636::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:19:39,636::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:19:39,636::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b291e29f-1145-460d-b891-bc9c71377122`::Granted request >Thread-10197::DEBUG::2014-08-11 17:19:39,636::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e702d3d8-07ea-4a5b-b9a9-b4b7c1fef825`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:19:39,636::task::993::Storage.TaskManager.Task::(_decref) Task=`e702d3d8-07ea-4a5b-b9a9-b4b7c1fef825`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:19:39,654::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:39,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`e702d3d8-07ea-4a5b-b9a9-b4b7c1fef825`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:39,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`e702d3d8-07ea-4a5b-b9a9-b4b7c1fef825`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:19:39,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:19:39,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:19:39,654::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:19:39,654::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:19:39,654::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:19:39,654::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:19:39,654::task::993::Storage.TaskManager.Task::(_decref) Task=`e702d3d8-07ea-4a5b-b9a9-b4b7c1fef825`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:19:41,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:41,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254921 s, 40.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:19:42,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`6608f24e-eb40-4aec-aa5e-6839a3117c01`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:19:42,331::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) (540807) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:19:42,332::__init__::225::IOProcess::(_processLogs) (540807) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) DEBUG|(540807) Building response >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) (540807) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:19:42,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:42,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::INFO::2014-08-11 17:19:42,334::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:19:42,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:19:42,334::task::1191::Storage.TaskManager.Task::(prepare) Task=`6608f24e-eb40-4aec-aa5e-6839a3117c01`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:19:42,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:19:42,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`6608f24e-eb40-4aec-aa5e-6839a3117c01`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:19:42,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:19:42,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:19:42,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:19:42,336::__init__::225::IOProcess::(_processLogs) (540808) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:19:42,336::task::993::Storage.TaskManager.Task::(_decref) Task=`6608f24e-eb40-4aec-aa5e-6839a3117c01`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:19:42,336::__init__::225::IOProcess::(_processLogs) (540808) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:19:42,337::__init__::225::IOProcess::(_processLogs) (540808) Building response >Thread-19::DEBUG::2014-08-11 17:19:42,337::__init__::225::IOProcess::(_processLogs) (540808) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:42,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:42,337::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:19:42,358::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:43,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:43,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050966 s, 20.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:44,276::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:44,277::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:44,277::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:44,278::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:44,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:44,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:44,281::__init__::225::IOProcess::(_processLogs) (540809) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:44,282::__init__::225::IOProcess::(_processLogs) (540809) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:44,282::__init__::225::IOProcess::(_processLogs) DEBUG|(540809) Building response >Thread-27::DEBUG::2014-08-11 17:19:44,282::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:19:44,282::__init__::225::IOProcess::(_processLogs) (540809) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:44,342::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:44,344::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:19:44,344::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000319491 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:44,346::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:44,347::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:44,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:44,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:44,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:44,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:44,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:44,350::__init__::225::IOProcess::(_processLogs) (540810) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:44,350::__init__::225::IOProcess::(_processLogs) (540810) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:44,351::__init__::225::IOProcess::(_processLogs) DEBUG|(540810) Building response >Thread-19::DEBUG::2014-08-11 17:19:44,352::__init__::225::IOProcess::(_processLogs) (540810) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:44,353::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:44,354::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:19:45,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:45,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373687 s, 27.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:47,072::__init__::225::IOProcess::(_processLogs) (540811) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:47,073::__init__::225::IOProcess::(_processLogs) (540811) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:47,073::__init__::225::IOProcess::(_processLogs) DEBUG|(540811) Building response >Thread-19::DEBUG::2014-08-11 17:19:47,073::__init__::225::IOProcess::(_processLogs) (540811) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:47,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:47,074::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:19:47,074::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:19:47,134::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000314707 s, 1.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:47,134::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:47,134::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:47,134::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) (540812) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) (540812) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:47,135::__init__::225::IOProcess::(_processLogs) DEBUG|(540812) Building response >Thread-19::DEBUG::2014-08-11 17:19:47,136::__init__::225::IOProcess::(_processLogs) (540812) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:47,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:47,136::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:19:47,136::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:19:47,136::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:19:47,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) (540813) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) (540813) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) (540813) Building response >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) (540813) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:47,137::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) (540814) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) (540814) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) (540814) Building response >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) (540814) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:47,138::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:47,139::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:19:47,139::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:47,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:47,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:47,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:47,140::__init__::225::IOProcess::(_processLogs) (540815) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:47,140::__init__::225::IOProcess::(_processLogs) (540815) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:47,140::__init__::225::IOProcess::(_processLogs) (540815) Building response >Thread-19::DEBUG::2014-08-11 17:19:47,140::__init__::225::IOProcess::(_processLogs) (540815) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:47,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:47,140::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:19:47,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:47,471::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0739199 s, 13.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:19:47,523::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:19:48,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`e473847c-84fa-4f6c-bb82-5c0d016848db`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:48,305::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:19:48,305::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319491', 'lastCheck': '4.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314707', 'lastCheck': '1.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:48,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`e473847c-84fa-4f6c-bb82-5c0d016848db`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000319491', 'lastCheck': '4.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314707', 'lastCheck': '1.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:19:48,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`e473847c-84fa-4f6c-bb82-5c0d016848db`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:48,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:48,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:48,306::task::993::Storage.TaskManager.Task::(_decref) Task=`e473847c-84fa-4f6c-bb82-5c0d016848db`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:19:48,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:19:48,325::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:49,283::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:49,283::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:49,284::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:49,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:49,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:49,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:19:49,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:49,551::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126971 s, 80.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:19:49,720::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:19:49,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c74048f-0fa5-4bdd-b7bb-34214d983af0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:49,720::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:19:49,770::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:49,771::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c74048f-0fa5-4bdd-b7bb-34214d983af0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:49,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c74048f-0fa5-4bdd-b7bb-34214d983af0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:49,771::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:49,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:49,771::task::993::Storage.TaskManager.Task::(_decref) Task=`2c74048f-0fa5-4bdd-b7bb-34214d983af0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:19:49,783::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:19:49,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b2b1f7f-f0af-4293-95ee-df280a6ccf97`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:19:49,783::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:19:49,783::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2fae7789-8437-4cbc-b8fc-c43b13d07362`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:19:49,784::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:19:49,784::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:19:49,784::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2fae7789-8437-4cbc-b8fc-c43b13d07362`::Granted request >Thread-10197::DEBUG::2014-08-11 17:19:49,784::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9b2b1f7f-f0af-4293-95ee-df280a6ccf97`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:19:49,784::task::993::Storage.TaskManager.Task::(_decref) Task=`9b2b1f7f-f0af-4293-95ee-df280a6ccf97`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:19:49,800::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:49,800::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b2b1f7f-f0af-4293-95ee-df280a6ccf97`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:49,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b2b1f7f-f0af-4293-95ee-df280a6ccf97`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:19:49,801::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:19:49,801::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:19:49,801::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:19:49,801::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:19:49,801::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:19:49,801::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:19:49,801::task::993::Storage.TaskManager.Task::(_decref) Task=`9b2b1f7f-f0af-4293-95ee-df280a6ccf97`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:19:51,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:51,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584244 s, 17.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:19:52,124::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:53,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:53,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028506 s, 35.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:54,290::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:54,290::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:54,290::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:54,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:54,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:54,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) (540816) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:54,353::__init__::225::IOProcess::(_processLogs) (540816) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:54,354::__init__::225::IOProcess::(_processLogs) (540816) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:54,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:19:54,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:19:54,414::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00105158 s, 348 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:54,416::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:54,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:54,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:54,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:54,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:54,420::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:54,420::__init__::225::IOProcess::(_processLogs) (540817) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:54,421::__init__::225::IOProcess::(_processLogs) (540817) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:54,423::__init__::225::IOProcess::(_processLogs) (540817) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:54,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:54,425::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:19:55,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:55,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035635 s, 28.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) (540818) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:57,140::__init__::225::IOProcess::(_processLogs) (540818) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:57,141::__init__::225::IOProcess::(_processLogs) (540818) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:57,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:19:57,141::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:19:57,206::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00220309 s, 225 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) (540819) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:19:57,207::__init__::225::IOProcess::(_processLogs) (540819) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:19:57,208::__init__::225::IOProcess::(_processLogs) (540819) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:57,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) (540820) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:57,209::__init__::225::IOProcess::(_processLogs) (540820) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:57,212::__init__::225::IOProcess::(_processLogs) (540820) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:57,212::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) (540821) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:57,213::__init__::225::IOProcess::(_processLogs) (540821) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:57,215::__init__::225::IOProcess::(_processLogs) (540821) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:57,215::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:19:57,216::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:19:57,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:19:57,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) (540822) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) (540822) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) (540822) Building response >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) (540822) Queuing response >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:19:57,217::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:19:57,419::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:19:57,894::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:19:57,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456889 s, 22.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:59,295::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:59,295::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:19:59,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:59,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:59,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:19:59,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:19:59,546::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:19:59,876::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:19:59,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd473b6a-3dca-4497-866a-fdf3b476641d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:19:59,876::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:19:59,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:59,928::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd473b6a-3dca-4497-866a-fdf3b476641d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:19:59,928::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd473b6a-3dca-4497-866a-fdf3b476641d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:19:59,928::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:19:59,928::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:19:59,928::task::993::Storage.TaskManager.Task::(_decref) Task=`fd473b6a-3dca-4497-866a-fdf3b476641d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:19:59,939::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:19:59,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd307184-dc5c-457c-94ac-9b5193ca4718`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:19:59,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:19:59,940::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bf97a603-c891-4f22-81b7-2e6416f78548`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:19:59,940::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:19:59,940::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:19:59,940::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bf97a603-c891-4f22-81b7-2e6416f78548`::Granted request >Thread-10197::DEBUG::2014-08-11 17:19:59,940::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`dd307184-dc5c-457c-94ac-9b5193ca4718`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:19:59,940::task::993::Storage.TaskManager.Task::(_decref) Task=`dd307184-dc5c-457c-94ac-9b5193ca4718`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:19:59,968::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:59,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd307184-dc5c-457c-94ac-9b5193ca4718`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:19:59,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd307184-dc5c-457c-94ac-9b5193ca4718`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:19:59,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:19:59,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:19:59,969::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:19:59,969::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:19:59,969::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:19:59,969::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:19:59,969::task::993::Storage.TaskManager.Task::(_decref) Task=`dd307184-dc5c-457c-94ac-9b5193ca4718`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:20:00,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:00,100::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0341905 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:20:02,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:02,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0183648 s, 55.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:20:03,515::task::595::Storage.TaskManager.Task::(_updateState) Task=`194a0a4b-9421-4fdd-9aa1-0586c08cad36`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:03,515::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:20:03,515::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105158', 'lastCheck': '9.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00220309', 'lastCheck': '6.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:03,515::task::1191::Storage.TaskManager.Task::(prepare) Task=`194a0a4b-9421-4fdd-9aa1-0586c08cad36`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105158', 'lastCheck': '9.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00220309', 'lastCheck': '6.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:03,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`194a0a4b-9421-4fdd-9aa1-0586c08cad36`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:03,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:03,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:03,516::task::993::Storage.TaskManager.Task::(_decref) Task=`194a0a4b-9421-4fdd-9aa1-0586c08cad36`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:20:03,528::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:20:03,529::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:04,264::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:04,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:04,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:04,328::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:04,329::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:04,332::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:04,333::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:04,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146893 s, 69.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:04,424::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:04,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:04,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:04,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:04,424::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:04,424::__init__::225::IOProcess::(_processLogs) (540823) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:04,425::__init__::225::IOProcess::(_processLogs) (540823) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:04,425::__init__::225::IOProcess::(_processLogs) (540823) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:04,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:20:04,425::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:04,426::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:20:04,485::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000378161 s, 968 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:04,487::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:04,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:04,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:04,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:04,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:04,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:04,490::__init__::225::IOProcess::(_processLogs) (540824) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:04,490::__init__::225::IOProcess::(_processLogs) (540824) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:04,492::__init__::225::IOProcess::(_processLogs) (540824) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:04,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:04,495::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:20:06,345::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:06,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442488 s, 23.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:20:07,173::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:20:07,217::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:07,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:07,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:07,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:07,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:07,217::__init__::225::IOProcess::(_processLogs) (540825) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:07,218::__init__::225::IOProcess::(_processLogs) (540825) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:07,218::__init__::225::IOProcess::(_processLogs) (540825) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:07,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:20:07,218::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:20:07,278::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00103341 s, 479 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) (540826) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:07,279::__init__::225::IOProcess::(_processLogs) (540826) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:07,280::__init__::225::IOProcess::(_processLogs) DEBUG|(540826) Building response >Thread-19::DEBUG::2014-08-11 17:20:07,280::__init__::225::IOProcess::(_processLogs) (540826) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:07,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:07,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) (540827) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) (540827) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) (540827) Building response >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) (540827) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:20:07,282::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) (540828) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) (540828) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) (540828) Building response >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) (540828) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:07,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:07,284::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:07,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:07,284::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:20:07,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:07,284::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:07,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) (540829) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) (540829) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) (540829) Building response >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) (540829) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:07,285::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:20:08,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:08,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.023068 s, 44.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:09,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:09,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:09,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:09,341::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:09,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:09,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:20:10,005::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:20:10,005::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb19038-5ec3-433c-9ac0-5be000a8b166`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:10,005::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:20:10,065::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:10,065::task::1191::Storage.TaskManager.Task::(prepare) Task=`3eb19038-5ec3-433c-9ac0-5be000a8b166`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:10,065::task::595::Storage.TaskManager.Task::(_updateState) Task=`3eb19038-5ec3-433c-9ac0-5be000a8b166`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:10,065::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:10,065::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:10,065::task::993::Storage.TaskManager.Task::(_decref) Task=`3eb19038-5ec3-433c-9ac0-5be000a8b166`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:20:10,077::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:20:10,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed69aac5-5603-4b44-a05e-6652fec6c119`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:20:10,077::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:20:10,077::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`61e9ebfa-0a8c-404e-a7b4-132697661789`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:20:10,077::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:20:10,077::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:20:10,078::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`61e9ebfa-0a8c-404e-a7b4-132697661789`::Granted request >Thread-10197::DEBUG::2014-08-11 17:20:10,078::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ed69aac5-5603-4b44-a05e-6652fec6c119`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:20:10,078::task::993::Storage.TaskManager.Task::(_decref) Task=`ed69aac5-5603-4b44-a05e-6652fec6c119`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:20:10,278::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:10,278::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed69aac5-5603-4b44-a05e-6652fec6c119`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:10,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed69aac5-5603-4b44-a05e-6652fec6c119`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:20:10,278::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:20:10,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:20:10,279::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:20:10,279::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:20:10,279::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:20:10,279::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:20:10,279::task::993::Storage.TaskManager.Task::(_decref) Task=`ed69aac5-5603-4b44-a05e-6652fec6c119`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:20:10,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:10,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124289 s, 82.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:20:12,427::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:20:12,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:12,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463838 s, 22.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:14,347::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:14,348::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:14,351::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:14,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:14,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:14,355::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:20:14,495::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:14,495::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:14,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:14,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:14,495::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:14,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:14,496::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:14,496::__init__::225::IOProcess::(_processLogs) (540830) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:14,496::__init__::225::IOProcess::(_processLogs) (540830) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:14,497::__init__::225::IOProcess::(_processLogs) DEBUG|(540830) Building response >Thread-19::DEBUG::2014-08-11 17:20:14,497::__init__::225::IOProcess::(_processLogs) (540830) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:14,497::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:20:14,498::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:20:14,498::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:20:14,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00219153 s, 167 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:14,561::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:14,562::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:14,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:14,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:14,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:14,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:14,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:14,563::__init__::225::IOProcess::(_processLogs) (540831) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:14,563::__init__::225::IOProcess::(_processLogs) (540831) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:14,563::__init__::225::IOProcess::(_processLogs) DEBUG|(540831) Building response >Thread-19::DEBUG::2014-08-11 17:20:14,563::__init__::225::IOProcess::(_processLogs) (540831) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:14,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:14,564::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:20:14,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:14,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424657 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:20:16,846::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:16,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0391867 s, 26.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:17,285::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:17,285::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:17,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:17,285::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:17,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:17,286::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:17,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:17,286::__init__::225::IOProcess::(_processLogs) (540832) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:17,286::__init__::225::IOProcess::(_processLogs) (540832) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:17,286::__init__::225::IOProcess::(_processLogs) DEBUG|(540832) Building response >Thread-28::DEBUG::2014-08-11 17:20:17,287::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:17,287::__init__::225::IOProcess::(_processLogs) (540832) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:17,345::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:17,345::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:20:17,346::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000326261 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:17,346::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:17,346::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:17,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:17,346::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:17,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:17,347::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:17,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:17,347::__init__::225::IOProcess::(_processLogs) (540833) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:17,347::__init__::225::IOProcess::(_processLogs) (540833) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:17,347::__init__::225::IOProcess::(_processLogs) DEBUG|(540833) Building response >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) (540833) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:17,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) (540834) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) (540834) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) (540834) Building response >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) (540834) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:17,349::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:17,350::__init__::225::IOProcess::(_processLogs) (540835) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) (540835) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) (540835) Building response >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) (540835) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:17,351::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) (540836) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) (540836) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) (540836) Building response >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) (540836) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:17,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:17,353::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:20:17,610::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:20:18,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`e52c291d-c1bb-403c-bf34-a1e7d73f20f4`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:18,741::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:20:18,741::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00219153', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326261', 'lastCheck': '1.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:18,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`e52c291d-c1bb-403c-bf34-a1e7d73f20f4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00219153', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000326261', 'lastCheck': '1.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:18,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`e52c291d-c1bb-403c-bf34-a1e7d73f20f4`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:18,741::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:18,741::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:18,741::task::993::Storage.TaskManager.Task::(_decref) Task=`e52c291d-c1bb-403c-bf34-a1e7d73f20f4`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:20:18,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:20:18,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:18,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:19,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431307 s, 23.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:19,358::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:19,358::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:19,358::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:19,360::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:19,360::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:19,361::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:20:20,333::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:20:20,334::task::595::Storage.TaskManager.Task::(_updateState) Task=`67b226c9-6653-4c20-8234-8ec9d6153122`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:20,334::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:20:20,398::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:20,398::task::1191::Storage.TaskManager.Task::(prepare) Task=`67b226c9-6653-4c20-8234-8ec9d6153122`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:20,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`67b226c9-6653-4c20-8234-8ec9d6153122`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:20,399::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:20,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:20,399::task::993::Storage.TaskManager.Task::(_decref) Task=`67b226c9-6653-4c20-8234-8ec9d6153122`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:20:20,411::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:20:20,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`e382d560-1dde-433f-9232-0844d9595d94`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:20:20,411::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:20:20,413::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`db331f92-1aed-422c-8f11-c11a6d04d2ce`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:20:20,413::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:20:20,413::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:20:20,413::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`db331f92-1aed-422c-8f11-c11a6d04d2ce`::Granted request >Thread-10197::DEBUG::2014-08-11 17:20:20,413::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e382d560-1dde-433f-9232-0844d9595d94`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:20:20,413::task::993::Storage.TaskManager.Task::(_decref) Task=`e382d560-1dde-433f-9232-0844d9595d94`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:20:20,431::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:20,431::task::1191::Storage.TaskManager.Task::(prepare) Task=`e382d560-1dde-433f-9232-0844d9595d94`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:20,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`e382d560-1dde-433f-9232-0844d9595d94`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:20:20,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:20:20,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:20:20,431::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:20:20,432::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:20:20,432::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:20:20,432::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:20:20,432::task::993::Storage.TaskManager.Task::(_decref) Task=`e382d560-1dde-433f-9232-0844d9595d94`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:20:21,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:21,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353738 s, 28.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:20:22,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7545725-d4d6-4a6e-8b56-a53ffa8868f8`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:20:22,176::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:20:22,176::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:22,176::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:20:22,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:22,176::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:22,177::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:22,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:22,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:22,177::__init__::225::IOProcess::(_processLogs) (540837) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:20:22,177::__init__::225::IOProcess::(_processLogs) (540837) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:20:22,180::__init__::225::IOProcess::(_processLogs) DEBUG|(540837) Building response >Thread-19::DEBUG::2014-08-11 17:20:22,180::__init__::225::IOProcess::(_processLogs) (540837) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:22,181::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:20:22,181::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:20:22,181::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:22,181::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:20:22,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:22,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:22,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:22,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:22,182::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-10017::INFO::2014-08-11 17:20:22,182::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:20:22,182::__init__::225::IOProcess::(_processLogs) (540838) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:20:22,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7545725-d4d6-4a6e-8b56-a53ffa8868f8`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:20:22,183::__init__::225::IOProcess::(_processLogs) (540838) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:20:22,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7545725-d4d6-4a6e-8b56-a53ffa8868f8`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:20:22,184::__init__::225::IOProcess::(_processLogs) (540838) Building response >Thread-10017::DEBUG::2014-08-11 17:20:22,184::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:20:22,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:20:22,184::__init__::225::IOProcess::(_processLogs) (540838) Queuing response >Thread-10017::DEBUG::2014-08-11 17:20:22,185::task::993::Storage.TaskManager.Task::(_decref) Task=`d7545725-d4d6-4a6e-8b56-a53ffa8868f8`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:20:22,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:22,185::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:20:22,205::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:20:23,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:23,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523136 s, 19.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:24,364::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:24,365::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:24,365::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:24,366::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:24,367::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:24,367::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:20:24,591::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:24,591::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:24,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:24,592::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:24,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:24,592::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:24,594::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-27::DEBUG::2014-08-11 17:20:24,595::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:24,595::__init__::225::IOProcess::(_processLogs) (540839) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:24,655::__init__::225::IOProcess::(_processLogs) (540839) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:24,656::__init__::225::IOProcess::(_processLogs) (540839) Building response >Thread-19::DEBUG::2014-08-11 17:20:24,657::__init__::225::IOProcess::(_processLogs) (540839) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:24,657::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:20:24,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00161318 s, 227 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:24,659::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:20:24,661::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:24,661::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:24,662::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:24,662::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:24,662::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:24,663::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:24,663::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:24,664::__init__::225::IOProcess::(_processLogs) (540840) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:24,664::__init__::225::IOProcess::(_processLogs) (540840) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:24,664::__init__::225::IOProcess::(_processLogs) DEBUG|(540840) Building response >Thread-19::DEBUG::2014-08-11 17:20:24,665::__init__::225::IOProcess::(_processLogs) (540840) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:24,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:24,665::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:20:25,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:25,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0201376 s, 50.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) (540841) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:27,353::__init__::225::IOProcess::(_processLogs) (540841) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:27,354::__init__::225::IOProcess::(_processLogs) DEBUG|(540841) Building response >Thread-19::DEBUG::2014-08-11 17:20:27,354::__init__::225::IOProcess::(_processLogs) (540841) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:27,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:27,354::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:20:27,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:27,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:20:27,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00272702 s, 182 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:27,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:27,528::__init__::225::IOProcess::(_processLogs) (540842) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:27,529::__init__::225::IOProcess::(_processLogs) (540842) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:27,530::__init__::225::IOProcess::(_processLogs) DEBUG|(540842) Building response >Thread-19::DEBUG::2014-08-11 17:20:27,531::__init__::225::IOProcess::(_processLogs) (540842) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:27,531::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:20:27,531::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:20:27,532::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:27,532::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:20:27,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:27,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:27,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:27,532::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:20:27,533::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:20:27,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) (540843) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) (540843) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) (540843) Building response >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) (540843) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:27,534::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) (540844) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) (540844) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) (540844) Building response >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) (540844) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:27,535::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:27,536::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:27,536::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:20:27,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:27,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:27,536::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:27,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) (540845) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) (540845) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) (540845) Building response >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) (540845) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:27,537::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:20:27,601::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0710676 s, 14.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:29,367::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:29,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:29,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:29,373::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:29,373::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:29,373::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:29,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:20:29,667::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:20:29,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0937182 s, 10.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:20:30,496::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:20:30,496::task::595::Storage.TaskManager.Task::(_updateState) Task=`391ddcf0-0f14-44d1-95bb-7f6b22d5073e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:30,496::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:20:30,588::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:30,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`391ddcf0-0f14-44d1-95bb-7f6b22d5073e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:30,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`391ddcf0-0f14-44d1-95bb-7f6b22d5073e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:30,588::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:30,588::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:30,588::task::993::Storage.TaskManager.Task::(_decref) Task=`391ddcf0-0f14-44d1-95bb-7f6b22d5073e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:20:30,599::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:20:30,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf84935a-e354-421b-a5d4-aacaa9a2e1fc`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:20:30,600::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:20:30,600::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0bdb6826-ddb0-4e57-ac5a-5aa440a0d4a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:20:30,600::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:20:30,600::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:20:30,600::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0bdb6826-ddb0-4e57-ac5a-5aa440a0d4a3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:20:30,601::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bf84935a-e354-421b-a5d4-aacaa9a2e1fc`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:20:30,601::task::993::Storage.TaskManager.Task::(_decref) Task=`bf84935a-e354-421b-a5d4-aacaa9a2e1fc`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:20:30,617::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:30,617::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf84935a-e354-421b-a5d4-aacaa9a2e1fc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:30,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf84935a-e354-421b-a5d4-aacaa9a2e1fc`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:20:30,617::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:20:30,618::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:20:30,618::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:20:30,618::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:20:30,618::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:20:30,618::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:20:30,618::task::993::Storage.TaskManager.Task::(_decref) Task=`bf84935a-e354-421b-a5d4-aacaa9a2e1fc`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:20:31,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:31,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.018171 s, 56.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:20:33,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:20:33,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f26b582-9e9d-46bf-b1c6-83a792f6c701`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:33,989::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:20:33,990::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00161318', 'lastCheck': '9.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272702', 'lastCheck': '6.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:33,990::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f26b582-9e9d-46bf-b1c6-83a792f6c701`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00161318', 'lastCheck': '9.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00272702', 'lastCheck': '6.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:33,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f26b582-9e9d-46bf-b1c6-83a792f6c701`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:33,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:33,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:33,990::task::993::Storage.TaskManager.Task::(_decref) Task=`4f26b582-9e9d-46bf-b1c6-83a792f6c701`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:20:34,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:20:34,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:34,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525706 s, 19.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:34,372::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:34,372::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:34,372::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:34,379::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:34,379::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:34,380::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) (540846) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) (540846) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:34,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540846) Building response >Thread-19::DEBUG::2014-08-11 17:20:34,667::__init__::225::IOProcess::(_processLogs) (540846) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:34,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:34,667::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:20:34,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:20:34,727::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000959229 s, 382 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:34,728::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:34,729::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:34,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:34,730::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:34,730::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:34,730::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:34,730::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:34,731::__init__::225::IOProcess::(_processLogs) (540847) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:34,731::__init__::225::IOProcess::(_processLogs) (540847) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:34,732::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540847) Building response >Thread-19::DEBUG::2014-08-11 17:20:34,734::__init__::225::IOProcess::(_processLogs) (540847) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:34,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:34,735::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:20:36,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:36,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141491 s, 72.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:20:37,213::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:20:37,537::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:37,537::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:37,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:37,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:37,537::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:37,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:37,538::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:37,538::__init__::225::IOProcess::(_processLogs) (540848) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:37,538::__init__::225::IOProcess::(_processLogs) (540848) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:37,539::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540848) Building response >Thread-19::DEBUG::2014-08-11 17:20:37,539::__init__::225::IOProcess::(_processLogs) (540848) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:37,539::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:20:37,540::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:37,540::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:20:37,600::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000611801 s, 809 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) (540849) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:37,601::__init__::225::IOProcess::(_processLogs) (540849) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:37,602::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540849) Building response >Thread-19::DEBUG::2014-08-11 17:20:37,602::__init__::225::IOProcess::(_processLogs) (540849) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:37,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:37,602::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:20:37,602::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) (540850) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) (540850) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:37,603::__init__::225::IOProcess::(_processLogs) (540850) Building response >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) (540850) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:37,604::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) (540851) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) (540851) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) (540851) Building response >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) (540851) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:37,605::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) (540852) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) (540852) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540852) Building response >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) (540852) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:37,606::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:20:37,607::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:20:38,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:38,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0527214 s, 19.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:39,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:39,379::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:39,379::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:39,385::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:39,386::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:39,386::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:40,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:40,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464556 s, 22.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:20:40,684::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:20:40,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`227b98c9-902b-44d4-a0ee-0e7905a4fe69`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:40,684::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:20:40,739::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:40,739::task::1191::Storage.TaskManager.Task::(prepare) Task=`227b98c9-902b-44d4-a0ee-0e7905a4fe69`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:40,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`227b98c9-902b-44d4-a0ee-0e7905a4fe69`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:40,739::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:40,739::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:40,740::task::993::Storage.TaskManager.Task::(_decref) Task=`227b98c9-902b-44d4-a0ee-0e7905a4fe69`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:20:40,746::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:20:40,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc059b6e-d4ad-41b6-a6bc-9d8d57749eaf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:20:40,746::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:20:40,747::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1379f588-f472-445b-bc7f-6362f70fb039`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:20:40,747::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:20:40,747::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:20:40,747::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1379f588-f472-445b-bc7f-6362f70fb039`::Granted request >Thread-10197::DEBUG::2014-08-11 17:20:40,747::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fc059b6e-d4ad-41b6-a6bc-9d8d57749eaf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:20:40,747::task::993::Storage.TaskManager.Task::(_decref) Task=`fc059b6e-d4ad-41b6-a6bc-9d8d57749eaf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:20:40,781::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:40,782::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc059b6e-d4ad-41b6-a6bc-9d8d57749eaf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:40,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc059b6e-d4ad-41b6-a6bc-9d8d57749eaf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:20:40,782::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:20:40,782::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:20:40,782::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:20:40,782::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:20:40,782::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:20:40,782::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:20:40,782::task::993::Storage.TaskManager.Task::(_decref) Task=`fc059b6e-d4ad-41b6-a6bc-9d8d57749eaf`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:20:42,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:42,452::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0445902 s, 23.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:20:42,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b4bb02e-080c-40b5-99c4-18e9b82ed6e7`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:20:42,536::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:20:42,536::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:42,536::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:20:42,536::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:42,536::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:42,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:42,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:42,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:42,537::__init__::225::IOProcess::(_processLogs) (540853) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:20:42,537::__init__::225::IOProcess::(_processLogs) (540853) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:20:42,537::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540853) Building response >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) (540853) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:42,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:20:42,538::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:20:42,539::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:20:42,539::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b4bb02e-080c-40b5-99c4-18e9b82ed6e7`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10102::DEBUG::2014-08-11 17:20:42,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b4bb02e-080c-40b5-99c4-18e9b82ed6e7`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:20:42,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:20:42,540::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:20:42,540::__init__::225::IOProcess::(_processLogs) (540854) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:20:42,540::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:20:42,541::__init__::225::IOProcess::(_processLogs) (540854) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:20:42,541::task::993::Storage.TaskManager.Task::(_decref) Task=`9b4bb02e-080c-40b5-99c4-18e9b82ed6e7`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:20:42,541::__init__::225::IOProcess::(_processLogs) (540854) Building response >Thread-19::DEBUG::2014-08-11 17:20:42,541::__init__::225::IOProcess::(_processLogs) (540854) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:42,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:42,542::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:20:42,563::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:44,385::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:44,385::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:44,385::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:44,392::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:44,392::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:44,392::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:44,459::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:44,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131983 s, 77.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:44,734::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:20:44,734::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:44,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:44,734::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:44,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) (540855) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) (540855) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) DEBUG|(540855) Building response >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) (540855) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:44,735::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:20:44,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:44,736::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:20:44,796::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00119863 s, 305 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:44,798::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:44,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:44,798::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:44,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:44,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:44,801::__init__::225::IOProcess::(_processLogs) (540856) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:44,801::__init__::225::IOProcess::(_processLogs) (540856) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:44,802::__init__::225::IOProcess::(_processLogs) (540856) Building response >Thread-19::DEBUG::2014-08-11 17:20:44,802::__init__::225::IOProcess::(_processLogs) (540856) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:44,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:44,803::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:20:46,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:46,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470791 s, 21.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:47,607::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:47,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:47,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:47,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:47,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:47,608::__init__::225::IOProcess::(_processLogs) (540857) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:47,608::__init__::225::IOProcess::(_processLogs) (540857) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:47,612::__init__::225::IOProcess::(_processLogs) (540857) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:47,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:20:47,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:20:47,673::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0011706 s, 423 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) (540858) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:47,674::__init__::225::IOProcess::(_processLogs) (540858) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:47,675::__init__::225::IOProcess::(_processLogs) (540858) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:47,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:47,675::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:20:47,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) (540859) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) (540859) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) (540859) Building response >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) (540859) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:47,676::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:47,677::__init__::225::IOProcess::(_processLogs) (540860) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) (540860) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) (540860) Building response >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) (540860) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:47,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) (540861) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) (540861) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) (540861) Building response >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) (540861) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:47,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:47,680::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:20:47,739::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:20:48,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:48,744::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251934 s, 40.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:20:49,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c758a39-6789-4651-91a8-cfc57b0fbf8e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:49,252::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:20:49,252::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00119863', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011706', 'lastCheck': '1.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:49,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c758a39-6789-4651-91a8-cfc57b0fbf8e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00119863', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0011706', 'lastCheck': '1.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:20:49,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c758a39-6789-4651-91a8-cfc57b0fbf8e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:49,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:49,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:49,252::task::993::Storage.TaskManager.Task::(_decref) Task=`3c758a39-6789-4651-91a8-cfc57b0fbf8e`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:20:49,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:20:49,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:49,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:49,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:49,392::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:49,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:49,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:49,399::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:20:50,752::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:20:50,819::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:20:50,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7f39ec4-78cb-464a-9389-fcdd513d4509`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:20:50,819::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:20:50,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0673871 s, 15.2 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:20:50,886::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:50,886::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7f39ec4-78cb-464a-9389-fcdd513d4509`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:20:50,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7f39ec4-78cb-464a-9389-fcdd513d4509`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:20:50,886::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:20:50,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:20:50,887::task::993::Storage.TaskManager.Task::(_decref) Task=`d7f39ec4-78cb-464a-9389-fcdd513d4509`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:20:50,899::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:20:50,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5c20f10-ce79-45b5-b4ba-cd75480cbc99`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:20:50,899::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:20:50,899::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9d1ec93b-8e64-4880-94a2-8381df1b5519`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:20:50,899::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:20:50,900::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:20:50,900::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9d1ec93b-8e64-4880-94a2-8381df1b5519`::Granted request >Thread-10197::DEBUG::2014-08-11 17:20:50,900::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d5c20f10-ce79-45b5-b4ba-cd75480cbc99`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:20:50,900::task::993::Storage.TaskManager.Task::(_decref) Task=`d5c20f10-ce79-45b5-b4ba-cd75480cbc99`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:20:50,916::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:50,916::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5c20f10-ce79-45b5-b4ba-cd75480cbc99`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:20:50,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5c20f10-ce79-45b5-b4ba-cd75480cbc99`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:20:50,917::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:20:50,917::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:20:50,917::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:20:50,917::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:20:50,917::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:20:50,917::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:20:50,917::task::993::Storage.TaskManager.Task::(_decref) Task=`d5c20f10-ce79-45b5-b4ba-cd75480cbc99`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:20:52,241::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:20:52,886::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:52,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508965 s, 20.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:54,397::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:54,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:54,398::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:54,404::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:54,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:54,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:20:54,801::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:20:54,802::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) (540862) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) (540862) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:20:54,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) (540863) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) (540863) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) (540862) Building response >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) (540862) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:54,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:54,805::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:20:54,805::__init__::225::IOProcess::(_processLogs) (540863) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:54,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:54,806::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:20:54,810::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) (540864) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:20:54,810::__init__::225::IOProcess::(_processLogs) (540864) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:20:54,825::__init__::225::IOProcess::(_processLogs) (540864) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:54,825::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:20:54,826::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:20:54,826::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:20:54,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:54,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,827::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,827::__init__::225::IOProcess::(_processLogs) (540865) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:20:54,827::__init__::225::IOProcess::(_processLogs) (540865) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:20:54,828::__init__::225::IOProcess::(_processLogs) (540865) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:54,829::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:20:54,829::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:20:54,829::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) (540866) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) (540866) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) (540866) Building response >Thread-19::DEBUG::2014-08-11 17:20:54,830::__init__::225::IOProcess::(_processLogs) (540866) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) (540867) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) (540867) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:20:54,831::__init__::225::IOProcess::(_processLogs) (540867) Queuing response >Thread-27::DEBUG::2014-08-11 17:20:54,832::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:20:54,832::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-27::INFO::2014-08-11 17:20:54,832::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-27::INFO::2014-08-11 17:20:54,832::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) (540868) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) (540868) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:54,833::__init__::225::IOProcess::(_processLogs) (540868) Queuing response >Thread-27::DEBUG::2014-08-11 17:20:54,834::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:54,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:54,893::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:20:54,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0026367 s, 139 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) (540869) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:54,898::__init__::225::IOProcess::(_processLogs) (540869) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:54,899::__init__::225::IOProcess::(_processLogs) (540869) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:54,899::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:20:55,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:55,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413701 s, 24.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:20:57,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:57,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01358 s, 75.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:20:57,604::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:20:57,679::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) (540870) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) (540870) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:57,680::__init__::225::IOProcess::(_processLogs) (540870) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:57,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:20:57,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:20:57,681::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:20:57,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000835118 s, 593 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) (540871) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) (540871) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) (540871) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:57,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) (540872) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:57,743::__init__::225::IOProcess::(_processLogs) (540872) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:57,744::__init__::225::IOProcess::(_processLogs) (540872) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:57,744::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:57,744::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:20:57,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:57,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:57,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:57,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:57,745::__init__::225::IOProcess::(_processLogs) (540873) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:57,745::__init__::225::IOProcess::(_processLogs) (540873) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:57,745::__init__::225::IOProcess::(_processLogs) (540873) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:57,745::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:20:57,745::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:20:57,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:20:57,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:20:57,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:20:57,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:20:57,746::__init__::225::IOProcess::(_processLogs) (540874) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:20:57,746::__init__::225::IOProcess::(_processLogs) (540874) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:20:57,747::__init__::225::IOProcess::(_processLogs) (540874) Building response >Thread-19::DEBUG::2014-08-11 17:20:57,747::__init__::225::IOProcess::(_processLogs) (540874) Queuing response >Thread-19::DEBUG::2014-08-11 17:20:57,747::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:20:57,747::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:20:59,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:20:59,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0435837 s, 23.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:59,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:59,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:20:59,406::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:59,411::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:59,411::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:20:59,411::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:20:59,750::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10205::DEBUG::2014-08-11 17:21:00,998::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:21:00,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa5e4522-a46f-4e5d-9b1b-285c27e1e31c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:00,999::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:21:01,013::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:01,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa5e4522-a46f-4e5d-9b1b-285c27e1e31c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:01,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa5e4522-a46f-4e5d-9b1b-285c27e1e31c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:01,013::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:01,013::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:01,013::task::993::Storage.TaskManager.Task::(_decref) Task=`fa5e4522-a46f-4e5d-9b1b-285c27e1e31c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:21:01,024::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:21:01,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fc4e869-98a4-4a6a-a214-eb5eb0776f1c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:21:01,024::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:21:01,025::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2aaf9ad7-e39f-403a-b85f-79ca2c731e8a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:21:01,025::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:21:01,025::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:21:01,025::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2aaf9ad7-e39f-403a-b85f-79ca2c731e8a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:21:01,025::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6fc4e869-98a4-4a6a-a214-eb5eb0776f1c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:21:01,025::task::993::Storage.TaskManager.Task::(_decref) Task=`6fc4e869-98a4-4a6a-a214-eb5eb0776f1c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:21:01,045::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:01,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fc4e869-98a4-4a6a-a214-eb5eb0776f1c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:01,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fc4e869-98a4-4a6a-a214-eb5eb0776f1c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:21:01,045::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:21:01,045::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:21:01,045::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:21:01,046::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:21:01,046::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:21:01,046::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:21:01,046::task::993::Storage.TaskManager.Task::(_decref) Task=`6fc4e869-98a4-4a6a-a214-eb5eb0776f1c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:21:01,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:01,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462462 s, 22.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:21:03,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:03,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02226 s, 46.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:04,410::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:04,410::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:04,410::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:04,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:04,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:04,418::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:04,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`38ddda86-8e84-4140-b937-5451b5b554a7`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:04,579::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:21:04,579::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0026367', 'lastCheck': '9.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835118', 'lastCheck': '6.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:21:04,580::task::1191::Storage.TaskManager.Task::(prepare) Task=`38ddda86-8e84-4140-b937-5451b5b554a7`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0026367', 'lastCheck': '9.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000835118', 'lastCheck': '6.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:21:04,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`38ddda86-8e84-4140-b937-5451b5b554a7`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:04,580::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:04,580::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:04,580::task::993::Storage.TaskManager.Task::(_decref) Task=`38ddda86-8e84-4140-b937-5451b5b554a7`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:21:04,598::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:04,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:21:04,900::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:04,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:04,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:04,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:04,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:04,901::__init__::225::IOProcess::(_processLogs) (540875) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:04,901::__init__::225::IOProcess::(_processLogs) (540875) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:04,903::__init__::225::IOProcess::(_processLogs) (540875) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:04,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:21:04,904::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:21:04,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000354513 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:04,962::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:04,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:04,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:04,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:04,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:04,963::__init__::225::IOProcess::(_processLogs) (540876) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:04,963::__init__::225::IOProcess::(_processLogs) (540876) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:04,963::__init__::225::IOProcess::(_processLogs) (540876) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:04,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:04,964::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:21:05,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:05,664::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0593547 s, 17.3 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:21:07,249::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:21:07,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:21:07,747::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:07,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:07,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:07,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:07,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:07,747::__init__::225::IOProcess::(_processLogs) (540877) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:07,748::__init__::225::IOProcess::(_processLogs) (540877) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:07,750::__init__::225::IOProcess::(_processLogs) (540877) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:07,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:21:07,752::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:07,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0771729 s, 13.3 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:21:07,813::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000809828 s, 611 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:07,814::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:07,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:07,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:07,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:07,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:07,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:07,817::__init__::225::IOProcess::(_processLogs) (540878) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:07,818::__init__::225::IOProcess::(_processLogs) (540878) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:07,818::__init__::225::IOProcess::(_processLogs) (540878) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:07,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:07,820::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:21:07,820::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:21:07,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:07,821::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:07,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:07,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:07,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:07,823::__init__::225::IOProcess::(_processLogs) (540879) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:07,823::__init__::225::IOProcess::(_processLogs) (540879) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:07,824::__init__::225::IOProcess::(_processLogs) (540879) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:07,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:07,825::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:07,825::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:21:07,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:07,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:07,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:07,827::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:07,828::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:07,828::__init__::225::IOProcess::(_processLogs) (540880) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:07,829::__init__::225::IOProcess::(_processLogs) (540880) Building response >Thread-19::DEBUG::2014-08-11 17:21:07,829::__init__::225::IOProcess::(_processLogs) (540880) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:07,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:07,830::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:07,831::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:21:07,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:07,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:07,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:07,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:07,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:07,833::__init__::225::IOProcess::(_processLogs) (540881) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:07,833::__init__::225::IOProcess::(_processLogs) (540881) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:07,834::__init__::225::IOProcess::(_processLogs) (540881) Building response >Thread-19::DEBUG::2014-08-11 17:21:07,835::__init__::225::IOProcess::(_processLogs) (540881) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:07,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:07,836::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:09,416::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:09,416::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:09,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:09,423::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:09,424::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:09,424::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:09,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:09,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120911 s, 84.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:21:11,104::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:21:11,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`72aae60e-96a8-404d-ab46-7b805d92e9af`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:11,105::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:21:11,126::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:11,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`72aae60e-96a8-404d-ab46-7b805d92e9af`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:11,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`72aae60e-96a8-404d-ab46-7b805d92e9af`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:11,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:11,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:11,126::task::993::Storage.TaskManager.Task::(_decref) Task=`72aae60e-96a8-404d-ab46-7b805d92e9af`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:21:11,138::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:21:11,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`81e77a4c-2ed9-42d3-a9c1-0bbe7fdbdc07`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:21:11,139::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:21:11,139::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`da4f7b38-dc9f-46d4-a6bd-ad6c68900a01`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:21:11,139::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:21:11,139::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:21:11,139::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`da4f7b38-dc9f-46d4-a6bd-ad6c68900a01`::Granted request >Thread-10197::DEBUG::2014-08-11 17:21:11,140::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81e77a4c-2ed9-42d3-a9c1-0bbe7fdbdc07`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:21:11,140::task::993::Storage.TaskManager.Task::(_decref) Task=`81e77a4c-2ed9-42d3-a9c1-0bbe7fdbdc07`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:21:11,164::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:11,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`81e77a4c-2ed9-42d3-a9c1-0bbe7fdbdc07`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:11,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`81e77a4c-2ed9-42d3-a9c1-0bbe7fdbdc07`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:21:11,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:21:11,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:21:11,164::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:21:11,164::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:21:11,164::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:21:11,164::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:21:11,165::task::993::Storage.TaskManager.Task::(_decref) Task=`81e77a4c-2ed9-42d3-a9c1-0bbe7fdbdc07`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:21:11,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:12,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285621 s, 35.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:21:12,611::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:21:14,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:14,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0373908 s, 27.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:14,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:14,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:14,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:14,430::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:14,430::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:14,430::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:21:14,964::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:14,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) (540882) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) (540882) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) (540882) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:14,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:21:14,965::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:21:15,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000848954 s, 431 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:15,026::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:15,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:15,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:15,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:15,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:15,027::__init__::225::IOProcess::(_processLogs) (540883) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:15,027::__init__::225::IOProcess::(_processLogs) (540883) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:15,027::__init__::225::IOProcess::(_processLogs) (540883) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:15,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:15,028::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:21:16,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:16,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523338 s, 19.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:21:17,821::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:21:17,835::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:17,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:17,835::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:17,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:17,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:17,836::__init__::225::IOProcess::(_processLogs) (540884) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:17,836::__init__::225::IOProcess::(_processLogs) (540884) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:17,837::__init__::225::IOProcess::(_processLogs) (540884) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:17,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:21:17,838::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:21:17,897::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00119157 s, 415 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) (540885) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:17,898::__init__::225::IOProcess::(_processLogs) (540885) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:17,899::__init__::225::IOProcess::(_processLogs) (540885) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:17,899::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:17,900::__init__::225::IOProcess::(_processLogs) (540886) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) (540886) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) (540886) Building response >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) (540886) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:17,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) (540887) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) (540887) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) (540887) Building response >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) (540887) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:17,902::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:17,903::__init__::225::IOProcess::(_processLogs) (540888) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:17,904::__init__::225::IOProcess::(_processLogs) (540888) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:17,904::__init__::225::IOProcess::(_processLogs) (540888) Building response >Thread-19::DEBUG::2014-08-11 17:21:17,904::__init__::225::IOProcess::(_processLogs) (540888) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:17,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:17,904::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:21:18,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:18,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129453 s, 79.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:19,428::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:19,429::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:19,429::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:19,436::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:19,436::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:19,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:19,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`4714d3a8-1de0-4688-9a6b-967d0612ade6`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:19,885::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:21:19,886::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000848954', 'lastCheck': '4.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00119157', 'lastCheck': '2.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:21:19,886::task::1191::Storage.TaskManager.Task::(prepare) Task=`4714d3a8-1de0-4688-9a6b-967d0612ade6`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000848954', 'lastCheck': '4.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00119157', 'lastCheck': '2.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:21:19,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`4714d3a8-1de0-4688-9a6b-967d0612ade6`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:19,886::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:19,886::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:19,886::task::993::Storage.TaskManager.Task::(_decref) Task=`4714d3a8-1de0-4688-9a6b-967d0612ade6`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:21:19,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:19,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:20,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:20,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0602525 s, 17.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:21:21,294::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:21:21,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`64ece59a-08d4-4002-8b0b-9e8af0335df0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:21,295::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:21:21,353::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:21,353::task::1191::Storage.TaskManager.Task::(prepare) Task=`64ece59a-08d4-4002-8b0b-9e8af0335df0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:21,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`64ece59a-08d4-4002-8b0b-9e8af0335df0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:21,353::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:21,353::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:21,353::task::993::Storage.TaskManager.Task::(_decref) Task=`64ece59a-08d4-4002-8b0b-9e8af0335df0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:21:21,366::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:21:21,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a91c7c9-896e-486f-a2b8-813a5e6e9a74`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:21:21,366::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:21:21,366::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7b8ee99c-c0e9-489a-abf4-52fd8bd06a9d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:21:21,366::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:21:21,367::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:21:21,367::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7b8ee99c-c0e9-489a-abf4-52fd8bd06a9d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:21:21,367::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6a91c7c9-896e-486f-a2b8-813a5e6e9a74`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:21:21,367::task::993::Storage.TaskManager.Task::(_decref) Task=`6a91c7c9-896e-486f-a2b8-813a5e6e9a74`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:21:21,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:21,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`6a91c7c9-896e-486f-a2b8-813a5e6e9a74`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:21,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`6a91c7c9-896e-486f-a2b8-813a5e6e9a74`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:21:21,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:21:21,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:21:21,391::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:21:21,391::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:21:21,391::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:21:21,391::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:21:21,392::task::993::Storage.TaskManager.Task::(_decref) Task=`6a91c7c9-896e-486f-a2b8-813a5e6e9a74`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:21:22,298::task::595::Storage.TaskManager.Task::(_updateState) Task=`77174eb9-f61a-4333-80a7-451df2e3c040`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:21:22,298::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:21:22,298::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:22,298::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:21:22,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:22,298::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:22,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:22,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:22,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:22,299::__init__::225::IOProcess::(_processLogs) (540889) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:21:22,299::__init__::225::IOProcess::(_processLogs) (540889) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:21:22,302::__init__::225::IOProcess::(_processLogs) DEBUG|(540889) Building response >Thread-19::DEBUG::2014-08-11 17:21:22,302::__init__::225::IOProcess::(_processLogs) (540889) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:22,302::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:21:22,303::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:21:22,303::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:21:22,304::task::1191::Storage.TaskManager.Task::(prepare) Task=`77174eb9-f61a-4333-80a7-451df2e3c040`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:21:22,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:21:22,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`77174eb9-f61a-4333-80a7-451df2e3c040`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:21:22,305::__init__::225::IOProcess::(_processLogs) (540890) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:21:22,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:21:22,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:21:22,305::__init__::225::IOProcess::(_processLogs) (540890) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:21:22,306::task::993::Storage.TaskManager.Task::(_decref) Task=`77174eb9-f61a-4333-80a7-451df2e3c040`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:21:22,306::__init__::225::IOProcess::(_processLogs) (540890) Building response >Thread-19::DEBUG::2014-08-11 17:21:22,306::__init__::225::IOProcess::(_processLogs) (540890) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:22,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:22,306::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:21:22,326::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:21:22,447::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:22,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125444 s, 81.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:24,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:24,434::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:24,434::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:24,442::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:24,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:24,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:24,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:24,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0639073 s, 16.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:25,028::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:25,028::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) (540891) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) (540891) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) DEBUG|(540891) Building response >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) (540891) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:25,029::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:21:25,030::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:21:25,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:21:25,091::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00112422 s, 326 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) (540892) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:25,092::__init__::225::IOProcess::(_processLogs) (540892) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:25,093::__init__::225::IOProcess::(_processLogs) DEBUG|(540892) Building response >Thread-19::DEBUG::2014-08-11 17:21:25,093::__init__::225::IOProcess::(_processLogs) (540892) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:25,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:25,094::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:21:26,658::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:26,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513114 s, 20.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:21:27,619::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:21:27,904::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:27,904::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:27,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:27,904::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:27,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:27,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:27,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:27,905::__init__::225::IOProcess::(_processLogs) (540893) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:27,905::__init__::225::IOProcess::(_processLogs) (540893) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:27,920::__init__::225::IOProcess::(_processLogs) DEBUG|(540893) Building response >Thread-19::DEBUG::2014-08-11 17:21:27,920::__init__::225::IOProcess::(_processLogs) (540893) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:27,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:27,921::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:21:27,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:21:27,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000914648 s, 541 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:27,981::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) (540894) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) (540894) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:27,982::__init__::225::IOProcess::(_processLogs) DEBUG|(540894) Building response >Thread-19::DEBUG::2014-08-11 17:21:27,983::__init__::225::IOProcess::(_processLogs) (540894) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:27,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:27,983::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:21:27,983::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:27,983::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:21:27,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) (540895) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) (540895) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) (540895) Building response >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) (540895) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:27,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:27,985::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) (540896) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) (540896) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) (540896) Building response >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) (540896) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:27,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:27,987::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:27,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:27,987::__init__::225::IOProcess::(_processLogs) (540897) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:27,987::__init__::225::IOProcess::(_processLogs) (540897) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:27,987::__init__::225::IOProcess::(_processLogs) (540897) Building response >Thread-19::DEBUG::2014-08-11 17:21:27,988::__init__::225::IOProcess::(_processLogs) (540897) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:27,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:27,988::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:21:28,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:28,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0311461 s, 32.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:29,439::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:29,440::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:29,440::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:29,448::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:29,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:29,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:21:29,834::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:21:30,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:30,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0363157 s, 28.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:21:31,419::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:21:31,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e795c16-dc0f-453e-a645-7403e14a3509`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:31,419::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:21:31,470::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:31,470::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e795c16-dc0f-453e-a645-7403e14a3509`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:31,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e795c16-dc0f-453e-a645-7403e14a3509`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:31,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:31,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:31,470::task::993::Storage.TaskManager.Task::(_decref) Task=`6e795c16-dc0f-453e-a645-7403e14a3509`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:21:31,477::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:21:31,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`af932211-67bd-4c71-99ff-e406f91479a2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:21:31,477::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:21:31,478::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0b9e0eed-1a10-45f6-a001-2f5c649089e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:21:31,478::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:21:31,478::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:21:31,478::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0b9e0eed-1a10-45f6-a001-2f5c649089e9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:21:31,479::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af932211-67bd-4c71-99ff-e406f91479a2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:21:31,479::task::993::Storage.TaskManager.Task::(_decref) Task=`af932211-67bd-4c71-99ff-e406f91479a2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:21:31,517::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:31,517::task::1191::Storage.TaskManager.Task::(prepare) Task=`af932211-67bd-4c71-99ff-e406f91479a2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:31,517::task::595::Storage.TaskManager.Task::(_updateState) Task=`af932211-67bd-4c71-99ff-e406f91479a2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:21:31,517::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:21:31,517::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:21:31,517::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:21:31,518::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:21:31,518::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:21:31,518::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:21:31,518::task::993::Storage.TaskManager.Task::(_decref) Task=`af932211-67bd-4c71-99ff-e406f91479a2`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:21:32,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:33,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0407632 s, 25.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:34,446::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:34,446::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:34,447::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:34,455::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:34,455::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:34,456::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:35,084::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:21:35,143::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:35,144::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:35,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:35,145::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10205::DEBUG::2014-08-11 17:21:35,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d1aa25f-e93e-4bb8-9417-785101eafda4`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:21:35,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10205::INFO::2014-08-11 17:21:35,146::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2014-08-11 17:21:35,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10205::INFO::2014-08-11 17:21:35,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112422', 'lastCheck': '10.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000914648', 'lastCheck': '7.2', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:21:35,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10205::DEBUG::2014-08-11 17:21:35,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d1aa25f-e93e-4bb8-9417-785101eafda4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112422', 'lastCheck': '10.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000914648', 'lastCheck': '7.2', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:21:35,148::__init__::225::IOProcess::(_processLogs) (540898) Finding callback 'statvfs'... >Thread-10205::DEBUG::2014-08-11 17:21:35,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d1aa25f-e93e-4bb8-9417-785101eafda4`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:21:35,149::__init__::225::IOProcess::(_processLogs) (540898) Got request for method 'statvfs' >Thread-10205::DEBUG::2014-08-11 17:21:35,149::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:35,149::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:21:35,150::__init__::225::IOProcess::(_processLogs) DEBUG|(540898) Building response >Thread-10205::DEBUG::2014-08-11 17:21:35,151::task::993::Storage.TaskManager.Task::(_decref) Task=`3d1aa25f-e93e-4bb8-9417-785101eafda4`::ref 0 aborting False >Thread-27::DEBUG::2014-08-11 17:21:35,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:21:35,151::__init__::225::IOProcess::(_processLogs) (540898) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:35,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:35,213::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:21:35,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000336004 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:35,216::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:35,217::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:35,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:35,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:35,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:35,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:35,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-51::DEBUG::2014-08-11 17:21:35,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0801757 s, 12.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:35,225::__init__::225::IOProcess::(_processLogs) (540899) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:35,227::__init__::225::IOProcess::(_processLogs) (540899) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:35,229::__init__::225::IOProcess::(_processLogs) DEBUG|(540899) Building response >Thread-19::DEBUG::2014-08-11 17:21:35,230::__init__::225::IOProcess::(_processLogs) (540899) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:35,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:35,233::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:21:35,255::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:35,256::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:37,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:21:37,334::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:21:37,366::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0640124 s, 16.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:37,988::__init__::225::IOProcess::(_processLogs) (540900) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:37,989::__init__::225::IOProcess::(_processLogs) (540900) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:37,989::__init__::225::IOProcess::(_processLogs) (540900) Building response >Thread-19::DEBUG::2014-08-11 17:21:37,989::__init__::225::IOProcess::(_processLogs) (540900) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:37,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:37,989::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:21:37,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:21:38,050::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00119036 s, 416 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:38,050::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) (540901) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) (540901) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:38,051::__init__::225::IOProcess::(_processLogs) DEBUG|(540901) Building response >Thread-19::DEBUG::2014-08-11 17:21:38,052::__init__::225::IOProcess::(_processLogs) (540901) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:38,052::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:38,052::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:21:38,052::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:38,052::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) (540902) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) (540902) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) (540902) Building response >Thread-19::DEBUG::2014-08-11 17:21:38,053::__init__::225::IOProcess::(_processLogs) (540902) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:38,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:38,054::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:38,054::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:38,054::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:21:38,055::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:38,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:38,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:38,057::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:38,059::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:38,060::__init__::225::IOProcess::(_processLogs) (540903) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:38,061::__init__::225::IOProcess::(_processLogs) (540903) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) (540903) Building response >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) (540903) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:21:38,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) (540904) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) (540904) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) DEBUG|(540904) Building response >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) (540904) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:38,063::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:21:38,064::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:21:39,375::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:39,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:39,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:39,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:39,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:39,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:39,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:39,532::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0944071 s, 10.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:21:41,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:21:41,600::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:21:41,629::task::595::Storage.TaskManager.Task::(_updateState) Task=`1efd3d14-e59f-45f6-84b2-1929f9dc9537`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:41,630::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:21:41,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0343029 s, 29.9 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:21:41,646::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:41,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`1efd3d14-e59f-45f6-84b2-1929f9dc9537`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:41,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`1efd3d14-e59f-45f6-84b2-1929f9dc9537`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:41,647::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:41,647::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:41,647::task::993::Storage.TaskManager.Task::(_decref) Task=`1efd3d14-e59f-45f6-84b2-1929f9dc9537`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:21:41,658::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:21:41,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec63b25a-54f4-4140-842d-a18a7c4cdec3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:21:41,658::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:21:41,659::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`70db78f3-38e8-4ac7-b30b-8cb5a6cafc9a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:21:41,659::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:21:41,659::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:21:41,659::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`70db78f3-38e8-4ac7-b30b-8cb5a6cafc9a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:21:41,659::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ec63b25a-54f4-4140-842d-a18a7c4cdec3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:21:41,659::task::993::Storage.TaskManager.Task::(_decref) Task=`ec63b25a-54f4-4140-842d-a18a7c4cdec3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:21:41,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:41,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`ec63b25a-54f4-4140-842d-a18a7c4cdec3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:41,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`ec63b25a-54f4-4140-842d-a18a7c4cdec3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:21:41,695::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:21:41,695::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:21:41,696::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:21:41,696::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:21:41,696::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:21:41,696::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:21:41,696::task::993::Storage.TaskManager.Task::(_decref) Task=`ec63b25a-54f4-4140-842d-a18a7c4cdec3`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:21:42,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`594a424b-7dce-479a-8697-3c313337144a`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:21:42,622::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:42,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:42,623::__init__::225::IOProcess::(_processLogs) (540905) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:21:42,623::__init__::225::IOProcess::(_processLogs) (540905) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:21:42,623::__init__::225::IOProcess::(_processLogs) DEBUG|(540905) Building response >Thread-19::DEBUG::2014-08-11 17:21:42,624::__init__::225::IOProcess::(_processLogs) (540905) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:42,624::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:21:42,624::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:21:42,624::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:42,625::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:21:42,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10102::INFO::2014-08-11 17:21:42,625::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:21:42,625::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10102::DEBUG::2014-08-11 17:21:42,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`594a424b-7dce-479a-8697-3c313337144a`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:21:42,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:21:42,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`594a424b-7dce-479a-8697-3c313337144a`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:21:42,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:21:42,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:21:42,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:21:42,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:21:42,627::task::993::Storage.TaskManager.Task::(_decref) Task=`594a424b-7dce-479a-8697-3c313337144a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:21:42,628::__init__::225::IOProcess::(_processLogs) (540906) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:21:42,628::__init__::225::IOProcess::(_processLogs) (540906) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:21:42,628::__init__::225::IOProcess::(_processLogs) (540906) Building response >Thread-19::DEBUG::2014-08-11 17:21:42,628::__init__::225::IOProcess::(_processLogs) (540906) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:42,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:42,628::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:21:42,649::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:21:43,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:43,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269681 s, 38.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:44,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:44,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:44,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:44,467::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:44,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:44,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:21:45,230::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) (540907) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) (540907) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:45,231::__init__::225::IOProcess::(_processLogs) DEBUG|(540907) Building response >Thread-19::DEBUG::2014-08-11 17:21:45,232::__init__::225::IOProcess::(_processLogs) (540907) Queuing response >Thread-27::DEBUG::2014-08-11 17:21:45,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:21:45,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:45,291::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:21:45,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00084278 s, 434 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:45,293::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:45,293::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:45,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:45,293::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:45,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:45,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:45,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:45,294::__init__::225::IOProcess::(_processLogs) (540908) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:45,294::__init__::225::IOProcess::(_processLogs) (540908) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:45,294::__init__::225::IOProcess::(_processLogs) DEBUG|(540908) Building response >Thread-19::DEBUG::2014-08-11 17:21:45,295::__init__::225::IOProcess::(_processLogs) (540908) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:45,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:45,295::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:21:45,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:45,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129353 s, 79.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:21:47,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:21:47,873::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:21:47,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0571629 s, 17.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:48,064::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:48,064::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:48,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) (540909) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) (540909) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:48,065::__init__::225::IOProcess::(_processLogs) DEBUG|(540909) Building response >Thread-19::DEBUG::2014-08-11 17:21:48,066::__init__::225::IOProcess::(_processLogs) (540909) Queuing response >Thread-28::DEBUG::2014-08-11 17:21:48,066::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:21:48,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:48,125::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:21:48,127::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00109614 s, 452 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:48,127::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:48,127::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:48,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:48,127::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:48,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:48,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:48,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:48,128::__init__::225::IOProcess::(_processLogs) (540910) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:48,128::__init__::225::IOProcess::(_processLogs) (540910) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:48,128::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540910) Building response >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) (540910) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:48,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) (540911) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) (540911) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) (540911) Building response >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) (540911) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:48,130::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:48,131::__init__::225::IOProcess::(_processLogs) (540912) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) (540912) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) (540912) Building response >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) (540912) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:48,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:48,133::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:48,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:48,133::__init__::225::IOProcess::(_processLogs) (540913) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:48,133::__init__::225::IOProcess::(_processLogs) (540913) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:48,133::__init__::225::IOProcess::(_processLogs) (540913) Building response >Thread-19::DEBUG::2014-08-11 17:21:48,133::__init__::225::IOProcess::(_processLogs) (540913) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:48,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:48,134::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:49,459::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:49,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:49,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:49,474::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:49,474::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:49,475::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:21:49,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:50,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.022154 s, 46.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:21:50,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16636ec-d010-4545-90bc-7ed4d4926611`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:50,418::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:21:50,418::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084278', 'lastCheck': '5.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109614', 'lastCheck': '2.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:21:50,419::task::1191::Storage.TaskManager.Task::(prepare) Task=`f16636ec-d010-4545-90bc-7ed4d4926611`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084278', 'lastCheck': '5.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109614', 'lastCheck': '2.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:21:50,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`f16636ec-d010-4545-90bc-7ed4d4926611`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:50,419::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:50,419::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:50,419::task::993::Storage.TaskManager.Task::(_decref) Task=`f16636ec-d010-4545-90bc-7ed4d4926611`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:21:50,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:50,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:21:51,903::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:21:51,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`023f87a3-dffd-49ec-9715-ec0aa0e8b4b1`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:21:51,904::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:21:51,966::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:51,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`023f87a3-dffd-49ec-9715-ec0aa0e8b4b1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:21:51,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`023f87a3-dffd-49ec-9715-ec0aa0e8b4b1`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:21:51,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:21:51,968::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:21:51,968::task::993::Storage.TaskManager.Task::(_decref) Task=`023f87a3-dffd-49ec-9715-ec0aa0e8b4b1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:21:51,981::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:21:51,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`97be24b1-f095-42f3-ac4f-6607891279d0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:21:51,981::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:21:51,982::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f554d189-af85-43ae-857b-69dbed25f136`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:21:51,982::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:21:51,982::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:21:51,982::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f554d189-af85-43ae-857b-69dbed25f136`::Granted request >Thread-10197::DEBUG::2014-08-11 17:21:51,982::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`97be24b1-f095-42f3-ac4f-6607891279d0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:21:51,982::task::993::Storage.TaskManager.Task::(_decref) Task=`97be24b1-f095-42f3-ac4f-6607891279d0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:21:51,999::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:51,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`97be24b1-f095-42f3-ac4f-6607891279d0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:21:51,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`97be24b1-f095-42f3-ac4f-6607891279d0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:21:51,999::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:21:51,999::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:21:52,000::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:21:52,000::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:21:52,000::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:21:52,000::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:21:52,000::task::993::Storage.TaskManager.Task::(_decref) Task=`97be24b1-f095-42f3-ac4f-6607891279d0`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:21:52,032::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:52,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471916 s, 21.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:21:52,342::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:21:54,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:54,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364938 s, 28.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:54,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:54,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:54,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:54,480::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:54,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:54,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:21:55,295::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) (540914) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) (540914) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:55,296::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540914) Building response >Thread-19::DEBUG::2014-08-11 17:21:55,297::__init__::225::IOProcess::(_processLogs) (540914) Queuing response >Thread-27::DEBUG::2014-08-11 17:21:55,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:21:55,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:55,356::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:21:55,357::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000783667 s, 467 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) (540915) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:55,358::__init__::225::IOProcess::(_processLogs) (540915) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:55,359::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540915) Building response >Thread-19::DEBUG::2014-08-11 17:21:55,359::__init__::225::IOProcess::(_processLogs) (540915) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:55,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:55,360::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:21:56,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:56,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0476317 s, 21.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:21:57,657::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) (540916) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) (540916) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540916) Building response >Thread-19::DEBUG::2014-08-11 17:21:58,134::__init__::225::IOProcess::(_processLogs) (540916) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:58,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:58,135::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:21:58,135::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:21:58,194::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000677001 s, 731 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:21:58,194::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:58,195::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:21:58,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:58,195::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:58,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:58,195::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) (540917) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) (540917) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) (540917) Building response >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) (540917) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:58,196::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) (540918) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) (540918) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:58,197::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540918) Building response >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) (540918) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:58,198::__init__::225::IOProcess::(_processLogs) (540919) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) (540919) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540919) Building response >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) (540919) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:21:58,199::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:21:58,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:21:58,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:21:58,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:21:58,200::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:21:58,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:21:58,200::__init__::225::IOProcess::(_processLogs) (540920) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:21:58,201::__init__::225::IOProcess::(_processLogs) (540920) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:21:58,201::__init__::225::IOProcess::(_processLogs) (540920) Building response >Thread-19::DEBUG::2014-08-11 17:21:58,201::__init__::225::IOProcess::(_processLogs) (540920) Queuing response >Thread-19::DEBUG::2014-08-11 17:21:58,201::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:21:58,201::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:21:58,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:21:58,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0366119 s, 28.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:59,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:59,467::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:21:59,467::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:59,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:59,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:21:59,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:21:59,907::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:22:00,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:00,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0647381 s, 15.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:22:02,067::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:22:02,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`f46ebc3f-27d4-4661-8ec0-a767364d233e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:02,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:22:02,117::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:02,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`f46ebc3f-27d4-4661-8ec0-a767364d233e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:02,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`f46ebc3f-27d4-4661-8ec0-a767364d233e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:02,119::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:02,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:02,120::task::993::Storage.TaskManager.Task::(_decref) Task=`f46ebc3f-27d4-4661-8ec0-a767364d233e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:22:02,134::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:22:02,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d26c7c6-65d4-48fd-b285-671c656ef34a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:22:02,136::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:22:02,138::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4bb28fc7-dea0-4358-a7bb-833567031340`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:22:02,138::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:22:02,140::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:22:02,141::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4bb28fc7-dea0-4358-a7bb-833567031340`::Granted request >Thread-10197::DEBUG::2014-08-11 17:22:02,143::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5d26c7c6-65d4-48fd-b285-671c656ef34a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:22:02,144::task::993::Storage.TaskManager.Task::(_decref) Task=`5d26c7c6-65d4-48fd-b285-671c656ef34a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:22:02,257::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:02,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d26c7c6-65d4-48fd-b285-671c656ef34a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:02,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d26c7c6-65d4-48fd-b285-671c656ef34a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:22:02,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:22:02,261::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:22:02,262::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:22:02,263::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:22:02,264::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:22:02,265::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:22:02,266::task::993::Storage.TaskManager.Task::(_decref) Task=`5d26c7c6-65d4-48fd-b285-671c656ef34a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:22:02,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:02,671::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146547 s, 69.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:04,469::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:04,470::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:04,470::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:04,493::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:04,493::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:04,494::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:04,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:04,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.059743 s, 17.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:05,360::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:05,360::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:05,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:05,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:05,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:05,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:05,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:05,361::__init__::225::IOProcess::(_processLogs) (540921) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:05,361::__init__::225::IOProcess::(_processLogs) (540921) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:05,361::__init__::225::IOProcess::(_processLogs) (540921) Building response >Thread-19::DEBUG::2014-08-11 17:22:05,361::__init__::225::IOProcess::(_processLogs) (540921) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:05,361::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:22:05,362::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:05,362::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:22:05,421::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000640208 s, 572 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) (540922) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:05,422::__init__::225::IOProcess::(_processLogs) (540922) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:05,423::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540922) Building response >Thread-19::DEBUG::2014-08-11 17:22:05,423::__init__::225::IOProcess::(_processLogs) (540922) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:05,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:05,424::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:22:05,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b253287-e8f4-495f-9d2c-6fe059c9bbaa`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:05,670::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:22:05,670::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640208', 'lastCheck': '0.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677001', 'lastCheck': '7.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:05,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b253287-e8f4-495f-9d2c-6fe059c9bbaa`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000640208', 'lastCheck': '0.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000677001', 'lastCheck': '7.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:05,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b253287-e8f4-495f-9d2c-6fe059c9bbaa`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:05,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:05,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:05,670::task::993::Storage.TaskManager.Task::(_decref) Task=`0b253287-e8f4-495f-9d2c-6fe059c9bbaa`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:22:05,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:22:05,689::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:06,814::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:06,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127365 s, 80.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:22:07,351::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:08,201::__init__::225::IOProcess::(_processLogs) (540923) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:08,202::__init__::225::IOProcess::(_processLogs) (540923) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:08,202::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540923) Building response >Thread-19::DEBUG::2014-08-11 17:22:08,202::__init__::225::IOProcess::(_processLogs) (540923) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:08,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:08,202::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:22:08,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:22:08,264::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000809632 s, 611 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:08,264::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) (540924) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) (540924) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:08,265::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540924) Building response >Thread-19::DEBUG::2014-08-11 17:22:08,266::__init__::225::IOProcess::(_processLogs) (540924) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:08,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:08,266::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:08,266::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:08,266::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) (540925) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) (540925) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:08,267::__init__::225::IOProcess::(_processLogs) (540925) Building response >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) (540925) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:08,268::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) (540926) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) (540926) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) (540926) Building response >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) (540926) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:22:08,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:08,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:08,270::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:08,270::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:08,270::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:08,270::__init__::225::IOProcess::(_processLogs) (540927) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:08,270::__init__::225::IOProcess::(_processLogs) (540927) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:08,271::__init__::225::IOProcess::(_processLogs) (540927) Building response >Thread-19::DEBUG::2014-08-11 17:22:08,271::__init__::225::IOProcess::(_processLogs) (540927) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:08,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:08,271::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:22:08,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:08,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153291 s, 66.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:09,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:09,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:09,477::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:09,499::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:09,500::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:09,500::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:10,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:11,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122716 s, 83.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:22:12,304::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:22:12,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`d58f56cf-12a1-483f-8c14-3ed4391819ae`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:12,304::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:22:12,363::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:12,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`d58f56cf-12a1-483f-8c14-3ed4391819ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:12,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`d58f56cf-12a1-483f-8c14-3ed4391819ae`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:12,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:12,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:12,364::task::993::Storage.TaskManager.Task::(_decref) Task=`d58f56cf-12a1-483f-8c14-3ed4391819ae`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:22:12,375::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:22:12,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`efbf75be-1ece-4c56-b49f-84cf47314a4e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:22:12,376::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:22:12,376::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`620f0dd9-40d3-4c06-bdea-1d19faab01d0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:22:12,376::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:22:12,376::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:22:12,376::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`620f0dd9-40d3-4c06-bdea-1d19faab01d0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:22:12,377::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`efbf75be-1ece-4c56-b49f-84cf47314a4e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:22:12,377::task::993::Storage.TaskManager.Task::(_decref) Task=`efbf75be-1ece-4c56-b49f-84cf47314a4e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:22:12,460::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:12,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`efbf75be-1ece-4c56-b49f-84cf47314a4e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:12,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`efbf75be-1ece-4c56-b49f-84cf47314a4e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:22:12,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:22:12,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:22:12,462::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:22:12,462::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:22:12,462::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:22:12,462::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:22:12,462::task::993::Storage.TaskManager.Task::(_decref) Task=`efbf75be-1ece-4c56-b49f-84cf47314a4e`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:22:12,665::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:22:13,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:13,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160402 s, 63.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:14,479::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:14,480::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:14,480::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:14,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:14,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:14,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:15,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:15,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130118 s, 78.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:15,424::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:15,424::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:15,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:15,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:15,424::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:15,424::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:15,425::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:15,425::__init__::225::IOProcess::(_processLogs) (540928) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:15,425::__init__::225::IOProcess::(_processLogs) (540928) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:15,425::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540928) Building response >Thread-27::DEBUG::2014-08-11 17:22:15,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:15,426::__init__::225::IOProcess::(_processLogs) (540928) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:15,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:15,485::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:22:15,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0281459 s, 13.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:15,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:15,518::__init__::225::IOProcess::(_processLogs) (540929) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:15,518::__init__::225::IOProcess::(_processLogs) (540929) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:15,518::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540929) Building response >Thread-19::DEBUG::2014-08-11 17:22:15,518::__init__::225::IOProcess::(_processLogs) (540929) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:15,519::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:15,519::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:22:17,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:17,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0595695 s, 17.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:22:17,960::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:18,271::__init__::225::IOProcess::(_processLogs) (540930) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:18,272::__init__::225::IOProcess::(_processLogs) (540930) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:18,272::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(540930) Building response >Thread-19::DEBUG::2014-08-11 17:22:18,272::__init__::225::IOProcess::(_processLogs) (540930) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:18,272::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:22:18,273::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:18,273::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:22:18,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000616445 s, 803 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:18,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:18,334::__init__::225::IOProcess::(_processLogs) (540931) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:18,334::__init__::225::IOProcess::(_processLogs) (540931) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:18,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540931) Building response >Thread-19::DEBUG::2014-08-11 17:22:18,334::__init__::225::IOProcess::(_processLogs) (540931) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:18,334::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:18,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) (540932) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) (540932) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) (540932) Building response >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) (540932) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:18,336::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) (540933) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) (540933) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) (540933) Building response >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) (540933) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:18,337::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:18,338::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:18,338::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:18,338::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:22:18,338::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:18,338::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) (540934) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) (540934) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) (540934) Building response >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) (540934) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:18,339::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:22:19,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:19,486::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:19,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:19,487::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:19,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0886479 s, 11.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:22:19,512::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:19,512::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:19,513::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:22:20,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d81ecb1-c0de-4311-820a-74b6b964eab8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:20,884::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:22:20,884::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0281459', 'lastCheck': '5.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616445', 'lastCheck': '2.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:20,884::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d81ecb1-c0de-4311-820a-74b6b964eab8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0281459', 'lastCheck': '5.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000616445', 'lastCheck': '2.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:20,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d81ecb1-c0de-4311-820a-74b6b964eab8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:20,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:20,885::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:20,885::task::993::Storage.TaskManager.Task::(_decref) Task=`5d81ecb1-c0de-4311-820a-74b6b964eab8`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:22:20,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:22:20,899::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:21,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:21,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0429664 s, 23.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:22:22,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`f260db07-0b39-484d-9f72-9303fc4c0d4a`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:22:22,354::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:22:22,354::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:22,354::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:22:22,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:22,354::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:22,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:22,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:22,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:22,355::__init__::225::IOProcess::(_processLogs) (540935) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:22:22,355::__init__::225::IOProcess::(_processLogs) (540935) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:22:22,358::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540935) Building response >Thread-19::DEBUG::2014-08-11 17:22:22,358::__init__::225::IOProcess::(_processLogs) (540935) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:22,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:22,359::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:22:22,359::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:22,359::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:22:22,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:22,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:22,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:22:22,360::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:22:22,360::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:22:22,360::task::1191::Storage.TaskManager.Task::(prepare) Task=`f260db07-0b39-484d-9f72-9303fc4c0d4a`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:22:22,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:22:22,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`f260db07-0b39-484d-9f72-9303fc4c0d4a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:22:22,361::__init__::225::IOProcess::(_processLogs) (540936) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:22:22,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:22:22,362::__init__::225::IOProcess::(_processLogs) (540936) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:22:22,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:22:22,362::__init__::225::IOProcess::(_processLogs) (540936) Building response >Thread-10017::DEBUG::2014-08-11 17:22:22,362::task::993::Storage.TaskManager.Task::(_decref) Task=`f260db07-0b39-484d-9f72-9303fc4c0d4a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:22:22,363::__init__::225::IOProcess::(_processLogs) (540936) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:22,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:22,363::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:22:22,385::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:22:22,519::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:22:22,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`44f77149-dbee-4a2f-a3d5-2e8b2917429c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:22,519::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:22:22,555::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:22,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`44f77149-dbee-4a2f-a3d5-2e8b2917429c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:22,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`44f77149-dbee-4a2f-a3d5-2e8b2917429c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:22,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:22,556::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:22,556::task::993::Storage.TaskManager.Task::(_decref) Task=`44f77149-dbee-4a2f-a3d5-2e8b2917429c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:22:22,567::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:22:22,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`32354526-ab2d-463b-86ae-5dec33f01c1d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:22:22,567::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:22:22,567::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a0d761dc-38de-4c9e-a618-c7cbc10b4df7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:22:22,567::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:22:22,567::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:22:22,567::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a0d761dc-38de-4c9e-a618-c7cbc10b4df7`::Granted request >Thread-10197::DEBUG::2014-08-11 17:22:22,568::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`32354526-ab2d-463b-86ae-5dec33f01c1d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:22:22,568::task::993::Storage.TaskManager.Task::(_decref) Task=`32354526-ab2d-463b-86ae-5dec33f01c1d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:22:22,584::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:22,584::task::1191::Storage.TaskManager.Task::(prepare) Task=`32354526-ab2d-463b-86ae-5dec33f01c1d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:22,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`32354526-ab2d-463b-86ae-5dec33f01c1d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:22:22,585::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:22:22,585::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:22:22,585::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:22:22,585::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:22:22,585::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:22:22,585::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:22:22,585::task::993::Storage.TaskManager.Task::(_decref) Task=`32354526-ab2d-463b-86ae-5dec33f01c1d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:22:23,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:23,782::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0649214 s, 15.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:24,490::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:24,490::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:24,491::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:24,518::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:24,519::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:24,519::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:22:25,519::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:25,519::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:25,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:25,519::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:25,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:25,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:25,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:25,520::__init__::225::IOProcess::(_processLogs) (540937) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:25,520::__init__::225::IOProcess::(_processLogs) (540937) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:25,520::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540937) Building response >Thread-19::DEBUG::2014-08-11 17:22:25,521::__init__::225::IOProcess::(_processLogs) (540937) Queuing response >Thread-27::DEBUG::2014-08-11 17:22:25,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:25,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:25,579::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:22:25,583::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00112046 s, 327 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:25,583::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:25,583::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:25,583::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:25,583::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:25,583::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:25,584::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:25,584::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:25,584::__init__::225::IOProcess::(_processLogs) (540938) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:25,584::__init__::225::IOProcess::(_processLogs) (540938) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:25,584::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540938) Building response >Thread-19::DEBUG::2014-08-11 17:22:25,584::__init__::225::IOProcess::(_processLogs) (540938) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:25,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:25,585::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:22:25,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:25,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0672899 s, 15.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:22:27,672::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:22:27,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:28,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284798 s, 36.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:28,339::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:28,339::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:28,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:28,339::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:28,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) (540939) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) (540939) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540939) Building response >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) (540939) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:28,340::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:22:28,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:22:28,400::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00087729 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:28,401::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:28,401::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:28,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:28,401::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:28,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:28,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:28,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:28,402::__init__::225::IOProcess::(_processLogs) (540940) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:28,402::__init__::225::IOProcess::(_processLogs) (540940) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:28,402::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540940) Building response >Thread-19::DEBUG::2014-08-11 17:22:28,403::__init__::225::IOProcess::(_processLogs) (540940) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:28,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:28,403::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:28,403::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:28,403::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:22:28,403::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) (540941) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) (540941) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) (540941) Building response >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) (540941) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:28,404::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) (540942) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) (540942) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:28,405::__init__::225::IOProcess::(_processLogs) (540942) Building response >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) (540942) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:28,406::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) (540943) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) (540943) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) (540943) Building response >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) (540943) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:28,407::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:29,492::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:29,493::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:29,493::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:29,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:29,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:29,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:22:29,991::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:22:30,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:30,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566715 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:22:32,147::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:32,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0776321 s, 13.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:22:32,614::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:22:32,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff1efce2-2bb7-49bf-894f-0dd652aeb974`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:32,616::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:22:32,690::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:32,690::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff1efce2-2bb7-49bf-894f-0dd652aeb974`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:32,690::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff1efce2-2bb7-49bf-894f-0dd652aeb974`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:32,690::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:32,690::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:32,690::task::993::Storage.TaskManager.Task::(_decref) Task=`ff1efce2-2bb7-49bf-894f-0dd652aeb974`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:22:32,697::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:22:32,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef1c5ddd-469e-4946-955d-b5c7de031298`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:22:32,697::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:22:32,697::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`aa69d476-bf1c-4b58-94cb-c491197fd166`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:22:32,697::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:22:32,698::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:22:32,698::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`aa69d476-bf1c-4b58-94cb-c491197fd166`::Granted request >Thread-10197::DEBUG::2014-08-11 17:22:32,698::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ef1c5ddd-469e-4946-955d-b5c7de031298`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:22:32,698::task::993::Storage.TaskManager.Task::(_decref) Task=`ef1c5ddd-469e-4946-955d-b5c7de031298`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:22:32,721::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:32,721::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef1c5ddd-469e-4946-955d-b5c7de031298`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:32,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef1c5ddd-469e-4946-955d-b5c7de031298`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:22:32,721::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:22:32,721::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:22:32,721::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:22:32,722::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:22:32,722::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:22:32,722::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:22:32,722::task::993::Storage.TaskManager.Task::(_decref) Task=`ef1c5ddd-469e-4946-955d-b5c7de031298`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:22:34,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:34,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162387 s, 63.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:34,497::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:34,498::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:34,498::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:34,531::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:34,531::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:34,532::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:22:35,585::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) (540944) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:35,586::__init__::225::IOProcess::(_processLogs) (540944) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:35,595::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540944) Building response >Thread-19::DEBUG::2014-08-11 17:22:35,595::__init__::225::IOProcess::(_processLogs) (540944) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:35,596::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:35,596::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:22:35,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:22:35,656::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000833971 s, 439 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) (540945) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:35,657::__init__::225::IOProcess::(_processLogs) (540945) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:35,658::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540945) Building response >Thread-19::DEBUG::2014-08-11 17:22:35,658::__init__::225::IOProcess::(_processLogs) (540945) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:35,659::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:35,659::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:22:36,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`0035963d-a3a7-4525-a3f5-5bc442127fcf`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:36,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:22:36,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833971', 'lastCheck': '0.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00087729', 'lastCheck': '7.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:36,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`0035963d-a3a7-4525-a3f5-5bc442127fcf`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000833971', 'lastCheck': '0.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00087729', 'lastCheck': '7.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:36,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`0035963d-a3a7-4525-a3f5-5bc442127fcf`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:36,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:36,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:36,109::task::993::Storage.TaskManager.Task::(_decref) Task=`0035963d-a3a7-4525-a3f5-5bc442127fcf`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:22:36,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:22:36,129::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:36,444::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:36,516::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138877 s, 73.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:22:37,418::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:22:38,407::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) (540946) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) (540946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:38,408::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(540946) Building response >Thread-19::DEBUG::2014-08-11 17:22:38,409::__init__::225::IOProcess::(_processLogs) (540946) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:38,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:38,409::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:22:38,410::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:22:38,471::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000324931 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:38,471::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:38,471::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:38,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:38,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:38,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:38,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:38,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) (540947) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) (540947) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) (540947) Building response >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) (540947) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:38,473::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) (540948) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) (540948) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) (540948) Building response >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) (540948) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:38,474::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:38,475::__init__::225::IOProcess::(_processLogs) (540949) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) (540949) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) (540949) Building response >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) (540949) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:38,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:38,477::__init__::225::IOProcess::(_processLogs) (540950) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:38,477::__init__::225::IOProcess::(_processLogs) (540950) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:38,477::__init__::225::IOProcess::(_processLogs) (540950) Building response >Thread-19::DEBUG::2014-08-11 17:22:38,477::__init__::225::IOProcess::(_processLogs) (540950) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:38,477::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:38,477::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:22:38,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:38,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049733 s, 20.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:39,504::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:39,504::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:39,505::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:39,537::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:39,538::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:39,538::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:40,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:40,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121954 s, 84.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:22:42,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9d84a95-fe5d-43d3-9332-cb19c4f2b654`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:22:42,700::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:22:42,700::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:42,700::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) (540951) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:22:42,701::__init__::225::IOProcess::(_processLogs) (540951) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:22:42,702::__init__::225::IOProcess::(_processLogs) DEBUG|(540951) Building response >Thread-19::DEBUG::2014-08-11 17:22:42,702::__init__::225::IOProcess::(_processLogs) (540951) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:42,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:42,703::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:22:42,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:42,703::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:22:42,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:42,704::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10102::INFO::2014-08-11 17:22:42,704::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:22:42,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:22:42,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9d84a95-fe5d-43d3-9332-cb19c4f2b654`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:22:42,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:22:42,705::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9d84a95-fe5d-43d3-9332-cb19c4f2b654`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:22:42,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:22:42,705::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:22:42,706::__init__::225::IOProcess::(_processLogs) (540952) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:22:42,706::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:22:42,706::__init__::225::IOProcess::(_processLogs) (540952) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:22:42,707::task::993::Storage.TaskManager.Task::(_decref) Task=`e9d84a95-fe5d-43d3-9332-cb19c4f2b654`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:22:42,707::__init__::225::IOProcess::(_processLogs) (540952) Building response >Thread-19::DEBUG::2014-08-11 17:22:42,707::__init__::225::IOProcess::(_processLogs) (540952) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:42,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:42,707::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Dummy-51::DEBUG::2014-08-11 17:22:42,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:22:42,787::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:22:42,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121083 s, 84.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:22:42,851::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:22:42,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c95f4e1-892b-4777-bbe3-10654cb164df`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:42,851::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:22:42,937::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:42,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c95f4e1-892b-4777-bbe3-10654cb164df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:42,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c95f4e1-892b-4777-bbe3-10654cb164df`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:42,937::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:42,937::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:42,937::task::993::Storage.TaskManager.Task::(_decref) Task=`4c95f4e1-892b-4777-bbe3-10654cb164df`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:22:42,950::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:22:42,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`d80381bc-5b08-469b-ab03-5be6930dfbbf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:22:42,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:22:42,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f9820baa-7d40-46d0-8973-327e49f0e41f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:22:42,950::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:22:42,950::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:22:42,951::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f9820baa-7d40-46d0-8973-327e49f0e41f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:22:42,951::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d80381bc-5b08-469b-ab03-5be6930dfbbf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:22:42,951::task::993::Storage.TaskManager.Task::(_decref) Task=`d80381bc-5b08-469b-ab03-5be6930dfbbf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:22:42,974::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:42,974::task::1191::Storage.TaskManager.Task::(prepare) Task=`d80381bc-5b08-469b-ab03-5be6930dfbbf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56477351936', 'isoprefix': '', 'alerts': [], 'disktotal': '621449052160', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:42,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`d80381bc-5b08-469b-ab03-5be6930dfbbf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:22:42,974::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:22:42,974::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:22:42,974::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:22:42,974::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:22:42,974::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:22:42,975::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:22:42,975::task::993::Storage.TaskManager.Task::(_decref) Task=`d80381bc-5b08-469b-ab03-5be6930dfbbf`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:44,510::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:44,510::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:44,511::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:44,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:44,543::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:44,543::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:44,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:44,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551208 s, 18.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:45,659::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:45,659::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:45,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:45,659::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:45,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:45,660::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:45,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:45,660::__init__::225::IOProcess::(_processLogs) (540953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:45,660::__init__::225::IOProcess::(_processLogs) (540953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:45,660::__init__::225::IOProcess::(_processLogs) DEBUG|(540953) Building response >Thread-19::DEBUG::2014-08-11 17:22:45,661::__init__::225::IOProcess::(_processLogs) (540953) Queuing response >Thread-27::DEBUG::2014-08-11 17:22:45,661::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:45,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:45,719::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:22:45,722::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00196618 s, 186 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:45,722::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:45,722::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:45,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) (540954) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) (540954) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:45,723::__init__::225::IOProcess::(_processLogs) DEBUG|(540954) Building response >Thread-19::DEBUG::2014-08-11 17:22:45,724::__init__::225::IOProcess::(_processLogs) (540954) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:45,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:45,724::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:22:46,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:47,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0556323 s, 18.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:22:48,033::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:22:48,488::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:48,488::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:48,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:48,489::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:48,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:48,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:48,489::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-28::DEBUG::2014-08-11 17:22:48,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:48,490::__init__::225::IOProcess::(_processLogs) (540955) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:48,548::__init__::225::IOProcess::(_processLogs) (540955) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:48,550::__init__::225::IOProcess::(_processLogs) (540955) Building response >Thread-28::DEBUG::2014-08-11 17:22:48,550::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0003752 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:48,551::__init__::225::IOProcess::(_processLogs) (540955) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:48,551::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:48,551::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:48,551::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:48,551::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:48,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) (540956) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) (540956) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:48,552::__init__::225::IOProcess::(_processLogs) DEBUG|(540956) Building response >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) (540956) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:48,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) (540957) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) (540957) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) (540957) Building response >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) (540957) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:48,554::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) (540958) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:48,555::__init__::225::IOProcess::(_processLogs) (540958) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) (540958) Building response >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) (540958) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:48,556::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) (540959) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) (540959) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) (540959) Building response >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) (540959) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:48,557::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:22:49,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:49,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270774 s, 37.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:49,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:49,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:49,518::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:49,549::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:49,549::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:49,549::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:51,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:51,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526618 s, 19.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:22:51,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d115542-61b9-4ca1-b843-2359ccdf7d72`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:51,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:22:51,375::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00196618', 'lastCheck': '5.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003752', 'lastCheck': '2.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:51,375::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d115542-61b9-4ca1-b843-2359ccdf7d72`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00196618', 'lastCheck': '5.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0003752', 'lastCheck': '2.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:22:51,375::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d115542-61b9-4ca1-b843-2359ccdf7d72`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:51,375::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:51,375::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:51,375::task::993::Storage.TaskManager.Task::(_decref) Task=`3d115542-61b9-4ca1-b843-2359ccdf7d72`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:22:51,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:22:51,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:22:52,493::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:22:53,052::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:22:53,052::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6a95054-fffe-4c21-8ce5-7342482ad51d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:22:53,052::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:22:53,096::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:53,096::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6a95054-fffe-4c21-8ce5-7342482ad51d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:22:53,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6a95054-fffe-4c21-8ce5-7342482ad51d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:22:53,096::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:22:53,096::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:22:53,096::task::993::Storage.TaskManager.Task::(_decref) Task=`b6a95054-fffe-4c21-8ce5-7342482ad51d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:22:53,103::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:22:53,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`4114d19f-1a95-4f83-a3cb-741c12096285`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:22:53,104::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:22:53,104::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`72de99b7-ebae-4cce-860f-de971a0f366a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:22:53,104::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:22:53,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:22:53,104::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`72de99b7-ebae-4cce-860f-de971a0f366a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:22:53,104::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4114d19f-1a95-4f83-a3cb-741c12096285`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:22:53,105::task::993::Storage.TaskManager.Task::(_decref) Task=`4114d19f-1a95-4f83-a3cb-741c12096285`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:22:53,122::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:53,122::task::1191::Storage.TaskManager.Task::(prepare) Task=`4114d19f-1a95-4f83-a3cb-741c12096285`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:22:53,122::task::595::Storage.TaskManager.Task::(_updateState) Task=`4114d19f-1a95-4f83-a3cb-741c12096285`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:22:53,123::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:22:53,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:22:53,123::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:22:53,123::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:22:53,123::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:22:53,123::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:22:53,123::task::993::Storage.TaskManager.Task::(_decref) Task=`4114d19f-1a95-4f83-a3cb-741c12096285`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:22:53,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:53,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222459 s, 46.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:54,520::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:54,520::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:54,520::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:54,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:54,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:54,556::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:55,346::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:55,417::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131782 s, 77.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) (540960) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:55,725::__init__::225::IOProcess::(_processLogs) (540960) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:55,726::__init__::225::IOProcess::(_processLogs) DEBUG|(540960) Building response >Thread-19::DEBUG::2014-08-11 17:22:55,726::__init__::225::IOProcess::(_processLogs) (540960) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:55,726::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:55,727::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:22:55,727::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:22:55,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00300145 s, 122 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:55,792::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:55,792::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:55,792::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:55,793::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:55,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:55,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:55,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:55,793::__init__::225::IOProcess::(_processLogs) (540961) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:55,793::__init__::225::IOProcess::(_processLogs) (540961) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:55,795::__init__::225::IOProcess::(_processLogs) DEBUG|(540961) Building response >Thread-19::DEBUG::2014-08-11 17:22:55,795::__init__::225::IOProcess::(_processLogs) (540961) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:55,795::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:55,796::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:22:57,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:57,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145243 s, 70.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:22:57,794::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-28::DEBUG::2014-08-11 17:22:58,557::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:22:58,558::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,558::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) (540962) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) (540962) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,559::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,560::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,560::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,560::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,560::__init__::225::IOProcess::(_processLogs) (540963) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:22:58,560::__init__::225::IOProcess::(_processLogs) (540963) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:22:58,577::__init__::225::IOProcess::(_processLogs) DEBUG|(540962) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,577::__init__::225::IOProcess::(_processLogs) (540962) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,577::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,578::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:22:58,579::__init__::225::IOProcess::(_processLogs) DEBUG|(540963) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,580::__init__::225::IOProcess::(_processLogs) (540963) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,581::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:22:58,584::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:22:58,584::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,584::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:22:58,584::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,585::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,585::__init__::225::IOProcess::(_processLogs) (540964) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:22:58,585::__init__::225::IOProcess::(_processLogs) (540964) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:22:58,601::__init__::225::IOProcess::(_processLogs) DEBUG|(540964) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,601::__init__::225::IOProcess::(_processLogs) (540964) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,601::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:22:58,602::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:22:58,602::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:58,602::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,602::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) (540965) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:22:58,603::__init__::225::IOProcess::(_processLogs) (540965) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:22:58,605::__init__::225::IOProcess::(_processLogs) DEBUG|(540965) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,605::__init__::225::IOProcess::(_processLogs) (540965) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,605::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:22:58,605::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:22:58,606::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) (540966) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) (540966) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) (540966) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) (540966) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,609::__init__::225::IOProcess::(_processLogs) (540967) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:22:58,609::__init__::225::IOProcess::(_processLogs) (540967) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:22:58,610::__init__::225::IOProcess::(_processLogs) DEBUG|(540967) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,610::__init__::225::IOProcess::(_processLogs) (540967) Queuing response >Thread-28::DEBUG::2014-08-11 17:22:58,610::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:22:58,610::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::INFO::2014-08-11 17:22:58,610::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:22:58,611::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-28::INFO::2014-08-11 17:22:58,611::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:22:58,611::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,611::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) (540968) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) (540968) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:58,612::__init__::225::IOProcess::(_processLogs) DEBUG|(540968) Building response >Thread-28::DEBUG::2014-08-11 17:22:58,613::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:22:58,613::__init__::225::IOProcess::(_processLogs) (540968) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,671::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:22:58,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00178342 s, 278 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:22:58,674::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,674::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:22:58,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,674::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,675::__init__::225::IOProcess::(_processLogs) (540969) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:22:58,675::__init__::225::IOProcess::(_processLogs) (540969) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:22:58,676::__init__::225::IOProcess::(_processLogs) DEBUG|(540969) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,677::__init__::225::IOProcess::(_processLogs) (540969) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,677::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) (540970) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:58,678::__init__::225::IOProcess::(_processLogs) (540970) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:58,680::__init__::225::IOProcess::(_processLogs) DEBUG|(540970) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,680::__init__::225::IOProcess::(_processLogs) (540970) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,680::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) (540971) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:58,681::__init__::225::IOProcess::(_processLogs) (540971) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:58,683::__init__::225::IOProcess::(_processLogs) DEBUG|(540971) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,683::__init__::225::IOProcess::(_processLogs) (540971) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,683::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,683::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:22:58,684::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:22:58,684::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:22:58,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:22:58,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:22:58,684::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:22:58,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) (540972) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) (540972) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) (540972) Building response >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) (540972) Queuing response >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:22:58,685::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:59,526::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:59,527::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:22:59,527::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:59,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:59,560::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:22:59,560::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:22:59,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:22:59,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0560144 s, 18.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:23:00,046::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:23:01,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:01,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0280387 s, 36.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:23:03,175::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:23:03,175::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a241ec8-fa86-4923-95a3-68de0839acd8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:03,176::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:23:03,230::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:03,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a241ec8-fa86-4923-95a3-68de0839acd8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:03,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a241ec8-fa86-4923-95a3-68de0839acd8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:03,230::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:03,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:03,231::task::993::Storage.TaskManager.Task::(_decref) Task=`3a241ec8-fa86-4923-95a3-68de0839acd8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:23:03,241::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:23:03,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`9729b238-0eb8-4d9c-8665-ab620d9142a0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:23:03,241::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:23:03,242::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`76cd6170-be09-4f68-a80a-7026d9984cbd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:23:03,242::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:23:03,242::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:23:03,242::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`76cd6170-be09-4f68-a80a-7026d9984cbd`::Granted request >Thread-10197::DEBUG::2014-08-11 17:23:03,242::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9729b238-0eb8-4d9c-8665-ab620d9142a0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:23:03,242::task::993::Storage.TaskManager.Task::(_decref) Task=`9729b238-0eb8-4d9c-8665-ab620d9142a0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:23:03,259::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:03,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`9729b238-0eb8-4d9c-8665-ab620d9142a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:03,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`9729b238-0eb8-4d9c-8665-ab620d9142a0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:23:03,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:23:03,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:23:03,259::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:23:03,260::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:23:03,260::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:23:03,260::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:23:03,260::task::993::Storage.TaskManager.Task::(_decref) Task=`9729b238-0eb8-4d9c-8665-ab620d9142a0`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:23:03,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:03,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0497943 s, 20.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:04,533::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:04,533::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:04,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:04,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:04,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:04,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:23:05,796::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) (540973) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) (540973) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) (540973) Building response >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) (540973) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:05,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:05,798::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:23:05,798::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:23:05,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00639803 s, 57.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) (540974) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:05,880::__init__::225::IOProcess::(_processLogs) (540974) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:05,883::__init__::225::IOProcess::(_processLogs) (540974) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:05,883::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:23:05,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:06,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414761 s, 24.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:23:06,591::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcae2aaf-542f-421f-8f78-d5d0e66516b0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:06,591::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:23:06,591::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00639803', 'lastCheck': '0.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178342', 'lastCheck': '7.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:06,591::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcae2aaf-542f-421f-8f78-d5d0e66516b0`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00639803', 'lastCheck': '0.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00178342', 'lastCheck': '7.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:06,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcae2aaf-542f-421f-8f78-d5d0e66516b0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:06,592::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:06,592::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:06,592::task::993::Storage.TaskManager.Task::(_decref) Task=`bcae2aaf-542f-421f-8f78-d5d0e66516b0`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:23:06,610::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:23:06,610::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:23:07,501::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:23:08,098::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:08,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447404 s, 22.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:08,685::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:08,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:08,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:08,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:08,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:08,686::__init__::225::IOProcess::(_processLogs) (540975) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:08,686::__init__::225::IOProcess::(_processLogs) (540975) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:08,686::__init__::225::IOProcess::(_processLogs) (540975) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:08,686::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:23:08,687::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:23:08,747::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000929715 s, 532 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) (540976) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:08,748::__init__::225::IOProcess::(_processLogs) (540976) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:08,749::__init__::225::IOProcess::(_processLogs) (540976) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:08,749::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:23:08,749::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) (540977) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) (540977) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) (540977) Building response >Thread-19::DEBUG::2014-08-11 17:23:08,750::__init__::225::IOProcess::(_processLogs) (540977) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:08,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:08,751::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:08,751::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:23:08,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:08,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:08,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) (540978) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) (540978) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) (540978) Building response >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) (540978) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:08,752::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) (540979) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) (540979) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) (540979) Building response >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) (540979) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:08,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:08,754::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:09,539::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:09,540::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:09,540::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:09,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:09,572::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:09,572::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:10,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:10,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128182 s, 79.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:23:12,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:12,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0472917 s, 21.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:23:12,802::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:23:13,296::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:23:13,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ea2c112-b2f0-4471-a1d0-011c42e1b280`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:13,297::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:23:13,332::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:13,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ea2c112-b2f0-4471-a1d0-011c42e1b280`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:13,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ea2c112-b2f0-4471-a1d0-011c42e1b280`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:13,332::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:13,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:13,333::task::993::Storage.TaskManager.Task::(_decref) Task=`8ea2c112-b2f0-4471-a1d0-011c42e1b280`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:23:13,344::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:23:13,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b2d798e-3368-491b-8e84-13b9733d26e5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:23:13,345::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:23:13,345::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`37601397-494c-4f7a-b5c5-0260ade07680`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:23:13,345::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:23:13,345::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:23:13,345::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`37601397-494c-4f7a-b5c5-0260ade07680`::Granted request >Thread-10197::DEBUG::2014-08-11 17:23:13,346::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4b2d798e-3368-491b-8e84-13b9733d26e5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:23:13,346::task::993::Storage.TaskManager.Task::(_decref) Task=`4b2d798e-3368-491b-8e84-13b9733d26e5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:23:13,365::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:13,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`4b2d798e-3368-491b-8e84-13b9733d26e5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:13,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`4b2d798e-3368-491b-8e84-13b9733d26e5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:23:13,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:23:13,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:23:13,366::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:23:13,366::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:23:13,366::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:23:13,366::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:23:13,366::task::993::Storage.TaskManager.Task::(_decref) Task=`4b2d798e-3368-491b-8e84-13b9733d26e5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:23:14,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:14,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0218746 s, 46.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:14,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:14,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:14,547::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:14,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:14,578::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:14,578::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:23:15,884::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:15,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:15,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:15,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:15,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:15,885::__init__::225::IOProcess::(_processLogs) (540980) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:15,885::__init__::225::IOProcess::(_processLogs) (540980) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:15,886::__init__::225::IOProcess::(_processLogs) (540980) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:15,886::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:23:15,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:23:15,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000872567 s, 419 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:15,964::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:15,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:15,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:15,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:15,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:15,965::__init__::225::IOProcess::(_processLogs) (540981) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:15,965::__init__::225::IOProcess::(_processLogs) (540981) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:15,965::__init__::225::IOProcess::(_processLogs) (540981) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:15,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:15,966::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:23:16,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:16,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012479 s, 82.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:23:18,064::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:23:18,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:18,682::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538672 s, 19.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) (540982) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:18,754::__init__::225::IOProcess::(_processLogs) (540982) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:18,755::__init__::225::IOProcess::(_processLogs) (540982) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:18,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:23:18,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:23:18,815::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0014163 s, 350 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) (540983) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:18,816::__init__::225::IOProcess::(_processLogs) (540983) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:18,817::__init__::225::IOProcess::(_processLogs) (540983) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:18,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:18,817::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) (540984) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:18,818::__init__::225::IOProcess::(_processLogs) (540984) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) (540984) Building response >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) (540984) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:23:18,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) (540985) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) (540985) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) (540985) Building response >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) (540985) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:18,820::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:23:18,821::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:18,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:18,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:18,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:18,821::__init__::225::IOProcess::(_processLogs) (540986) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:18,822::__init__::225::IOProcess::(_processLogs) (540986) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:18,822::__init__::225::IOProcess::(_processLogs) (540986) Building response >Thread-19::DEBUG::2014-08-11 17:23:18,822::__init__::225::IOProcess::(_processLogs) (540986) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:18,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:18,822::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:19,552::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:19,553::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:19,553::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:19,579::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:19,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:19,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:20,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:20,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0555696 s, 18.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:23:21,862::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffd81639-f2e4-4efa-b9b6-1cf515fe0294`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:21,862::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:23:21,862::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000872567', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014163', 'lastCheck': '3.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:21,862::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffd81639-f2e4-4efa-b9b6-1cf515fe0294`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000872567', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014163', 'lastCheck': '3.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:21,863::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffd81639-f2e4-4efa-b9b6-1cf515fe0294`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:21,863::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:21,863::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:21,863::task::993::Storage.TaskManager.Task::(_decref) Task=`ffd81639-f2e4-4efa-b9b6-1cf515fe0294`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:23:21,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:23:21,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:23:22,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`f211e9c7-1f51-45cc-be26-6588b433614a`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:23:22,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) (540987) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:23:22,550::__init__::225::IOProcess::(_processLogs) (540987) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:23:22,554::__init__::225::IOProcess::(_processLogs) (540987) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:22,554::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:22,554::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:23:22,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:22,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:23:22,555::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:23:22,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:23:22,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`f211e9c7-1f51-45cc-be26-6588b433614a`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:23:22,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:23:22,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`f211e9c7-1f51-45cc-be26-6588b433614a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:23:22,556::__init__::225::IOProcess::(_processLogs) (540988) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:23:22,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:23:22,557::__init__::225::IOProcess::(_processLogs) (540988) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:23:22,557::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:23:22,557::__init__::225::IOProcess::(_processLogs) (540988) Building response >Thread-10017::DEBUG::2014-08-11 17:23:22,558::task::993::Storage.TaskManager.Task::(_decref) Task=`f211e9c7-1f51-45cc-be26-6588b433614a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:23:22,558::__init__::225::IOProcess::(_processLogs) (540988) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:22,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:22,558::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:23:22,579::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:23:22,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:22,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0309188 s, 33.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:23:23,398::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:23:23,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`acd40cd4-2f71-4c15-9a19-38623e17d3da`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:23,399::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:23:23,413::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:23,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`acd40cd4-2f71-4c15-9a19-38623e17d3da`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:23,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`acd40cd4-2f71-4c15-9a19-38623e17d3da`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:23,413::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:23,413::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:23,414::task::993::Storage.TaskManager.Task::(_decref) Task=`acd40cd4-2f71-4c15-9a19-38623e17d3da`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:23:23,420::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:23:23,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba58fa9e-ab4a-402a-b6c1-f3a27b7a0db6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:23:23,421::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:23:23,421::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`50638f85-0132-41e4-bc2b-76a696be9868`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:23:23,421::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:23:23,421::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:23:23,421::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`50638f85-0132-41e4-bc2b-76a696be9868`::Granted request >Thread-10197::DEBUG::2014-08-11 17:23:23,422::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ba58fa9e-ab4a-402a-b6c1-f3a27b7a0db6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:23:23,422::task::993::Storage.TaskManager.Task::(_decref) Task=`ba58fa9e-ab4a-402a-b6c1-f3a27b7a0db6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:23:23,438::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:23,438::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba58fa9e-ab4a-402a-b6c1-f3a27b7a0db6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:23,438::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba58fa9e-ab4a-402a-b6c1-f3a27b7a0db6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:23:23,438::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:23:23,438::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:23:23,439::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:23:23,439::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:23:23,439::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:23:23,439::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:23:23,439::task::993::Storage.TaskManager.Task::(_decref) Task=`ba58fa9e-ab4a-402a-b6c1-f3a27b7a0db6`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:24,558::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:24,558::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:24,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:24,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:24,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:24,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:24,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:25,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0524119 s, 19.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:25,966::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:25,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:25,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:25,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:25,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:25,967::__init__::225::IOProcess::(_processLogs) (540989) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:25,967::__init__::225::IOProcess::(_processLogs) (540989) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:25,967::__init__::225::IOProcess::(_processLogs) (540989) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:25,967::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:23:25,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:23:26,028::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000836546 s, 438 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) (540990) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:26,029::__init__::225::IOProcess::(_processLogs) (540990) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:26,030::__init__::225::IOProcess::(_processLogs) (540990) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:26,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:26,031::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:23:27,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:27,128::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394726 s, 25.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:23:27,820::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) (540991) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:28,822::__init__::225::IOProcess::(_processLogs) (540991) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:28,826::__init__::225::IOProcess::(_processLogs) DEBUG|(540991) Building response >Thread-19::DEBUG::2014-08-11 17:23:28,826::__init__::225::IOProcess::(_processLogs) (540991) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:28,826::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:23:28,827::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:23:28,827::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:23:28,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000455668 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:28,887::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:23:28,887::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:28,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:28,887::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:28,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:28,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:28,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:28,888::__init__::225::IOProcess::(_processLogs) (540992) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:28,888::__init__::225::IOProcess::(_processLogs) (540992) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:28,888::__init__::225::IOProcess::(_processLogs) DEBUG|(540992) Building response >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) (540992) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:28,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:28,890::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:28,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:28,891::__init__::225::IOProcess::(_processLogs) (540993) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:28,891::__init__::225::IOProcess::(_processLogs) (540993) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:28,891::__init__::225::IOProcess::(_processLogs) (540993) Building response >Thread-19::DEBUG::2014-08-11 17:23:28,891::__init__::225::IOProcess::(_processLogs) (540993) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:28,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:28,892::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) (540994) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) (540994) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) (540994) Building response >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) (540994) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:23:28,893::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) (540995) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) (540995) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) (540995) Building response >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) (540995) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:28,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:28,895::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:23:29,136::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:29,245::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504825 s, 20.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:29,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:29,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:29,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:29,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:29,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:29,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:23:30,089::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:23:31,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:31,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016414 s, 62.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:23:33,337::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:33,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123022 s, 83.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:23:33,472::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:23:33,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`93d25ed0-7b99-43e6-a291-45d048104737`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:33,472::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:23:33,562::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:33,562::task::1191::Storage.TaskManager.Task::(prepare) Task=`93d25ed0-7b99-43e6-a291-45d048104737`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:33,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`93d25ed0-7b99-43e6-a291-45d048104737`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:33,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:33,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:33,562::task::993::Storage.TaskManager.Task::(_decref) Task=`93d25ed0-7b99-43e6-a291-45d048104737`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:23:33,574::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:23:33,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3859316-0698-47c9-9539-bddc5622ac3e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:23:33,574::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:23:33,575::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8134507a-c599-4937-82a8-56ec768ec014`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:23:33,575::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:23:33,575::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:23:33,575::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8134507a-c599-4937-82a8-56ec768ec014`::Granted request >Thread-10197::DEBUG::2014-08-11 17:23:33,575::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d3859316-0698-47c9-9539-bddc5622ac3e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:23:33,575::task::993::Storage.TaskManager.Task::(_decref) Task=`d3859316-0698-47c9-9539-bddc5622ac3e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:23:33,647::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:33,647::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3859316-0698-47c9-9539-bddc5622ac3e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:33,647::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3859316-0698-47c9-9539-bddc5622ac3e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:23:33,647::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:23:33,647::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:23:33,648::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:23:33,648::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:23:33,648::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:23:33,648::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:23:33,648::task::993::Storage.TaskManager.Task::(_decref) Task=`d3859316-0698-47c9-9539-bddc5622ac3e`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:34,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:34,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:34,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:34,592::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:34,593::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:34,593::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:35,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:35,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0668126 s, 15.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:36,031::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:36,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:36,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:36,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:36,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:36,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:36,032::__init__::225::IOProcess::(_processLogs) (540996) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:36,032::__init__::225::IOProcess::(_processLogs) (540996) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:36,032::__init__::225::IOProcess::(_processLogs) (540996) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:36,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:23:36,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:23:36,092::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000590828 s, 619 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:36,092::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) (540997) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) (540997) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:36,093::__init__::225::IOProcess::(_processLogs) (540997) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:36,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10205::DEBUG::2014-08-11 17:23:37,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`71e25d5b-2658-4ffb-99b3-256ea86d6e2b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:37,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:23:37,336::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590828', 'lastCheck': '1.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455668', 'lastCheck': '8.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:37,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`71e25d5b-2658-4ffb-99b3-256ea86d6e2b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000590828', 'lastCheck': '1.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000455668', 'lastCheck': '8.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:37,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`71e25d5b-2658-4ffb-99b3-256ea86d6e2b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:37,337::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:37,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:37,337::task::993::Storage.TaskManager.Task::(_decref) Task=`71e25d5b-2658-4ffb-99b3-256ea86d6e2b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:23:37,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:23:37,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:37,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:23:37,612::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:23:37,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0516262 s, 19.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:38,894::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) (540998) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) (540998) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) (540998) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:38,895::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:23:38,896::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:23:38,955::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000728463 s, 680 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) (540999) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:38,956::__init__::225::IOProcess::(_processLogs) (540999) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:38,957::__init__::225::IOProcess::(_processLogs) (540999) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:38,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:38,957::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:23:38,957::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:23:38,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) (541000) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) (541000) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) (541000) Building response >Thread-19::DEBUG::2014-08-11 17:23:38,958::__init__::225::IOProcess::(_processLogs) (541000) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:38,959::__init__::225::IOProcess::(_processLogs) (541001) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) (541001) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) (541001) Building response >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) (541001) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:38,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:38,961::__init__::225::IOProcess::(_processLogs) (541002) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:38,961::__init__::225::IOProcess::(_processLogs) (541002) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:38,961::__init__::225::IOProcess::(_processLogs) (541002) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:38,961::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:38,961::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:39,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:39,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:39,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:39,595::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:39,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:39,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:39,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:39,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0225144 s, 45.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:23:41,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:41,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124218 s, 82.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:23:42,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`f36e8178-1d22-447c-9c13-2cb1ec686f3c`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:23:42,822::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:23:42,822::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:23:42,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:42,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:42,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:42,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:42,823::__init__::225::IOProcess::(_processLogs) (541003) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:23:42,823::__init__::225::IOProcess::(_processLogs) (541003) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:23:42,823::__init__::225::IOProcess::(_processLogs) (541003) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:42,823::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:23:42,824::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:23:42,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:42,824::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:42,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:23:42,824::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:23:42,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:23:42,825::task::1191::Storage.TaskManager.Task::(prepare) Task=`f36e8178-1d22-447c-9c13-2cb1ec686f3c`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:23:42,825::__init__::225::IOProcess::(_processLogs) (541004) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:23:42,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`f36e8178-1d22-447c-9c13-2cb1ec686f3c`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:23:42,826::__init__::225::IOProcess::(_processLogs) (541004) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:23:42,826::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:23:42,826::__init__::225::IOProcess::(_processLogs) (541004) Building response >Thread-10102::DEBUG::2014-08-11 17:23:42,826::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:23:42,827::__init__::225::IOProcess::(_processLogs) (541004) Queuing response >Thread-10102::DEBUG::2014-08-11 17:23:42,827::task::993::Storage.TaskManager.Task::(_decref) Task=`f36e8178-1d22-447c-9c13-2cb1ec686f3c`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:23:42,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:42,827::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:23:42,847::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:23:43,723::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:23:43,723::task::595::Storage.TaskManager.Task::(_updateState) Task=`61172e11-e3a6-4666-8156-bf294a2709e2`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:43,723::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:23:43,787::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:43,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`61172e11-e3a6-4666-8156-bf294a2709e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:43,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`61172e11-e3a6-4666-8156-bf294a2709e2`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:43,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:43,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:43,788::task::993::Storage.TaskManager.Task::(_decref) Task=`61172e11-e3a6-4666-8156-bf294a2709e2`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:23:43,800::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:23:43,800::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c12d101-87c2-4adf-8795-42325ae00159`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:23:43,800::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:23:43,800::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d05b7ff3-1929-4960-be08-1ad213ba38bc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:23:43,800::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:23:43,801::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:23:43,801::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d05b7ff3-1929-4960-be08-1ad213ba38bc`::Granted request >Thread-10197::DEBUG::2014-08-11 17:23:43,801::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2c12d101-87c2-4adf-8795-42325ae00159`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:23:43,801::task::993::Storage.TaskManager.Task::(_decref) Task=`2c12d101-87c2-4adf-8795-42325ae00159`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:23:43,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10197::INFO::2014-08-11 17:23:43,893::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:43,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c12d101-87c2-4adf-8795-42325ae00159`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:43,893::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c12d101-87c2-4adf-8795-42325ae00159`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:23:43,893::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:23:43,893::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:23:43,894::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:23:43,894::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:23:43,894::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:23:43,894::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:23:43,894::task::993::Storage.TaskManager.Task::(_decref) Task=`2c12d101-87c2-4adf-8795-42325ae00159`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:23:43,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125292 s, 81.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:44,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:44,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:44,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:44,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:44,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:44,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:45,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:45,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129318 s, 79.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) (541005) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:46,095::__init__::225::IOProcess::(_processLogs) (541005) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:46,096::__init__::225::IOProcess::(_processLogs) (541005) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:46,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:23:46,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:23:46,161::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00312302 s, 117 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:46,162::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:46,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:46,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:46,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:46,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:46,162::__init__::225::IOProcess::(_processLogs) (541006) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:46,163::__init__::225::IOProcess::(_processLogs) (541006) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:46,163::__init__::225::IOProcess::(_processLogs) (541006) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:46,163::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:23:47,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:48,063::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138795 s, 73.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:23:48,156::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) (541007) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:48,962::__init__::225::IOProcess::(_processLogs) (541007) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:48,977::__init__::225::IOProcess::(_processLogs) (541007) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:48,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:23:48,978::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:23:49,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000446722 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:49,037::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:49,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:49,037::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:49,037::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:49,038::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:49,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:49,038::__init__::225::IOProcess::(_processLogs) (541008) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:49,038::__init__::225::IOProcess::(_processLogs) (541008) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:49,038::__init__::225::IOProcess::(_processLogs) (541008) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:49,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) (541009) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) (541009) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) (541009) Building response >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) (541009) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:49,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) (541010) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) (541010) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) (541010) Building response >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) (541010) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:49,041::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:23:49,042::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:49,042::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:49,042::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:49,042::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:49,042::__init__::225::IOProcess::(_processLogs) (541011) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:49,042::__init__::225::IOProcess::(_processLogs) (541011) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:49,043::__init__::225::IOProcess::(_processLogs) (541011) Building response >Thread-19::DEBUG::2014-08-11 17:23:49,043::__init__::225::IOProcess::(_processLogs) (541011) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:49,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:49,043::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:49,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:49,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:49,586::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:49,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:49,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:49,609::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:23:50,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:50,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0219602 s, 46.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:23:52,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:52,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146371 s, 70.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:23:52,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4456a5f-cc36-46a4-878a-327e15fc7217`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:52,508::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:23:52,508::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00312302', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446722', 'lastCheck': '3.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:52,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4456a5f-cc36-46a4-878a-327e15fc7217`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00312302', 'lastCheck': '6.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446722', 'lastCheck': '3.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:23:52,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4456a5f-cc36-46a4-878a-327e15fc7217`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:52,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:52,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:52,508::task::993::Storage.TaskManager.Task::(_decref) Task=`c4456a5f-cc36-46a4-878a-327e15fc7217`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:23:52,527::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:23:52,527::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:23:52,619::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:23:53,941::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:23:53,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b9de03c-3c85-4fbc-8e90-90938994a55b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:23:53,941::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:23:53,955::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:53,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b9de03c-3c85-4fbc-8e90-90938994a55b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:23:53,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b9de03c-3c85-4fbc-8e90-90938994a55b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:23:53,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:23:53,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:23:53,956::task::993::Storage.TaskManager.Task::(_decref) Task=`8b9de03c-3c85-4fbc-8e90-90938994a55b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:23:53,962::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:23:53,963::task::595::Storage.TaskManager.Task::(_updateState) Task=`1691ccab-ddf4-44fb-aad5-9ddcc65cddf5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:23:53,963::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:23:53,963::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f2640ee1-e41e-4b12-b2fc-8127695bca00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:23:53,963::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:23:53,963::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:23:53,963::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f2640ee1-e41e-4b12-b2fc-8127695bca00`::Granted request >Thread-10197::DEBUG::2014-08-11 17:23:53,963::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1691ccab-ddf4-44fb-aad5-9ddcc65cddf5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:23:53,963::task::993::Storage.TaskManager.Task::(_decref) Task=`1691ccab-ddf4-44fb-aad5-9ddcc65cddf5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:23:53,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:53,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`1691ccab-ddf4-44fb-aad5-9ddcc65cddf5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:23:53,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`1691ccab-ddf4-44fb-aad5-9ddcc65cddf5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:23:53,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:23:53,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:23:53,980::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:23:53,980::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:23:53,981::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:23:53,981::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:23:53,981::task::993::Storage.TaskManager.Task::(_decref) Task=`1691ccab-ddf4-44fb-aad5-9ddcc65cddf5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:23:54,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:54,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0461138 s, 22.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:54,590::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:54,590::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:54,591::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:54,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:54,615::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:54,615::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:23:56,164::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:56,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:56,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:56,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:23:56,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:56,165::__init__::225::IOProcess::(_processLogs) (541012) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:56,165::__init__::225::IOProcess::(_processLogs) (541012) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:56,165::__init__::225::IOProcess::(_processLogs) (541012) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:56,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:23:56,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:23:56,166::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:23:56,225::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000330034 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:56,225::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:56,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:56,226::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:56,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:56,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:56,226::__init__::225::IOProcess::(_processLogs) (541013) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:56,227::__init__::225::IOProcess::(_processLogs) (541013) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:56,227::__init__::225::IOProcess::(_processLogs) (541013) Building response >Thread-19::DEBUG::2014-08-11 17:23:56,227::__init__::225::IOProcess::(_processLogs) (541013) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:56,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:56,227::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:23:56,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:56,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.020077 s, 51.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:23:57,855::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:23:58,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:23:58,524::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130002 s, 78.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:59,043::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:59,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:59,043::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:59,043::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:59,044::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-28::DEBUG::2014-08-11 17:23:59,044::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:23:59,044::__init__::225::IOProcess::(_processLogs) (541014) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:59,102::__init__::225::IOProcess::(_processLogs) (541014) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:59,103::__init__::225::IOProcess::(_processLogs) (541014) Building response >Thread-19::DEBUG::2014-08-11 17:23:59,103::__init__::225::IOProcess::(_processLogs) (541014) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:59,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:59,103::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:23:59,103::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000441937 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) (541015) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:23:59,104::__init__::225::IOProcess::(_processLogs) (541015) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:23:59,105::__init__::225::IOProcess::(_processLogs) (541015) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:59,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:59,105::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:23:59,105::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) (541016) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) (541016) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) (541016) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:59,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) (541017) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) (541017) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:59,107::__init__::225::IOProcess::(_processLogs) (541017) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:23:59,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:23:59,109::__init__::225::IOProcess::(_processLogs) (541018) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:23:59,109::__init__::225::IOProcess::(_processLogs) (541018) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:23:59,109::__init__::225::IOProcess::(_processLogs) (541018) Building response >Thread-19::DEBUG::2014-08-11 17:23:59,109::__init__::225::IOProcess::(_processLogs) (541018) Queuing response >Thread-19::DEBUG::2014-08-11 17:23:59,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:23:59,109::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:59,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:59,597::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:23:59,597::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:59,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:59,621::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:23:59,621::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:24:00,169::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:24:00,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:00,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200325 s, 51.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:24:02,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:02,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0350491 s, 29.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:24:04,040::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:24:04,041::task::595::Storage.TaskManager.Task::(_updateState) Task=`491abf79-c920-493c-b087-6a26bd235f46`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:04,041::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:24:04,097::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:04,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`491abf79-c920-493c-b087-6a26bd235f46`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:04,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`491abf79-c920-493c-b087-6a26bd235f46`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:04,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:04,098::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:04,098::task::993::Storage.TaskManager.Task::(_decref) Task=`491abf79-c920-493c-b087-6a26bd235f46`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:24:04,108::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:24:04,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`5553659f-5e79-4cca-a1d3-bee00f2079d8`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:24:04,108::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:24:04,108::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5c3f91df-0722-44ff-88e1-5b342862365c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:24:04,108::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:24:04,109::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:24:04,109::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5c3f91df-0722-44ff-88e1-5b342862365c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:24:04,109::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5553659f-5e79-4cca-a1d3-bee00f2079d8`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:24:04,109::task::993::Storage.TaskManager.Task::(_decref) Task=`5553659f-5e79-4cca-a1d3-bee00f2079d8`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:24:04,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:04,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`5553659f-5e79-4cca-a1d3-bee00f2079d8`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:04,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`5553659f-5e79-4cca-a1d3-bee00f2079d8`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:24:04,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:24:04,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:24:04,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:24:04,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:24:04,126::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:24:04,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:24:04,126::task::993::Storage.TaskManager.Task::(_decref) Task=`5553659f-5e79-4cca-a1d3-bee00f2079d8`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:04,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:04,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:04,600::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:04,627::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:04,627::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:04,628::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:04,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:04,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126549 s, 80.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:06,227::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:06,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:06,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:06,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:06,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:06,228::__init__::225::IOProcess::(_processLogs) (541019) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:06,228::__init__::225::IOProcess::(_processLogs) (541019) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:06,231::__init__::225::IOProcess::(_processLogs) (541019) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:06,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:24:06,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:24:06,292::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00150187 s, 244 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) (541020) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) (541020) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:06,293::__init__::225::IOProcess::(_processLogs) (541020) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:06,294::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:24:06,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:06,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492206 s, 20.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:24:07,684::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:24:07,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`26d77e83-3d05-4e37-9666-f897d3acb4c9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:07,719::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:24:07,720::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150187', 'lastCheck': '1.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441937', 'lastCheck': '8.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:07,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`26d77e83-3d05-4e37-9666-f897d3acb4c9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150187', 'lastCheck': '1.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000441937', 'lastCheck': '8.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:07,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`26d77e83-3d05-4e37-9666-f897d3acb4c9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:07,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:07,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:07,720::task::993::Storage.TaskManager.Task::(_decref) Task=`26d77e83-3d05-4e37-9666-f897d3acb4c9`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:24:07,737::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:24:07,738::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:08,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:08,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135878 s, 75.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:09,109::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:09,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:09,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:09,110::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:09,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:09,110::__init__::225::IOProcess::(_processLogs) (541021) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:09,110::__init__::225::IOProcess::(_processLogs) (541021) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:09,111::__init__::225::IOProcess::(_processLogs) (541021) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:09,111::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:24:09,111::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:24:09,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00215465 s, 230 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) (541022) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:09,188::__init__::225::IOProcess::(_processLogs) (541022) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:09,189::__init__::225::IOProcess::(_processLogs) (541022) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:09,189::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:09,190::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:24:09,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:09,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:09,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:09,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:09,190::__init__::225::IOProcess::(_processLogs) (541023) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) (541023) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) (541023) Building response >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) (541023) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:24:09,191::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) (541024) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) (541024) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) (541024) Building response >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) (541024) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:24:09,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:09,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:09,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:09,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:09,193::__init__::225::IOProcess::(_processLogs) (541025) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:09,193::__init__::225::IOProcess::(_processLogs) (541025) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:09,193::__init__::225::IOProcess::(_processLogs) (541025) Building response >Thread-19::DEBUG::2014-08-11 17:24:09,194::__init__::225::IOProcess::(_processLogs) (541025) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:09,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:09,194::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:09,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:09,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:09,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:09,633::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:09,634::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:09,634::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:11,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:11,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529662 s, 19.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:24:12,869::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:24:13,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:13,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0890624 s, 11.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:24:14,160::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:24:14,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`34bae428-72b5-4d7c-a932-5b80c9db2ddd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:14,161::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:24:14,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:14,187::task::1191::Storage.TaskManager.Task::(prepare) Task=`34bae428-72b5-4d7c-a932-5b80c9db2ddd`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:14,187::task::595::Storage.TaskManager.Task::(_updateState) Task=`34bae428-72b5-4d7c-a932-5b80c9db2ddd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:14,187::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:14,187::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:14,187::task::993::Storage.TaskManager.Task::(_decref) Task=`34bae428-72b5-4d7c-a932-5b80c9db2ddd`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:24:14,194::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:24:14,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`d17cb659-2a8c-452c-be3c-02ee4651cd1a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:24:14,194::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:24:14,194::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`81712367-73f2-4c77-a472-9d173f1e7804`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:24:14,195::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:24:14,195::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:24:14,195::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`81712367-73f2-4c77-a472-9d173f1e7804`::Granted request >Thread-10197::DEBUG::2014-08-11 17:24:14,195::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d17cb659-2a8c-452c-be3c-02ee4651cd1a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:24:14,195::task::993::Storage.TaskManager.Task::(_decref) Task=`d17cb659-2a8c-452c-be3c-02ee4651cd1a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:24:14,212::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:14,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`d17cb659-2a8c-452c-be3c-02ee4651cd1a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:14,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`d17cb659-2a8c-452c-be3c-02ee4651cd1a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:24:14,212::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:24:14,212::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:24:14,213::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:24:14,213::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:24:14,213::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:24:14,213::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:24:14,213::task::993::Storage.TaskManager.Task::(_decref) Task=`d17cb659-2a8c-452c-be3c-02ee4651cd1a`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:14,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:14,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:14,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:14,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:14,639::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:14,639::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:15,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:15,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0639722 s, 16.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) (541026) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:16,295::__init__::225::IOProcess::(_processLogs) (541026) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:16,297::__init__::225::IOProcess::(_processLogs) (541026) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:16,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:24:16,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:24:16,365::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00111929 s, 327 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:16,365::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:16,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) (541027) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) (541027) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:16,366::__init__::225::IOProcess::(_processLogs) (541027) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:16,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:16,367::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:24:17,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:17,583::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10548 s, 9.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:24:18,187::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) (541028) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:19,194::__init__::225::IOProcess::(_processLogs) (541028) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:19,195::__init__::225::IOProcess::(_processLogs) (541028) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:19,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:24:19,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:24:19,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00380598 s, 130 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:19,260::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:19,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:19,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:19,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:19,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:19,261::__init__::225::IOProcess::(_processLogs) (541029) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:19,261::__init__::225::IOProcess::(_processLogs) (541029) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:19,261::__init__::225::IOProcess::(_processLogs) (541029) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:19,262::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) (541030) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) (541030) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) (541030) Building response >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) (541030) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:19,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) (541031) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) (541031) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) (541031) Building response >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) (541031) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:19,264::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:19,265::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:24:19,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:19,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:19,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:19,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:19,265::__init__::225::IOProcess::(_processLogs) (541032) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:19,266::__init__::225::IOProcess::(_processLogs) (541032) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:19,266::__init__::225::IOProcess::(_processLogs) (541032) Building response >Thread-19::DEBUG::2014-08-11 17:24:19,266::__init__::225::IOProcess::(_processLogs) (541032) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:19,266::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:19,266::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:24:19,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:19,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:19,652::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:19,656::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:19,656::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:19,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:19,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:19,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0159547 s, 64.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:24:21,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:21,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133198 s, 76.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:24:22,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`97481c23-090f-492a-8c9a-5052d3b20eb1`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:24:22,699::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:24:22,699::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:24:22,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:22,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:22,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:22,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:22,700::__init__::225::IOProcess::(_processLogs) (541033) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:24:22,700::__init__::225::IOProcess::(_processLogs) (541033) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:24:22,701::__init__::225::IOProcess::(_processLogs) (541033) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:22,701::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:24:22,701::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:24:22,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:22,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:24:22,702::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:24:22,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:24:22,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`97481c23-090f-492a-8c9a-5052d3b20eb1`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:24:22,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:24:22,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`97481c23-090f-492a-8c9a-5052d3b20eb1`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:24:22,703::__init__::225::IOProcess::(_processLogs) (541034) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:24:22,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:24:22,704::__init__::225::IOProcess::(_processLogs) (541034) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:24:22,704::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:24:22,704::__init__::225::IOProcess::(_processLogs) (541034) Building response >Thread-10017::DEBUG::2014-08-11 17:24:22,705::task::993::Storage.TaskManager.Task::(_decref) Task=`97481c23-090f-492a-8c9a-5052d3b20eb1`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:24:22,705::__init__::225::IOProcess::(_processLogs) (541034) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:22,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:22,705::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:24:22,724::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:24:22,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`9671210f-69d8-4be5-b122-a02b27523505`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:22,942::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:24:22,943::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111929', 'lastCheck': '6.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00380598', 'lastCheck': '3.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:22,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`9671210f-69d8-4be5-b122-a02b27523505`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111929', 'lastCheck': '6.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00380598', 'lastCheck': '3.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:22,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`9671210f-69d8-4be5-b122-a02b27523505`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:22,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:22,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:22,943::task::993::Storage.TaskManager.Task::(_decref) Task=`9671210f-69d8-4be5-b122-a02b27523505`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:24:22,961::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:24:22,962::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:23,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:23,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291309 s, 35.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:24:24,284::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:24:24,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`4364744a-815c-471e-af20-bd5261488fda`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:24,284::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:24:24,301::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:24,301::task::1191::Storage.TaskManager.Task::(prepare) Task=`4364744a-815c-471e-af20-bd5261488fda`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:24,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`4364744a-815c-471e-af20-bd5261488fda`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:24,302::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:24,302::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:24,302::task::993::Storage.TaskManager.Task::(_decref) Task=`4364744a-815c-471e-af20-bd5261488fda`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:24:24,313::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:24:24,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`33f72830-dc3d-4abd-8613-dffae7bc2fbf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:24:24,313::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:24:24,314::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3722f193-e583-48bb-94a2-590275bdd7bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:24:24,314::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:24:24,314::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:24:24,314::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3722f193-e583-48bb-94a2-590275bdd7bf`::Granted request >Thread-10197::DEBUG::2014-08-11 17:24:24,314::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`33f72830-dc3d-4abd-8613-dffae7bc2fbf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:24:24,314::task::993::Storage.TaskManager.Task::(_decref) Task=`33f72830-dc3d-4abd-8613-dffae7bc2fbf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:24:24,364::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:24,364::task::1191::Storage.TaskManager.Task::(prepare) Task=`33f72830-dc3d-4abd-8613-dffae7bc2fbf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:24,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`33f72830-dc3d-4abd-8613-dffae7bc2fbf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:24:24,364::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:24:24,364::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:24:24,365::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:24:24,365::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:24:24,365::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:24:24,365::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:24:24,365::task::993::Storage.TaskManager.Task::(_decref) Task=`33f72830-dc3d-4abd-8613-dffae7bc2fbf`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:24,669::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:24,669::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:24,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:24,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:24,674::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:24,674::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:25,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:25,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143873 s, 71.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) (541035) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:26,368::__init__::225::IOProcess::(_processLogs) (541035) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:26,373::__init__::225::IOProcess::(_processLogs) (541035) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:26,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:24:26,373::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:24:26,432::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000428966 s, 853 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) (541036) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) (541036) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:26,433::__init__::225::IOProcess::(_processLogs) (541036) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:26,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:26,434::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:24:27,877::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:24:27,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:28,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016583 s, 61.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:29,266::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:29,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:29,266::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:29,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:29,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:29,267::__init__::225::IOProcess::(_processLogs) (541037) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:29,267::__init__::225::IOProcess::(_processLogs) (541037) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:29,267::__init__::225::IOProcess::(_processLogs) (541037) Queuing response >Thread-28::DEBUG::2014-08-11 17:24:29,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:29,268::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:29,326::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:24:29,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0197686 s, 25.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) (541038) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) (541038) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:29,367::__init__::225::IOProcess::(_processLogs) (541038) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:29,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:29,368::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:29,368::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:24:29,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:29,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:29,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:29,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:29,369::__init__::225::IOProcess::(_processLogs) (541039) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:29,369::__init__::225::IOProcess::(_processLogs) (541039) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:29,370::__init__::225::IOProcess::(_processLogs) (541039) Building response >Thread-19::DEBUG::2014-08-11 17:24:29,371::__init__::225::IOProcess::(_processLogs) (541039) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:29,372::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:29,372::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:29,374::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:24:29,374::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:29,375::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:29,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:29,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:29,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:29,376::__init__::225::IOProcess::(_processLogs) (541040) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:29,376::__init__::225::IOProcess::(_processLogs) (541040) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:29,377::__init__::225::IOProcess::(_processLogs) (541040) Building response >Thread-19::DEBUG::2014-08-11 17:24:29,377::__init__::225::IOProcess::(_processLogs) (541040) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:29,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:29,378::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:29,379::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:24:29,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:29,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:29,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:29,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:29,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:29,380::__init__::225::IOProcess::(_processLogs) (541041) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:29,380::__init__::225::IOProcess::(_processLogs) (541041) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:29,380::__init__::225::IOProcess::(_processLogs) (541041) Building response >Thread-19::DEBUG::2014-08-11 17:24:29,381::__init__::225::IOProcess::(_processLogs) (541041) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:29,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:29,381::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:24:29,680::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:29,680::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:29,680::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:29,681::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:29,682::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:29,682::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:30,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:30,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0224958 s, 45.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:24:30,199::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:24:32,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:32,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206997 s, 49.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:24:34,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:34,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128975 s, 79.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:24:34,395::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:24:34,395::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e16e21c-0ca4-4151-a40e-0dce6bf6d170`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:34,395::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:24:34,417::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:34,418::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e16e21c-0ca4-4151-a40e-0dce6bf6d170`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:34,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e16e21c-0ca4-4151-a40e-0dce6bf6d170`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:34,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:34,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:34,418::task::993::Storage.TaskManager.Task::(_decref) Task=`1e16e21c-0ca4-4151-a40e-0dce6bf6d170`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:24:34,424::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:24:34,424::task::595::Storage.TaskManager.Task::(_updateState) Task=`bacfc42c-cab5-45dc-a161-91a4e1693a58`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:24:34,424::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:24:34,425::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`78d7aa48-a3b0-462a-894f-975136fb1528`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:24:34,425::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:24:34,425::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:24:34,425::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`78d7aa48-a3b0-462a-894f-975136fb1528`::Granted request >Thread-10197::DEBUG::2014-08-11 17:24:34,425::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bacfc42c-cab5-45dc-a161-91a4e1693a58`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:24:34,425::task::993::Storage.TaskManager.Task::(_decref) Task=`bacfc42c-cab5-45dc-a161-91a4e1693a58`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:24:34,442::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:34,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`bacfc42c-cab5-45dc-a161-91a4e1693a58`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:34,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`bacfc42c-cab5-45dc-a161-91a4e1693a58`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:24:34,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:24:34,442::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:24:34,442::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:24:34,442::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:24:34,442::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:24:34,442::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:24:34,442::task::993::Storage.TaskManager.Task::(_decref) Task=`bacfc42c-cab5-45dc-a161-91a4e1693a58`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:24:34,682::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:34,682::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:34,683::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:34,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:34,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:34,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:36,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:36,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317993 s, 32.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:36,435::__init__::225::IOProcess::(_processLogs) (541041) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:36,436::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:36,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:36,436::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:36,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:36,436::__init__::225::IOProcess::(_processLogs) (541041) Got request for method 'access'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:36,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-27::DEBUG::2014-08-11 17:24:36,437::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:36,437::__init__::225::IOProcess::(_processLogs) (541042) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:36,524::__init__::225::IOProcess::(_processLogs) (541042) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:36,526::__init__::225::IOProcess::(_processLogs) (541042) Building response >Thread-27::DEBUG::2014-08-11 17:24:36,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000333987 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:36,526::__init__::225::IOProcess::(_processLogs) (541042) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:36,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:36,528::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:36,528::__init__::225::IOProcess::(_processLogs) (541041) Got request for method 'access'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:36,528::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:36,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) (541043) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) (541043) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:36,529::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(541043) Building response >Thread-19::DEBUG::2014-08-11 17:24:36,530::__init__::225::IOProcess::(_processLogs) (541043) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:36,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:36,530::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:24:37,731::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:24:38,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`a913f01a-017f-451a-90f4-f40205caad69`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:38,198::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:24:38,198::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333987', 'lastCheck': '1.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0197686', 'lastCheck': '8.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:38,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`a913f01a-017f-451a-90f4-f40205caad69`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333987', 'lastCheck': '1.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0197686', 'lastCheck': '8.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:38,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`a913f01a-017f-451a-90f4-f40205caad69`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:38,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:38,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:38,198::task::993::Storage.TaskManager.Task::(_decref) Task=`a913f01a-017f-451a-90f4-f40205caad69`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:24:38,219::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:24:38,219::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:38,432::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:38,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134808 s, 76.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:39,381::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:39,381::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:39,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:39,381::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:39,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:39,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:39,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:39,382::__init__::225::IOProcess::(_processLogs) (541044) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:39,382::__init__::225::IOProcess::(_processLogs) (541044) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:39,382::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(541044) Building response >Thread-28::DEBUG::2014-08-11 17:24:39,383::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:39,383::__init__::225::IOProcess::(_processLogs) (541044) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:39,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:24:39,443::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000396169 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:39,443::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:39,445::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:39,445::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:39,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:39,447::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:39,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:39,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:39,448::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:39,448::__init__::225::IOProcess::(_processLogs) (541045) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:39,449::__init__::225::IOProcess::(_processLogs) (541045) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:39,450::__init__::225::IOProcess::(_processLogs) (541045) Building response >Thread-19::DEBUG::2014-08-11 17:24:39,451::__init__::225::IOProcess::(_processLogs) (541045) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:39,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:39,451::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:39,452::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:39,453::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:24:39,453::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:39,453::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:39,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:39,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:39,453::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) (541046) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) (541046) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) DEBUG|(541046) Building response >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) (541046) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:39,454::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) (541047) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:39,455::__init__::225::IOProcess::(_processLogs) (541047) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) (541047) Building response >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) (541047) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:39,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:39,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:39,457::__init__::225::IOProcess::(_processLogs) (541048) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:39,457::__init__::225::IOProcess::(_processLogs) (541048) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:39,457::__init__::225::IOProcess::(_processLogs) DEBUG|(541048) Building response >Thread-19::DEBUG::2014-08-11 17:24:39,457::__init__::225::IOProcess::(_processLogs) (541048) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:39,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:39,458::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:24:39,687::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:39,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:39,688::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:39,693::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:39,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:39,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:40,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:40,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342903 s, 29.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:24:42,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:42,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015239 s, 67.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:24:42,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd8795a-3c28-457c-9232-061bb16ddebd`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:24:42,878::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:42,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:42,880::__init__::225::IOProcess::(_processLogs) (541049) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:24:42,880::__init__::225::IOProcess::(_processLogs) (541049) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:24:42,880::__init__::225::IOProcess::(_processLogs) DEBUG|(541049) Building response >Thread-19::DEBUG::2014-08-11 17:24:42,880::__init__::225::IOProcess::(_processLogs) (541049) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:42,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:42,880::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:24:42,881::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:42,881::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:24:42,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:42,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:42,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:42,881::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:24:42,881::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:24:42,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:24:42,882::task::1191::Storage.TaskManager.Task::(prepare) Task=`9bd8795a-3c28-457c-9232-061bb16ddebd`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:24:42,882::__init__::225::IOProcess::(_processLogs) (541050) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:24:42,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bd8795a-3c28-457c-9232-061bb16ddebd`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:24:42,883::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:24:42,883::__init__::225::IOProcess::(_processLogs) (541050) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:24:42,883::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:24:42,884::__init__::225::IOProcess::(_processLogs) (541050) Building response >Thread-10102::DEBUG::2014-08-11 17:24:42,884::task::993::Storage.TaskManager.Task::(_decref) Task=`9bd8795a-3c28-457c-9232-061bb16ddebd`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:24:42,884::__init__::225::IOProcess::(_processLogs) (541050) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:42,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:42,885::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:24:42,906::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:24:44,568::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:24:44,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd059bc1-b9f4-4d63-91fa-bf1c7fc2ae48`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:44,569::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:24:44,592::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:44,593::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd059bc1-b9f4-4d63-91fa-bf1c7fc2ae48`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:44,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd059bc1-b9f4-4d63-91fa-bf1c7fc2ae48`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:44,593::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:44,593::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:44,593::task::993::Storage.TaskManager.Task::(_decref) Task=`fd059bc1-b9f4-4d63-91fa-bf1c7fc2ae48`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:24:44,605::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:24:44,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bfff840-f95b-4fd4-b28c-9bf8f67a8324`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:24:44,605::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:24:44,605::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9c502fb-acc2-4d6e-89e7-354a3e218939`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:24:44,605::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:24:44,606::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:24:44,606::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9c502fb-acc2-4d6e-89e7-354a3e218939`::Granted request >Thread-10197::DEBUG::2014-08-11 17:24:44,606::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6bfff840-f95b-4fd4-b28c-9bf8f67a8324`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:24:44,606::task::993::Storage.TaskManager.Task::(_decref) Task=`6bfff840-f95b-4fd4-b28c-9bf8f67a8324`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:24:44,626::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:44,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`6bfff840-f95b-4fd4-b28c-9bf8f67a8324`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56476303360', 'isoprefix': '', 'alerts': [], 'disktotal': '621448003584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:44,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`6bfff840-f95b-4fd4-b28c-9bf8f67a8324`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:24:44,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:24:44,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:24:44,626::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:24:44,626::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:24:44,626::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:24:44,626::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:24:44,626::task::993::Storage.TaskManager.Task::(_decref) Task=`6bfff840-f95b-4fd4-b28c-9bf8f67a8324`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:24:44,691::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:44,692::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:44,692::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:44,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:44,754::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:44,754::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:44,755::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:44,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0573871 s, 17.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) (541051) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:46,531::__init__::225::IOProcess::(_processLogs) (541051) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:46,532::__init__::225::IOProcess::(_processLogs) DEBUG|(541051) Building response >Thread-19::DEBUG::2014-08-11 17:24:46,532::__init__::225::IOProcess::(_processLogs) (541051) Queuing response >Thread-27::DEBUG::2014-08-11 17:24:46,532::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:46,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:46,591::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:24:46,593::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00112397 s, 326 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:46,593::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:46,593::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:46,593::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:46,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:46,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:46,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:46,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:46,594::__init__::225::IOProcess::(_processLogs) (541052) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:46,594::__init__::225::IOProcess::(_processLogs) (541052) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:46,595::__init__::225::IOProcess::(_processLogs) DEBUG|(541052) Building response >Thread-19::DEBUG::2014-08-11 17:24:46,595::__init__::225::IOProcess::(_processLogs) (541052) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:46,595::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:24:46,595::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:24:46,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:46,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124547 s, 82.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:24:48,217::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:24:48,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:49,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508397 s, 20.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:49,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:49,459::__init__::225::IOProcess::(_processLogs) (541053) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:49,459::__init__::225::IOProcess::(_processLogs) (541053) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:49,459::__init__::225::IOProcess::(_processLogs) DEBUG|(541053) Building response >Thread-28::DEBUG::2014-08-11 17:24:49,460::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:49,460::__init__::225::IOProcess::(_processLogs) (541053) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:49,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:49,518::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:24:49,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000829432 s, 597 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:49,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:49,523::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:49,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:49,524::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:49,524::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:49,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:49,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:49,526::__init__::225::IOProcess::(_processLogs) (541054) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:49,526::__init__::225::IOProcess::(_processLogs) (541054) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:49,526::__init__::225::IOProcess::(_processLogs) DEBUG|(541054) Building response >Thread-19::DEBUG::2014-08-11 17:24:49,526::__init__::225::IOProcess::(_processLogs) (541054) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:49,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:49,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) (541055) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) (541055) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) (541055) Building response >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) (541055) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:49,528::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) (541056) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) (541056) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) (541056) Building response >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) (541056) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:49,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:49,530::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:49,530::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:49,530::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:24:49,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:49,530::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:49,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) (541057) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) (541057) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) (541057) Building response >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) (541057) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:49,531::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:24:49,693::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:49,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:49,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:49,760::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:49,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:49,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:51,076::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:51,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396752 s, 25.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:24:52,760::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:24:53,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:53,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128946 s, 79.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:24:53,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8389a72-e72c-4abc-8bf3-11a108b96d9d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:53,397::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:24:53,397::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112397', 'lastCheck': '6.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000829432', 'lastCheck': '3.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:53,397::task::1191::Storage.TaskManager.Task::(prepare) Task=`a8389a72-e72c-4abc-8bf3-11a108b96d9d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112397', 'lastCheck': '6.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000829432', 'lastCheck': '3.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:24:53,397::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8389a72-e72c-4abc-8bf3-11a108b96d9d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:53,398::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:53,398::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:53,398::task::993::Storage.TaskManager.Task::(_decref) Task=`a8389a72-e72c-4abc-8bf3-11a108b96d9d`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:24:53,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:24:53,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:24:54,666::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:24:54,666::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac0d748-b63e-4356-859d-0e98904ac9f0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:24:54,667::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >GuestMonitor-vm::DEBUG::2014-08-11 17:24:54,700::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:54,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:54,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::INFO::2014-08-11 17:24:54,718::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:54,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ac0d748-b63e-4356-859d-0e98904ac9f0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:24:54,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ac0d748-b63e-4356-859d-0e98904ac9f0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:24:54,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:24:54,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:24:54,718::task::993::Storage.TaskManager.Task::(_decref) Task=`4ac0d748-b63e-4356-859d-0e98904ac9f0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:24:54,730::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:24:54,730::task::595::Storage.TaskManager.Task::(_updateState) Task=`718a4919-383c-44ce-b8cf-ee67fad7b50f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:24:54,730::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:24:54,730::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4f32e3e6-779d-410c-b99b-32009819b499`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:24:54,730::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:24:54,730::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:24:54,730::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4f32e3e6-779d-410c-b99b-32009819b499`::Granted request >Thread-10197::DEBUG::2014-08-11 17:24:54,731::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`718a4919-383c-44ce-b8cf-ee67fad7b50f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:24:54,731::task::993::Storage.TaskManager.Task::(_decref) Task=`718a4919-383c-44ce-b8cf-ee67fad7b50f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:24:54,747::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:54,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`718a4919-383c-44ce-b8cf-ee67fad7b50f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:24:54,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`718a4919-383c-44ce-b8cf-ee67fad7b50f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:24:54,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:24:54,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:24:54,747::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:24:54,747::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:24:54,747::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:24:54,748::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:24:54,748::task::993::Storage.TaskManager.Task::(_decref) Task=`718a4919-383c-44ce-b8cf-ee67fad7b50f`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:54,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:54,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:54,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:24:55,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:55,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0612732 s, 16.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:56,596::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:56,596::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:56,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:56,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:56,597::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:56,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:56,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:56,597::__init__::225::IOProcess::(_processLogs) (541058) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:56,597::__init__::225::IOProcess::(_processLogs) (541058) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:56,617::__init__::225::IOProcess::(_processLogs) DEBUG|(541058) Building response >Thread-19::DEBUG::2014-08-11 17:24:56,617::__init__::225::IOProcess::(_processLogs) (541058) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:56,617::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:56,617::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:24:56,618::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:24:56,677::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000393971 s, 929 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:56,677::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:56,677::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:56,677::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:56,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:56,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:56,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:56,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:56,678::__init__::225::IOProcess::(_processLogs) (541059) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:56,678::__init__::225::IOProcess::(_processLogs) (541059) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:56,678::__init__::225::IOProcess::(_processLogs) DEBUG|(541059) Building response >Thread-19::DEBUG::2014-08-11 17:24:56,679::__init__::225::IOProcess::(_processLogs) (541059) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:56,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:56,679::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:24:57,390::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:24:57,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189468 s, 54.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:24:57,943::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:24:59,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:59,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:59,536::__init__::225::IOProcess::(_processLogs) (541060) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:59,536::__init__::225::IOProcess::(_processLogs) (541060) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:59,544::__init__::225::IOProcess::(_processLogs) DEBUG|(541060) Building response >Thread-19::DEBUG::2014-08-11 17:24:59,544::__init__::225::IOProcess::(_processLogs) (541060) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:59,545::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:24:59,546::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:24:59,546::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:24:59,608::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000323967 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:59,610::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:59,611::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:24:59,612::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:59,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:59,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:59,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-51::DEBUG::2014-08-11 17:24:59,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.080661 s, 12.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:24:59,616::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:59,617::__init__::225::IOProcess::(_processLogs) (541061) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:24:59,617::__init__::225::IOProcess::(_processLogs) (541061) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:24:59,618::__init__::225::IOProcess::(_processLogs) (541061) Building response >Thread-19::DEBUG::2014-08-11 17:24:59,618::__init__::225::IOProcess::(_processLogs) (541061) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:59,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:59,619::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:24:59,620::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:59,621::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:24:59,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:59,622::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:59,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:59,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:59,624::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:59,624::__init__::225::IOProcess::(_processLogs) (541062) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:59,625::__init__::225::IOProcess::(_processLogs) (541062) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:59,626::__init__::225::IOProcess::(_processLogs) (541062) Building response >Thread-19::DEBUG::2014-08-11 17:24:59,626::__init__::225::IOProcess::(_processLogs) (541062) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:59,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:59,627::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:59,628::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:59,629::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:24:59,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:59,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:59,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:59,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:59,632::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:59,632::__init__::225::IOProcess::(_processLogs) (541063) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:59,633::__init__::225::IOProcess::(_processLogs) (541063) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:59,633::__init__::225::IOProcess::(_processLogs) (541063) Building response >Thread-19::DEBUG::2014-08-11 17:24:59,633::__init__::225::IOProcess::(_processLogs) (541063) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:59,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:59,634::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:24:59,635::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:24:59,635::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:24:59,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:24:59,636::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:24:59,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:24:59,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:24:59,638::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:24:59,639::__init__::225::IOProcess::(_processLogs) (541064) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:24:59,639::__init__::225::IOProcess::(_processLogs) (541064) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:24:59,640::__init__::225::IOProcess::(_processLogs) (541064) Building response >Thread-19::DEBUG::2014-08-11 17:24:59,640::__init__::225::IOProcess::(_processLogs) (541064) Queuing response >Thread-19::DEBUG::2014-08-11 17:24:59,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:24:59,641::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:24:59,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:59,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:24:59,708::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:59,770::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:59,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:24:59,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:25:00,246::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:25:01,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:01,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463092 s, 22.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:25:03,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:03,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0212967 s, 48.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:04,714::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:04,714::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:04,714::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:04,775::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:04,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:04,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:04,929::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:25:04,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`574b31aa-b9ee-4048-8858-a2e22b342517`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:04,930::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:25:04,967::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:04,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`574b31aa-b9ee-4048-8858-a2e22b342517`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:04,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`574b31aa-b9ee-4048-8858-a2e22b342517`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:04,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:04,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:04,967::task::993::Storage.TaskManager.Task::(_decref) Task=`574b31aa-b9ee-4048-8858-a2e22b342517`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:25:04,979::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:25:04,979::task::595::Storage.TaskManager.Task::(_updateState) Task=`867e1198-c65f-44da-9b6f-07f69ce9a4d4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:25:04,979::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:25:04,980::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b458f577-b133-4557-9b48-65c16e808b38`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:25:04,980::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:25:04,980::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:25:04,980::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b458f577-b133-4557-9b48-65c16e808b38`::Granted request >Thread-10197::DEBUG::2014-08-11 17:25:04,980::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`867e1198-c65f-44da-9b6f-07f69ce9a4d4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:25:04,980::task::993::Storage.TaskManager.Task::(_decref) Task=`867e1198-c65f-44da-9b6f-07f69ce9a4d4`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:25:04,996::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:04,996::task::1191::Storage.TaskManager.Task::(prepare) Task=`867e1198-c65f-44da-9b6f-07f69ce9a4d4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:04,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`867e1198-c65f-44da-9b6f-07f69ce9a4d4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:25:04,996::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:25:04,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:25:04,997::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:25:04,997::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:25:04,997::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:25:04,997::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:25:04,997::task::993::Storage.TaskManager.Task::(_decref) Task=`867e1198-c65f-44da-9b6f-07f69ce9a4d4`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:25:05,904::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:05,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125897 s, 81.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:06,679::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:06,680::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:06,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:06,680::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:06,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:06,681::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:06,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:06,681::__init__::225::IOProcess::(_processLogs) (541065) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:06,681::__init__::225::IOProcess::(_processLogs) (541065) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:06,681::__init__::225::IOProcess::(_processLogs) DEBUG|(541065) Building response >Thread-19::DEBUG::2014-08-11 17:25:06,682::__init__::225::IOProcess::(_processLogs) (541065) Queuing response >Thread-27::DEBUG::2014-08-11 17:25:06,682::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:25:06,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:06,740::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:25:06,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00112864 s, 324 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:06,742::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:06,742::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:06,742::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) (541066) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) (541066) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:06,743::__init__::225::IOProcess::(_processLogs) DEBUG|(541066) Building response >Thread-19::DEBUG::2014-08-11 17:25:06,744::__init__::225::IOProcess::(_processLogs) (541066) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:06,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:06,744::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:25:07,767::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:25:07,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:08,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0784668 s, 13.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:25:08,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb7988d7-5fe9-4ecf-a9fa-9f0f946a56dc`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:08,661::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:25:08,662::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112864', 'lastCheck': '1.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323967', 'lastCheck': '9.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:08,662::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb7988d7-5fe9-4ecf-a9fa-9f0f946a56dc`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112864', 'lastCheck': '1.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000323967', 'lastCheck': '9.0', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:08,662::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb7988d7-5fe9-4ecf-a9fa-9f0f946a56dc`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:08,662::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:08,662::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:08,662::task::993::Storage.TaskManager.Task::(_decref) Task=`cb7988d7-5fe9-4ecf-a9fa-9f0f946a56dc`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:25:08,681::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:08,681::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:09,639::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:09,639::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:09,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:09,639::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:09,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) (541067) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) (541067) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) DEBUG|(541067) Building response >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) (541067) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:09,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:09,641::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:25:09,641::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:25:09,703::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0011399 s, 434 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:09,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:09,703::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:09,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) (541068) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) (541068) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) DEBUG|(541068) Building response >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) (541068) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:09,704::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:25:09,705::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:09,705::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:25:09,705::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:09,705::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) (541069) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) (541069) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) (541069) Building response >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) (541069) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:09,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:09,707::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) (541070) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) (541070) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) (541070) Building response >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) (541070) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:09,708::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:09,709::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:09,709::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:09,709::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:09,709::__init__::225::IOProcess::(_processLogs) (541071) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:09,709::__init__::225::IOProcess::(_processLogs) (541071) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:09,709::__init__::225::IOProcess::(_processLogs) (541071) Building response >Thread-19::DEBUG::2014-08-11 17:25:09,710::__init__::225::IOProcess::(_processLogs) (541071) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:09,710::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:09,710::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:09,720::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:09,721::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:09,721::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:09,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:09,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:09,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:25:10,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:10,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394857 s, 25.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:25:12,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:12,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392414 s, 26.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:25:12,950::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:25:14,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:14,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126074 s, 81.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:14,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:14,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:14,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:14,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:14,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:14,789::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:15,117::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:25:15,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`09272940-f7eb-4ae3-b1a7-b6a3bfc71f31`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:15,118::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:25:15,202::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:15,202::task::1191::Storage.TaskManager.Task::(prepare) Task=`09272940-f7eb-4ae3-b1a7-b6a3bfc71f31`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:15,202::task::595::Storage.TaskManager.Task::(_updateState) Task=`09272940-f7eb-4ae3-b1a7-b6a3bfc71f31`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:15,202::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:15,202::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:15,202::task::993::Storage.TaskManager.Task::(_decref) Task=`09272940-f7eb-4ae3-b1a7-b6a3bfc71f31`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:25:15,214::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:25:15,214::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1e9884-2b93-44b6-b733-374e1972addc`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:25:15,214::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:25:15,215::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`18d17d81-ae16-496e-b7ab-66f6b8d4bec2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:25:15,215::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:25:15,215::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:25:15,215::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`18d17d81-ae16-496e-b7ab-66f6b8d4bec2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:25:15,216::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bb1e9884-2b93-44b6-b733-374e1972addc`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:25:15,216::task::993::Storage.TaskManager.Task::(_decref) Task=`bb1e9884-2b93-44b6-b733-374e1972addc`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:25:15,235::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:15,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`bb1e9884-2b93-44b6-b733-374e1972addc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56345231360', 'isoprefix': '', 'alerts': [], 'disktotal': '621316931584', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:15,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`bb1e9884-2b93-44b6-b733-374e1972addc`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:25:15,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:25:15,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:25:15,236::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:25:15,236::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:25:15,236::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:25:15,236::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:25:15,236::task::993::Storage.TaskManager.Task::(_decref) Task=`bb1e9884-2b93-44b6-b733-374e1972addc`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:25:16,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:16,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0464445 s, 22.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:16,744::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) (541072) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:16,745::__init__::225::IOProcess::(_processLogs) (541072) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:16,746::__init__::225::IOProcess::(_processLogs) DEBUG|(541072) Building response >Thread-19::DEBUG::2014-08-11 17:25:16,746::__init__::225::IOProcess::(_processLogs) (541072) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:16,746::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:25:16,746::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:25:16,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:25:16,814::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00541256 s, 67.6 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) (541073) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:16,815::__init__::225::IOProcess::(_processLogs) (541073) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:16,816::__init__::225::IOProcess::(_processLogs) DEBUG|(541073) Building response >Thread-19::DEBUG::2014-08-11 17:25:16,816::__init__::225::IOProcess::(_processLogs) (541073) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:16,816::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:25:16,816::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:25:18,297::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:25:18,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:18,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147686 s, 69.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) (541074) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:19,710::__init__::225::IOProcess::(_processLogs) (541074) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:19,711::__init__::225::IOProcess::(_processLogs) DEBUG|(541074) Building response >Thread-19::DEBUG::2014-08-11 17:25:19,711::__init__::225::IOProcess::(_processLogs) (541074) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:19,711::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:25:19,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:25:19,712::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:19,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:19,771::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:19,772::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-28::DEBUG::2014-08-11 17:25:19,773::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00173623 s, 285 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:19,774::__init__::225::IOProcess::(_processLogs) (541075) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:19,775::__init__::225::IOProcess::(_processLogs) (541075) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:19,775::__init__::225::IOProcess::(_processLogs) DEBUG|(541075) Building response >Thread-19::DEBUG::2014-08-11 17:25:19,775::__init__::225::IOProcess::(_processLogs) (541075) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:19,775::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:19,776::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) (541076) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) (541076) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) (541076) Building response >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) (541076) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:25:19,777::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) (541077) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) (541077) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) (541077) Building response >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) (541077) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:19,778::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:19,779::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:19,780::__init__::225::IOProcess::(_processLogs) (541078) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:19,780::__init__::225::IOProcess::(_processLogs) (541078) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:19,780::__init__::225::IOProcess::(_processLogs) (541078) Building response >Thread-19::DEBUG::2014-08-11 17:25:19,780::__init__::225::IOProcess::(_processLogs) (541078) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:19,780::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:19,780::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:19,793::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:19,794::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:19,794::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:25:20,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:20,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132774 s, 77.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:25:22,697::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:22,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425092 s, 24.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:25:22,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`9dd7b30f-02f5-49a5-9b3b-ea5749da17aa`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:25:22,808::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:25:22,810::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:22,811::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:25:22,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:22,812::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:22,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:22,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:22,814::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:22,815::__init__::225::IOProcess::(_processLogs) (541079) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:25:22,815::__init__::225::IOProcess::(_processLogs) (541079) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:25:22,816::__init__::225::IOProcess::(_processLogs) (541079) Building response >Thread-19::DEBUG::2014-08-11 17:25:22,816::__init__::225::IOProcess::(_processLogs) (541079) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:22,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:22,817::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:25:22,818::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:22,818::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:25:22,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:22,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:22,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:22,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:22,821::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-10017::INFO::2014-08-11 17:25:22,821::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:25:22,850::__init__::225::IOProcess::(_processLogs) (541080) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:25:22,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`9dd7b30f-02f5-49a5-9b3b-ea5749da17aa`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:25:22,852::__init__::225::IOProcess::(_processLogs) (541080) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:25:22,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`9dd7b30f-02f5-49a5-9b3b-ea5749da17aa`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:25:22,852::__init__::225::IOProcess::(_processLogs) (541080) Building response >Thread-10017::DEBUG::2014-08-11 17:25:22,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:25:22,853::__init__::225::IOProcess::(_processLogs) (541080) Queuing response >Thread-10017::DEBUG::2014-08-11 17:25:22,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:25:22,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:25:22,854::task::993::Storage.TaskManager.Task::(_decref) Task=`9dd7b30f-02f5-49a5-9b3b-ea5749da17aa`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:25:22,855::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:25:22,877::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:25:23,895::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c9987b9-bca9-4d11-8cdd-273dfeabb00d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:23,896::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:25:23,896::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541256', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00173623', 'lastCheck': '4.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:23,896::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c9987b9-bca9-4d11-8cdd-273dfeabb00d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00541256', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00173623', 'lastCheck': '4.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:23,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c9987b9-bca9-4d11-8cdd-273dfeabb00d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:23,896::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:23,896::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:23,896::task::993::Storage.TaskManager.Task::(_decref) Task=`2c9987b9-bca9-4d11-8cdd-273dfeabb00d`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:25:23,912::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:23,912::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:24,777::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:24,778::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:24,778::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:24,800::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:24,800::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:24,800::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:25:24,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:24,952::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.032906 s, 31.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:25:25,263::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:25:25,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbc72c5d-5c2f-483c-9391-7bb060506247`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:25,264::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:25:25,280::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:25,280::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbc72c5d-5c2f-483c-9391-7bb060506247`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:25,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbc72c5d-5c2f-483c-9391-7bb060506247`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:25,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:25,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:25,281::task::993::Storage.TaskManager.Task::(_decref) Task=`fbc72c5d-5c2f-483c-9391-7bb060506247`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:25:25,292::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:25:25,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`59f7e3d2-5054-4924-94f0-50728db4fc93`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:25:25,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:25:25,293::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`56e3c8ed-3f73-4d5a-ba8c-24f10aa16428`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:25:25,293::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:25:25,293::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:25:25,293::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`56e3c8ed-3f73-4d5a-ba8c-24f10aa16428`::Granted request >Thread-10197::DEBUG::2014-08-11 17:25:25,293::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`59f7e3d2-5054-4924-94f0-50728db4fc93`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:25:25,293::task::993::Storage.TaskManager.Task::(_decref) Task=`59f7e3d2-5054-4924-94f0-50728db4fc93`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:25:25,311::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:25,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`59f7e3d2-5054-4924-94f0-50728db4fc93`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:25,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`59f7e3d2-5054-4924-94f0-50728db4fc93`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:25:25,311::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:25:25,311::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:25:25,311::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:25:25,312::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:25:25,312::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:25:25,312::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:25:25,312::task::993::Storage.TaskManager.Task::(_decref) Task=`59f7e3d2-5054-4924-94f0-50728db4fc93`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:25:26,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:26,817::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) (541081) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:26,818::__init__::225::IOProcess::(_processLogs) (541081) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:26,827::__init__::225::IOProcess::(_processLogs) DEBUG|(541081) Building response >Thread-19::DEBUG::2014-08-11 17:25:26,827::__init__::225::IOProcess::(_processLogs) (541081) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:26,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:26,827::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:25:26,828::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:25:26,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000421035 s, 869 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:26,887::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) (541082) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) (541082) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:26,888::__init__::225::IOProcess::(_processLogs) DEBUG|(541082) Building response >Thread-19::DEBUG::2014-08-11 17:25:26,889::__init__::225::IOProcess::(_processLogs) (541082) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:26,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:26,889::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:25:26,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:27,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122412 s, 83.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:25:27,960::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:25:29,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:29,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0727268 s, 14.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:29,781::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >GuestMonitor-vm::DEBUG::2014-08-11 17:25:29,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:29,782::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:29,783::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:29,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:29,784::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:25:29,784::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:29,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:29,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:29,786::__init__::225::IOProcess::(_processLogs) (541083) Finding callback 'statvfs'... >GuestMonitor-vm::DEBUG::2014-08-11 17:25:29,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:29,786::__init__::225::IOProcess::(_processLogs) (541083) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:29,788::__init__::225::IOProcess::(_processLogs) DEBUG|(541083) Building response >Thread-28::DEBUG::2014-08-11 17:25:29,788::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:25:29,788::__init__::225::IOProcess::(_processLogs) (541083) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:29,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:25:29,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000381814 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:29,849::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:29,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:29,851::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:29,852::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:29,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:29,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:29,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:29,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:29,854::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:29,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:29,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:29,856::__init__::225::IOProcess::(_processLogs) (541084) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:29,856::__init__::225::IOProcess::(_processLogs) (541084) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:29,857::__init__::225::IOProcess::(_processLogs) DEBUG|(541084) Building response >Thread-19::DEBUG::2014-08-11 17:25:29,858::__init__::225::IOProcess::(_processLogs) (541084) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:29,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:29,858::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:29,859::__init__::225::IOProcess::(_processLogs) (541085) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) (541085) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) (541085) Building response >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) (541085) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:29,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) (541086) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) (541086) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) (541086) Building response >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) (541086) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:29,861::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:29,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:29,863::__init__::225::IOProcess::(_processLogs) (541087) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:29,863::__init__::225::IOProcess::(_processLogs) (541087) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:29,863::__init__::225::IOProcess::(_processLogs) (541087) Building response >Thread-19::DEBUG::2014-08-11 17:25:29,863::__init__::225::IOProcess::(_processLogs) (541087) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:29,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:29,863::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:25:30,309::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:25:31,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:31,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655543 s, 15.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:25:33,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:33,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139511 s, 73.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:34,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:34,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:34,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:34,862::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:34,862::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:34,862::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:35,349::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:25:35,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`147a6192-7070-4944-82da-d6e8b5481026`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:35,349::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:25:35,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::INFO::2014-08-11 17:25:35,454::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:35,454::task::1191::Storage.TaskManager.Task::(prepare) Task=`147a6192-7070-4944-82da-d6e8b5481026`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:35,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`147a6192-7070-4944-82da-d6e8b5481026`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:35,454::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:35,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:35,455::task::993::Storage.TaskManager.Task::(_decref) Task=`147a6192-7070-4944-82da-d6e8b5481026`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:25:35,462::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:25:35,463::task::595::Storage.TaskManager.Task::(_updateState) Task=`603b620a-5556-4dbc-895c-279363b75aa3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:25:35,463::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:25:35,463::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b025932f-22bd-42c9-b8aa-471a5782ca3e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:25:35,463::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:25:35,464::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:25:35,464::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b025932f-22bd-42c9-b8aa-471a5782ca3e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:25:35,464::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`603b620a-5556-4dbc-895c-279363b75aa3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:25:35,464::task::993::Storage.TaskManager.Task::(_decref) Task=`603b620a-5556-4dbc-895c-279363b75aa3`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:25:35,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180389 s, 56.8 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:25:35,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:35,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`603b620a-5556-4dbc-895c-279363b75aa3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:35,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`603b620a-5556-4dbc-895c-279363b75aa3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:25:35,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:25:35,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:25:35,485::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:25:35,485::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:25:35,485::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:25:35,485::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:25:35,485::task::993::Storage.TaskManager.Task::(_decref) Task=`603b620a-5556-4dbc-895c-279363b75aa3`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) (541088) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:36,890::__init__::225::IOProcess::(_processLogs) (541088) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:36,891::__init__::225::IOProcess::(_processLogs) (541088) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:36,891::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:25:36,892::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:25:36,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000989905 s, 370 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:36,952::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:36,952::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:36,952::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:36,952::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:36,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:36,953::__init__::225::IOProcess::(_processLogs) (541089) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:36,953::__init__::225::IOProcess::(_processLogs) (541089) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:36,953::__init__::225::IOProcess::(_processLogs) (541089) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:36,953::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:25:37,481::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:37,582::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423893 s, 24.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:25:37,955::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:25:39,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`12e67ff7-41c2-4386-9fd8-a6f50aac434b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:39,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:25:39,113::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000989905', 'lastCheck': '2.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381814', 'lastCheck': '9.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:39,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`12e67ff7-41c2-4386-9fd8-a6f50aac434b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000989905', 'lastCheck': '2.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381814', 'lastCheck': '9.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:39,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`12e67ff7-41c2-4386-9fd8-a6f50aac434b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:39,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:39,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:39,113::task::993::Storage.TaskManager.Task::(_decref) Task=`12e67ff7-41c2-4386-9fd8-a6f50aac434b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:25:39,131::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:39,132::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:25:39,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:39,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0777542 s, 13.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:39,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:39,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:39,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:39,863::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:39,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:39,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:39,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:39,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:39,864::__init__::225::IOProcess::(_processLogs) (541090) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:39,864::__init__::225::IOProcess::(_processLogs) (541090) Got request for method 'statvfs' >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:39,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:39,866::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:39,866::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:40,040::__init__::225::IOProcess::(_processLogs) (541090) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:40,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:25:40,041::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:25:40,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00044786 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) (541091) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:40,100::__init__::225::IOProcess::(_processLogs) (541091) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:40,101::__init__::225::IOProcess::(_processLogs) (541091) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:40,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:40,101::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) (541092) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:40,102::__init__::225::IOProcess::(_processLogs) (541092) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) (541092) Building response >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) (541092) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:40,103::__init__::225::IOProcess::(_processLogs) (541093) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) (541093) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) (541093) Building response >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) (541093) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:40,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:40,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:40,105::__init__::225::IOProcess::(_processLogs) (541094) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:40,105::__init__::225::IOProcess::(_processLogs) (541094) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:40,107::__init__::225::IOProcess::(_processLogs) (541094) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:40,107::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:25:41,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:41,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0773215 s, 13.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:25:42,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`9071ceec-20fb-420e-890e-4a0f1f35ebe2`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:25:42,962::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:25:42,962::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:25:42,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:42,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:42,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:42,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:42,963::__init__::225::IOProcess::(_processLogs) (541095) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:25:42,963::__init__::225::IOProcess::(_processLogs) (541095) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:25:42,964::__init__::225::IOProcess::(_processLogs) (541095) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:42,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:42,965::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:25:42,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:42,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:25:42,965::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:25:42,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:25:42,966::task::1191::Storage.TaskManager.Task::(prepare) Task=`9071ceec-20fb-420e-890e-4a0f1f35ebe2`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:25:42,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:25:42,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`9071ceec-20fb-420e-890e-4a0f1f35ebe2`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:25:42,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:25:42,967::__init__::225::IOProcess::(_processLogs) (541096) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:25:42,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:25:42,967::__init__::225::IOProcess::(_processLogs) (541096) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:25:42,968::task::993::Storage.TaskManager.Task::(_decref) Task=`9071ceec-20fb-420e-890e-4a0f1f35ebe2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:25:42,968::__init__::225::IOProcess::(_processLogs) (541096) Building response >Thread-19::DEBUG::2014-08-11 17:25:42,968::__init__::225::IOProcess::(_processLogs) (541096) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:42,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:42,969::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:25:42,989::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:25:43,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:43,994::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551249 s, 18.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:44,798::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:44,799::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:44,799::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:44,872::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:44,872::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:44,872::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:45,528::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:25:45,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5345c72-0a93-41f1-974a-a79321bf307c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:45,528::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:25:45,586::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:45,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`d5345c72-0a93-41f1-974a-a79321bf307c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:45,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`d5345c72-0a93-41f1-974a-a79321bf307c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:45,586::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:45,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:45,586::task::993::Storage.TaskManager.Task::(_decref) Task=`d5345c72-0a93-41f1-974a-a79321bf307c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:25:45,593::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:25:45,593::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1f01399-244f-4488-b06b-6f5a635c0215`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:25:45,594::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:25:45,594::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b660df38-f9e8-4266-9b86-422cadee4a00`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:25:45,594::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:25:45,594::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:25:45,594::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b660df38-f9e8-4266-9b86-422cadee4a00`::Granted request >Thread-10197::DEBUG::2014-08-11 17:25:45,594::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a1f01399-244f-4488-b06b-6f5a635c0215`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:25:45,594::task::993::Storage.TaskManager.Task::(_decref) Task=`a1f01399-244f-4488-b06b-6f5a635c0215`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:25:45,612::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:45,612::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1f01399-244f-4488-b06b-6f5a635c0215`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56289656832', 'isoprefix': '', 'alerts': [], 'disktotal': '621261357056', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:45,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1f01399-244f-4488-b06b-6f5a635c0215`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:25:45,612::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:25:45,612::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:25:45,612::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:25:45,612::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:25:45,612::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:25:45,613::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:25:45,613::task::993::Storage.TaskManager.Task::(_decref) Task=`a1f01399-244f-4488-b06b-6f5a635c0215`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:25:46,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:46,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326835 s, 31.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:46,954::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:46,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:46,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:46,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:46,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:46,955::__init__::225::IOProcess::(_processLogs) (541097) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:46,955::__init__::225::IOProcess::(_processLogs) (541097) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:46,956::__init__::225::IOProcess::(_processLogs) (541097) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:46,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:25:46,957::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:25:47,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000475979 s, 769 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) (541098) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:47,016::__init__::225::IOProcess::(_processLogs) (541098) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:47,017::__init__::225::IOProcess::(_processLogs) (541098) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:47,017::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:25:48,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:48,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146548 s, 69.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:25:48,405::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:25:49,805::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:49,805::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:49,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:49,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:49,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:49,879::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) (541099) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:50,108::__init__::225::IOProcess::(_processLogs) (541099) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:50,110::__init__::225::IOProcess::(_processLogs) (541099) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:50,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:25:50,110::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:25:50,176::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00241354 s, 205 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:50,176::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:50,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:50,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:50,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:50,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:50,177::__init__::225::IOProcess::(_processLogs) (541100) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:50,177::__init__::225::IOProcess::(_processLogs) (541100) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:50,177::__init__::225::IOProcess::(_processLogs) (541100) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:50,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:50,178::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:25:50,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:50,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:50,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:50,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) (541101) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) (541101) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) (541101) Building response >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) (541101) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:50,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) (541102) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) (541102) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) (541102) Building response >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) (541102) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:50,180::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:50,181::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:25:50,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:50,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:50,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:50,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:50,181::__init__::225::IOProcess::(_processLogs) (541103) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:50,182::__init__::225::IOProcess::(_processLogs) (541103) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:50,182::__init__::225::IOProcess::(_processLogs) (541103) Building response >Thread-19::DEBUG::2014-08-11 17:25:50,182::__init__::225::IOProcess::(_processLogs) (541103) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:50,182::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:50,182::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:25:50,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:50,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200513 s, 51.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:25:52,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:52,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330528 s, 31.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:25:52,963::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:25:54,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`2360118b-15a6-4652-b956-438aea420ff1`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:54,357::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:25:54,357::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475979', 'lastCheck': '7.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00241354', 'lastCheck': '4.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:54,357::task::1191::Storage.TaskManager.Task::(prepare) Task=`2360118b-15a6-4652-b956-438aea420ff1`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475979', 'lastCheck': '7.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00241354', 'lastCheck': '4.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:25:54,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`2360118b-15a6-4652-b956-438aea420ff1`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:54,357::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:54,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:54,357::task::993::Storage.TaskManager.Task::(_decref) Task=`2360118b-15a6-4652-b956-438aea420ff1`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:25:54,374::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:54,374::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:25:54,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:54,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655802 s, 15.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:54,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:54,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:54,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:54,884::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:54,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:54,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:25:55,658::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:25:55,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`17fd8d51-4169-49d8-9509-a9c85c895a05`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:25:55,659::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:25:55,679::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:55,680::task::1191::Storage.TaskManager.Task::(prepare) Task=`17fd8d51-4169-49d8-9509-a9c85c895a05`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:25:55,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`17fd8d51-4169-49d8-9509-a9c85c895a05`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:25:55,681::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:25:55,681::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:25:55,682::task::993::Storage.TaskManager.Task::(_decref) Task=`17fd8d51-4169-49d8-9509-a9c85c895a05`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:25:55,694::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:25:55,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`851b4425-17de-4d85-8637-5bea08cbee69`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:25:55,694::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:25:55,695::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fd2150b7-2bad-43de-9e1b-edf5a40f137d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:25:55,695::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:25:55,695::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:25:55,695::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fd2150b7-2bad-43de-9e1b-edf5a40f137d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:25:55,695::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`851b4425-17de-4d85-8637-5bea08cbee69`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:25:55,695::task::993::Storage.TaskManager.Task::(_decref) Task=`851b4425-17de-4d85-8637-5bea08cbee69`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:25:55,712::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:55,712::task::1191::Storage.TaskManager.Task::(prepare) Task=`851b4425-17de-4d85-8637-5bea08cbee69`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:25:55,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`851b4425-17de-4d85-8637-5bea08cbee69`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:25:55,712::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:25:55,712::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:25:55,713::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:25:55,713::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:25:55,713::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:25:55,713::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:25:55,713::task::993::Storage.TaskManager.Task::(_decref) Task=`851b4425-17de-4d85-8637-5bea08cbee69`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:25:56,525::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:56,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0793318 s, 12.9 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:25:57,018::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:25:57,019::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) (541104) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) (541104) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:25:57,020::__init__::225::IOProcess::(_processLogs) (541104) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,021::__init__::225::IOProcess::(_processLogs) (541105) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:25:57,022::__init__::225::IOProcess::(_processLogs) (541105) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:25:57,022::__init__::225::IOProcess::(_processLogs) (541105) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,023::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:25:57,027::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) (541106) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:25:57,027::__init__::225::IOProcess::(_processLogs) (541106) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:25:57,142::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541106) Building response >Thread-19::DEBUG::2014-08-11 17:25:57,143::__init__::225::IOProcess::(_processLogs) (541106) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,143::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:25:57,143::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) (541107) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:25:57,144::__init__::225::IOProcess::(_processLogs) (541107) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:25:57,145::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541107) Building response >Thread-19::DEBUG::2014-08-11 17:25:57,145::__init__::225::IOProcess::(_processLogs) (541107) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,145::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:25:57,145::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:25:57,145::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-19::DEBUG::2014-08-11 17:25:57,146::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:57,146::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) (541108) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) (541108) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:25:57,147::__init__::225::IOProcess::(_processLogs) (541108) Building response >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) (541108) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:25:57,148::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:25:57,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-27::INFO::2014-08-11 17:25:57,149::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:25:57,149::__init__::225::IOProcess::(_processLogs) (541109) Finding callback 'glob'... >Thread-27::INFO::2014-08-11 17:25:57,150::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:25:57,150::__init__::225::IOProcess::(_processLogs) (541109) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:25:57,150::__init__::225::IOProcess::(_processLogs) (541109) Building response >Thread-19::DEBUG::2014-08-11 17:25:57,150::__init__::225::IOProcess::(_processLogs) (541109) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) (541110) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) (541110) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) (541110) Building response >Thread-19::DEBUG::2014-08-11 17:25:57,151::__init__::225::IOProcess::(_processLogs) (541110) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,152::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:25:57,152::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:25:57,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000391976 s, 934 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:25:57,211::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:25:57,211::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:25:57,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:25:57,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:25:57,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:25:57,212::__init__::225::IOProcess::(_processLogs) (541111) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:25:57,212::__init__::225::IOProcess::(_processLogs) (541111) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:25:57,212::__init__::225::IOProcess::(_processLogs) (541111) Queuing response >Thread-19::DEBUG::2014-08-11 17:25:57,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:25:57,213::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:25:58,021::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:25:58,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:25:58,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0288301 s, 35.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:25:59,818::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:59,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:25:59,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:59,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:59,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:25:59,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:26:00,182::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:00,182::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:00,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:00,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:00,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:00,183::__init__::225::IOProcess::(_processLogs) (541112) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:00,183::__init__::225::IOProcess::(_processLogs) (541112) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:00,183::__init__::225::IOProcess::(_processLogs) (541112) Queuing response >Thread-28::DEBUG::2014-08-11 17:26:00,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:00,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:00,242::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:26:00,243::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000847837 s, 584 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:00,243::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) (541113) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) (541113) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:00,244::__init__::225::IOProcess::(_processLogs) (541113) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:00,245::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:26:00,245::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:26:00,245::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) (541114) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) (541114) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) (541114) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:00,246::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) (541115) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:00,247::__init__::225::IOProcess::(_processLogs) (541115) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:00,248::__init__::225::IOProcess::(_processLogs) (541115) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:00,248::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:00,249::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:26:00,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:00,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) (541116) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) (541116) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) (541116) Building response >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) (541116) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:00,250::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:26:00,445::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:26:00,765::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:00,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421023 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:26:02,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:03,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.10732 s, 9.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:04,825::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:04,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:04,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:04,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:04,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:04,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:26:05,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:05,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0749051 s, 13.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:26:05,779::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:26:05,779::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2ac2aaa-4b44-4183-931c-e926cc57f368`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:05,779::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:26:05,822::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:05,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2ac2aaa-4b44-4183-931c-e926cc57f368`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:05,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2ac2aaa-4b44-4183-931c-e926cc57f368`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:05,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:05,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:05,822::task::993::Storage.TaskManager.Task::(_decref) Task=`f2ac2aaa-4b44-4183-931c-e926cc57f368`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:26:05,834::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:26:05,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`6283c2c5-baee-4767-9277-74e06140470a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:26:05,834::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:26:05,834::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4708842e-325f-4ba5-af10-e72e9beb5927`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:26:05,834::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:26:05,835::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:26:05,835::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4708842e-325f-4ba5-af10-e72e9beb5927`::Granted request >Thread-10197::DEBUG::2014-08-11 17:26:05,835::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6283c2c5-baee-4767-9277-74e06140470a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:26:05,835::task::993::Storage.TaskManager.Task::(_decref) Task=`6283c2c5-baee-4767-9277-74e06140470a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:26:05,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:05,852::task::1191::Storage.TaskManager.Task::(prepare) Task=`6283c2c5-baee-4767-9277-74e06140470a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:05,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`6283c2c5-baee-4767-9277-74e06140470a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:26:05,852::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:26:05,852::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:26:05,852::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:26:05,852::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:26:05,852::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:26:05,852::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:26:05,853::task::993::Storage.TaskManager.Task::(_decref) Task=`6283c2c5-baee-4767-9277-74e06140470a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:26:07,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:07,251::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) (541117) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) (541117) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:07,252::__init__::225::IOProcess::(_processLogs) (541117) Queuing response >Thread-27::DEBUG::2014-08-11 17:26:07,253::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:07,253::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:07,311::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:26:07,313::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000388074 s, 943 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:07,314::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:07,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:07,315::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:07,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:07,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:07,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:07,318::__init__::225::IOProcess::(_processLogs) (541118) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:07,319::__init__::225::IOProcess::(_processLogs) (541118) Building response >Thread-19::DEBUG::2014-08-11 17:26:07,319::__init__::225::IOProcess::(_processLogs) (541118) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:07,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:07,320::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:26:07,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0693462 s, 14.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:26:07,970::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:09,329::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:09,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135987 s, 75.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:26:09,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`5edfea49-b66c-4aa8-8462-1eaae31421d5`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:09,540::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:26:09,540::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388074', 'lastCheck': '2.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000847837', 'lastCheck': '9.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:09,540::task::1191::Storage.TaskManager.Task::(prepare) Task=`5edfea49-b66c-4aa8-8462-1eaae31421d5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388074', 'lastCheck': '2.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000847837', 'lastCheck': '9.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:09,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`5edfea49-b66c-4aa8-8462-1eaae31421d5`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:09,540::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:09,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:09,541::task::993::Storage.TaskManager.Task::(_decref) Task=`5edfea49-b66c-4aa8-8462-1eaae31421d5`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:26:09,556::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:09,556::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:09,827::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:09,828::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:09,828::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:09,899::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:09,899::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:09,900::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:26:10,250::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:10,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:10,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:10,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:10,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:10,250::__init__::225::IOProcess::(_processLogs) (541119) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:10,251::__init__::225::IOProcess::(_processLogs) (541119) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:10,251::__init__::225::IOProcess::(_processLogs) (541119) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:10,251::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:26:10,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:26:10,312::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00130149 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) (541120) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) (541120) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:10,313::__init__::225::IOProcess::(_processLogs) (541120) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:10,314::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:26:10,314::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) (541121) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) (541121) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) (541121) Building response >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) (541121) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:10,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:10,316::__init__::225::IOProcess::(_processLogs) (541122) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) (541122) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) (541122) Building response >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) (541122) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:10,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) (541123) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) (541123) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) (541123) Building response >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) (541123) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:10,318::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:26:11,409::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:11,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0641516 s, 16.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:26:13,030::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:13,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:13,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012344 s, 83.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:14,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:14,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:14,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:14,905::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:14,906::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:14,906::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:26:15,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:15,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0870576 s, 11.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:26:15,917::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [13b5bee0] >Thread-10205::DEBUG::2014-08-11 17:26:15,917::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeb2f4d7-93ea-4c2f-a6e9-6eba5c3ef653`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:15,917::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Detector thread::DEBUG::2014-08-11 17:26:15,960::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.1.234:61000 >Detector thread::DEBUG::2014-08-11 17:26:15,961::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.1.234:61000 >Detector thread::DEBUG::2014-08-11 17:26:15,961::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.1.234:61000 >Detector thread::DEBUG::2014-08-11 17:26:15,961::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.1.234', 61000) >Thread-10205::INFO::2014-08-11 17:26:15,978::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:15,978::task::1191::Storage.TaskManager.Task::(prepare) Task=`eeb2f4d7-93ea-4c2f-a6e9-6eba5c3ef653`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:15,978::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeb2f4d7-93ea-4c2f-a6e9-6eba5c3ef653`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:15,978::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:15,978::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:15,979::task::993::Storage.TaskManager.Task::(_decref) Task=`eeb2f4d7-93ea-4c2f-a6e9-6eba5c3ef653`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:26:15,989::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [13b5bee0] >Thread-10197::DEBUG::2014-08-11 17:26:15,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`194de8c5-2871-40dd-8a41-f65b53a514c6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:26:15,990::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:26:15,990::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e20de700-8494-4d5b-b383-599ca76dbc91`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:26:15,990::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:26:15,990::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:26:15,990::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e20de700-8494-4d5b-b383-599ca76dbc91`::Granted request >Thread-10197::DEBUG::2014-08-11 17:26:15,990::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`194de8c5-2871-40dd-8a41-f65b53a514c6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:26:15,990::task::993::Storage.TaskManager.Task::(_decref) Task=`194de8c5-2871-40dd-8a41-f65b53a514c6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:26:16,015::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:16,015::task::1191::Storage.TaskManager.Task::(prepare) Task=`194de8c5-2871-40dd-8a41-f65b53a514c6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56281268224', 'isoprefix': '', 'alerts': [], 'disktotal': '621254017024', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:16,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`194de8c5-2871-40dd-8a41-f65b53a514c6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:26:16,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:26:16,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:26:16,015::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:26:16,015::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:26:16,015::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:26:16,015::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:26:16,016::task::993::Storage.TaskManager.Task::(_decref) Task=`194de8c5-2871-40dd-8a41-f65b53a514c6`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:26:17,319::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:17,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:17,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:17,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:17,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:17,319::__init__::225::IOProcess::(_processLogs) (541124) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:17,320::__init__::225::IOProcess::(_processLogs) (541124) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:17,320::__init__::225::IOProcess::(_processLogs) (541124) Queuing response >Thread-27::DEBUG::2014-08-11 17:26:17,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:17,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:17,379::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:26:17,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000365627 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:17,385::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:17,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:17,385::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:17,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:17,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:17,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:17,386::__init__::225::IOProcess::(_processLogs) (541125) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:17,386::__init__::225::IOProcess::(_processLogs) (541125) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:17,386::__init__::225::IOProcess::(_processLogs) (541125) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:17,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:17,387::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:26:17,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:17,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0220453 s, 46.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:26:18,474::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:26:19,838::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:19,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:19,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:26:19,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:19,928::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:19,928::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:19,929::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:26:19,965::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301842 s, 33.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:20,318::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) (541126) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) (541126) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:20,319::__init__::225::IOProcess::(_processLogs) (541126) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:20,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:26:20,320::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:26:20,378::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000451431 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) (541127) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:20,379::__init__::225::IOProcess::(_processLogs) (541127) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:20,380::__init__::225::IOProcess::(_processLogs) (541127) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:20,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:20,380::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:26:20,380::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) (541128) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) (541128) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) (541128) Building response >Thread-19::DEBUG::2014-08-11 17:26:20,381::__init__::225::IOProcess::(_processLogs) (541128) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:20,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) (541129) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) (541129) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) (541129) Building response >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) (541129) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:26:20,383::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) (541130) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) (541130) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) (541130) Building response >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) (541130) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:20,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:20,385::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:26:21,973::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:22,107::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0651499 s, 15.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:26:22,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`682cb304-1e28-4401-ab9a-bf3510c88b33`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:26:22,972::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) (541131) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:26:22,973::__init__::225::IOProcess::(_processLogs) (541131) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:26:22,992::__init__::225::IOProcess::(_processLogs) (541131) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:22,992::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:26:22,993::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:26:22,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:22,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:26:22,993::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:26:22,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:26:22,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`682cb304-1e28-4401-ab9a-bf3510c88b33`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:26:22,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:26:22,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`682cb304-1e28-4401-ab9a-bf3510c88b33`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:26:22,995::__init__::225::IOProcess::(_processLogs) (541132) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:26:22,995::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:26:22,996::__init__::225::IOProcess::(_processLogs) (541132) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:26:22,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:26:22,996::__init__::225::IOProcess::(_processLogs) (541132) Building response >Thread-10017::DEBUG::2014-08-11 17:26:22,996::task::993::Storage.TaskManager.Task::(_decref) Task=`682cb304-1e28-4401-ab9a-bf3510c88b33`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:26:22,997::__init__::225::IOProcess::(_processLogs) (541132) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:22,997::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:22,997::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:26:23,016::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:24,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:24,188::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142669 s, 71.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:24,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:24,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:24,846::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:24,933::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:24,934::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:24,934::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:25,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d01092a-7ee0-46e4-8464-e497ec453fad`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:25,042::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:26:25,043::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365627', 'lastCheck': '7.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451431', 'lastCheck': '4.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:25,043::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d01092a-7ee0-46e4-8464-e497ec453fad`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000365627', 'lastCheck': '7.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000451431', 'lastCheck': '4.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:25,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d01092a-7ee0-46e4-8464-e497ec453fad`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:25,043::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:25,043::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:25,043::task::993::Storage.TaskManager.Task::(_decref) Task=`8d01092a-7ee0-46e4-8464-e497ec453fad`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:26:25,058::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:25,058::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:26,070::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10205::DEBUG::2014-08-11 17:26:26,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9ad582d-1fbd-4994-9135-5117a2ccf4c5`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:26,070::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:26:26,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:26,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9ad582d-1fbd-4994-9135-5117a2ccf4c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:26,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9ad582d-1fbd-4994-9135-5117a2ccf4c5`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:26,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:26,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:26,134::task::993::Storage.TaskManager.Task::(_decref) Task=`b9ad582d-1fbd-4994-9135-5117a2ccf4c5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:26:26,145::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10197::DEBUG::2014-08-11 17:26:26,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf04775c-fa6c-4f74-b486-2d0ed2eb927e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:26:26,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:26:26,145::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9bfdd01-dc0a-4297-adab-de79384a7168`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:26:26,145::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:26:26,146::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:26:26,147::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9bfdd01-dc0a-4297-adab-de79384a7168`::Granted request >Thread-10197::DEBUG::2014-08-11 17:26:26,147::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cf04775c-fa6c-4f74-b486-2d0ed2eb927e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:26:26,147::task::993::Storage.TaskManager.Task::(_decref) Task=`cf04775c-fa6c-4f74-b486-2d0ed2eb927e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:26:26,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:26,163::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf04775c-fa6c-4f74-b486-2d0ed2eb927e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:26,163::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf04775c-fa6c-4f74-b486-2d0ed2eb927e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:26:26,163::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:26:26,163::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:26:26,163::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:26:26,163::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:26:26,164::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:26:26,164::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:26:26,164::task::993::Storage.TaskManager.Task::(_decref) Task=`cf04775c-fa6c-4f74-b486-2d0ed2eb927e`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:26:26,196::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:26,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158701 s, 64.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) (541133) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:27,388::__init__::225::IOProcess::(_processLogs) (541133) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:27,389::__init__::225::IOProcess::(_processLogs) (541133) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:27,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:26:27,389::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:26:27,450::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00151175 s, 242 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) (541134) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:27,451::__init__::225::IOProcess::(_processLogs) (541134) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:27,454::__init__::225::IOProcess::(_processLogs) (541134) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:27,455::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:26:28,037::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:28,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:28,382::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381737 s, 26.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:29,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:29,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:29,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:29,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:29,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:29,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:26:30,384::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) (541135) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) (541135) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:30,385::__init__::225::IOProcess::(_processLogs) (541135) Queuing response >Thread-28::DEBUG::2014-08-11 17:26:30,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:30,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:30,445::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:26:30,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:26:30,504::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-28::DEBUG::2014-08-11 17:26:30,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0198403 s, 24.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:30,505::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:30,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:30,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:30,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:30,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:30,506::__init__::225::IOProcess::(_processLogs) (541136) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:30,506::__init__::225::IOProcess::(_processLogs) (541136) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:30,524::__init__::225::IOProcess::(_processLogs) (541136) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:30,525::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:26:30,526::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:26:30,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:30,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:30,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:30,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:30,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:30,529::__init__::225::IOProcess::(_processLogs) (541137) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:30,530::__init__::225::IOProcess::(_processLogs) (541137) Building response >Thread-19::DEBUG::2014-08-11 17:26:30,530::__init__::225::IOProcess::(_processLogs) (541137) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:30,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:30,531::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:30,532::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:26:30,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:30,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-51::DEBUG::2014-08-11 17:26:30,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281877 s, 36.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:30,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:30,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:30,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:30,535::__init__::225::IOProcess::(_processLogs) (541138) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:30,536::__init__::225::IOProcess::(_processLogs) (541138) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:30,537::__init__::225::IOProcess::(_processLogs) (541138) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:30,537::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:30,538::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:30,538::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:26:30,539::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:30,539::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:30,539::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:30,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:30,541::__init__::225::IOProcess::(_processLogs) (541139) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:30,541::__init__::225::IOProcess::(_processLogs) (541139) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:30,542::__init__::225::IOProcess::(_processLogs) (541139) Building response >Thread-19::DEBUG::2014-08-11 17:26:30,542::__init__::225::IOProcess::(_processLogs) (541139) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:30,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:30,543::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:26:32,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:32,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0669515 s, 15.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:26:34,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:34,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0573693 s, 17.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:34,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:34,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:34,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:34,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:34,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:34,947::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:36,256::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:26:36,257::task::595::Storage.TaskManager.Task::(_updateState) Task=`a77df4d1-6458-423d-b4df-67e0d6cfec0b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:36,257::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:26:36,293::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:36,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`a77df4d1-6458-423d-b4df-67e0d6cfec0b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:36,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`a77df4d1-6458-423d-b4df-67e0d6cfec0b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:36,293::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:36,293::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:36,293::task::993::Storage.TaskManager.Task::(_decref) Task=`a77df4d1-6458-423d-b4df-67e0d6cfec0b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:26:36,305::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:26:36,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`42a3317e-2429-4902-bff5-8069ef79e797`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:26:36,305::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:26:36,306::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9ceca805-1323-4018-83b2-1c4dd1906627`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:26:36,306::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:26:36,306::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:26:36,306::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9ceca805-1323-4018-83b2-1c4dd1906627`::Granted request >Thread-10197::DEBUG::2014-08-11 17:26:36,306::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`42a3317e-2429-4902-bff5-8069ef79e797`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:26:36,306::task::993::Storage.TaskManager.Task::(_decref) Task=`42a3317e-2429-4902-bff5-8069ef79e797`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:26:36,325::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:36,325::task::1191::Storage.TaskManager.Task::(prepare) Task=`42a3317e-2429-4902-bff5-8069ef79e797`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:36,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`42a3317e-2429-4902-bff5-8069ef79e797`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:26:36,326::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:26:36,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:26:36,326::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:26:36,326::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:26:36,326::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:26:36,326::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:26:36,326::task::993::Storage.TaskManager.Task::(_decref) Task=`42a3317e-2429-4902-bff5-8069ef79e797`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:26:36,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:36,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0810467 s, 12.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) (541140) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:37,456::__init__::225::IOProcess::(_processLogs) (541140) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:37,457::__init__::225::IOProcess::(_processLogs) (541140) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:37,457::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:26:37,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:26:37,525::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000388299 s, 943 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:37,526::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:37,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:37,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:37,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:37,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:37,527::__init__::225::IOProcess::(_processLogs) (541141) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:37,527::__init__::225::IOProcess::(_processLogs) (541141) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:37,527::__init__::225::IOProcess::(_processLogs) (541141) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:37,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:37,528::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:26:38,023::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:38,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:39,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0889743 s, 11.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:39,860::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:39,861::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:39,861::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:39,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:39,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:39,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:40,280::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0763450-cac0-4595-8134-2c236b13231e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:40,280::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:26:40,280::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388299', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0198403', 'lastCheck': '9.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:40,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0763450-cac0-4595-8134-2c236b13231e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388299', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0198403', 'lastCheck': '9.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:40,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0763450-cac0-4595-8134-2c236b13231e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:40,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:40,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:40,281::task::993::Storage.TaskManager.Task::(_decref) Task=`b0763450-cac0-4595-8134-2c236b13231e`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:26:40,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:40,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:26:40,542::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:40,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:40,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:40,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:40,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:40,542::__init__::225::IOProcess::(_processLogs) (541142) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:40,543::__init__::225::IOProcess::(_processLogs) (541142) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:40,543::__init__::225::IOProcess::(_processLogs) (541142) Queuing response >Thread-28::DEBUG::2014-08-11 17:26:40,544::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:40,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:40,603::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:26:40,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00240297 s, 206 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) (541143) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:40,617::__init__::225::IOProcess::(_processLogs) (541143) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:40,619::__init__::225::IOProcess::(_processLogs) (541143) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:40,619::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:26:40,620::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:26:40,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:40,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) (541144) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) (541144) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) (541144) Building response >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) (541144) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:40,621::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:26:40,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:40,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:40,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:40,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:40,622::__init__::225::IOProcess::(_processLogs) (541145) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:40,622::__init__::225::IOProcess::(_processLogs) (541145) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) (541145) Building response >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) (541145) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) (541146) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:40,623::__init__::225::IOProcess::(_processLogs) (541146) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:40,624::__init__::225::IOProcess::(_processLogs) (541146) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:40,624::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:26:41,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:41,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134775 s, 76.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:26:43,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1838dec-888b-40c5-a497-a22b1ab9ffbd`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:26:43,040::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:26:43,040::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:26:43,040::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:43,040::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:43,040::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:43,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:43,040::__init__::225::IOProcess::(_processLogs) (541147) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:26:43,041::__init__::225::IOProcess::(_processLogs) (541147) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:26:43,044::__init__::225::IOProcess::(_processLogs) (541147) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:43,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:43,045::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:26:43,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:43,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:26:43,045::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:26:43,047::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:26:43,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1838dec-888b-40c5-a497-a22b1ab9ffbd`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:26:43,048::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:26:43,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1838dec-888b-40c5-a497-a22b1ab9ffbd`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:26:43,048::__init__::225::IOProcess::(_processLogs) (541148) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:26:43,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:26:43,049::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:26:43,049::__init__::225::IOProcess::(_processLogs) (541148) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:26:43,049::task::993::Storage.TaskManager.Task::(_decref) Task=`c1838dec-888b-40c5-a497-a22b1ab9ffbd`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:26:43,049::__init__::225::IOProcess::(_processLogs) (541148) Building response >Thread-19::DEBUG::2014-08-11 17:26:43,050::__init__::225::IOProcess::(_processLogs) (541148) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:43,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:43,050::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:26:43,071::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:43,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:43,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423606 s, 24.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:44,864::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:44,864::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:44,864::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:44,958::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:44,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:44,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:26:45,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:45,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0163487 s, 62.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:26:46,379::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:26:46,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf684fc5-8ac1-4646-bc18-58b754c61a6e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:46,380::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:26:46,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:46,399::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf684fc5-8ac1-4646-bc18-58b754c61a6e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:46,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf684fc5-8ac1-4646-bc18-58b754c61a6e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:46,399::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:46,399::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:46,399::task::993::Storage.TaskManager.Task::(_decref) Task=`cf684fc5-8ac1-4646-bc18-58b754c61a6e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:26:46,410::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:26:46,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`f70eb661-68f0-4c86-8977-56ba0720bc4d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:26:46,411::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:26:46,411::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d4ad1bc7-14c3-4ada-aada-119a44a763ae`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:26:46,411::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:26:46,411::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:26:46,411::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d4ad1bc7-14c3-4ada-aada-119a44a763ae`::Granted request >Thread-10197::DEBUG::2014-08-11 17:26:46,411::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f70eb661-68f0-4c86-8977-56ba0720bc4d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:26:46,411::task::993::Storage.TaskManager.Task::(_decref) Task=`f70eb661-68f0-4c86-8977-56ba0720bc4d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:26:46,428::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:46,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`f70eb661-68f0-4c86-8977-56ba0720bc4d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56263442432', 'isoprefix': '', 'alerts': [], 'disktotal': '621235142656', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:46,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`f70eb661-68f0-4c86-8977-56ba0720bc4d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:26:46,428::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:26:46,428::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:26:46,429::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:26:46,429::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:26:46,429::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:26:46,429::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:26:46,429::task::993::Storage.TaskManager.Task::(_decref) Task=`f70eb661-68f0-4c86-8977-56ba0720bc4d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:26:47,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:47,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162071 s, 63.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:47,528::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:47,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:47,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:47,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:47,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:47,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:47,529::__init__::225::IOProcess::(_processLogs) (541149) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:47,529::__init__::225::IOProcess::(_processLogs) (541149) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:47,532::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541149) Building response >Thread-19::DEBUG::2014-08-11 17:26:47,533::__init__::225::IOProcess::(_processLogs) (541149) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:47,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:47,533::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:26:47,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:26:47,598::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00205351 s, 178 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:47,598::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:47,598::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) (541150) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) (541150) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:47,599::__init__::225::IOProcess::(_processLogs) DEBUG|(541150) Building response >Thread-19::DEBUG::2014-08-11 17:26:47,600::__init__::225::IOProcess::(_processLogs) (541150) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:47,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:47,600::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:26:48,527::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:26:49,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:49,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0566122 s, 18.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:49,870::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:49,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:49,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:49,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:49,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:49,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) (541151) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:50,626::__init__::225::IOProcess::(_processLogs) (541151) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:50,652::__init__::225::IOProcess::(_processLogs) DEBUG|(541151) Building response >Thread-19::DEBUG::2014-08-11 17:26:50,652::__init__::225::IOProcess::(_processLogs) (541151) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:50,652::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:26:50,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:50,653::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:26:50,715::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00102237 s, 484 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:50,715::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) (541152) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) (541152) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:50,716::__init__::225::IOProcess::(_processLogs) DEBUG|(541152) Building response >Thread-19::DEBUG::2014-08-11 17:26:50,717::__init__::225::IOProcess::(_processLogs) (541152) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:50,717::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:26:50,717::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) (541153) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:50,718::__init__::225::IOProcess::(_processLogs) (541153) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) (541153) Building response >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) (541153) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:50,719::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) (541154) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) (541154) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) (541154) Building response >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) (541154) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:50,720::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:26:50,721::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:50,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:50,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:50,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:50,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:50,722::__init__::225::IOProcess::(_processLogs) (541155) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:26:50,722::__init__::225::IOProcess::(_processLogs) (541155) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:26:50,722::__init__::225::IOProcess::(_processLogs) (541155) Building response >Thread-19::DEBUG::2014-08-11 17:26:50,722::__init__::225::IOProcess::(_processLogs) (541155) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:50,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:50,722::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:26:51,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:51,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0652715 s, 15.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:26:53,060::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:26:53,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:53,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0759543 s, 13.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:26:54,875::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:54,876::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:54,876::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:54,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:54,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:54,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:55,464::task::595::Storage.TaskManager.Task::(_updateState) Task=`06a642f7-4657-4699-98c0-9f522af762c9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:55,464::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:26:55,465::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00205351', 'lastCheck': '7.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102237', 'lastCheck': '4.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:55,465::task::1191::Storage.TaskManager.Task::(prepare) Task=`06a642f7-4657-4699-98c0-9f522af762c9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00205351', 'lastCheck': '7.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102237', 'lastCheck': '4.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:26:55,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`06a642f7-4657-4699-98c0-9f522af762c9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:55,465::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:55,465::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:55,465::task::993::Storage.TaskManager.Task::(_decref) Task=`06a642f7-4657-4699-98c0-9f522af762c9`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:26:55,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:26:55,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:26:55,883::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:55,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0222243 s, 46.1 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:26:56,510::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:26:56,510::task::595::Storage.TaskManager.Task::(_updateState) Task=`197f6788-263f-4278-aa36-a6f84827b78a`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:26:56,511::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:26:56,531::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:56,531::task::1191::Storage.TaskManager.Task::(prepare) Task=`197f6788-263f-4278-aa36-a6f84827b78a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:26:56,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`197f6788-263f-4278-aa36-a6f84827b78a`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:26:56,531::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:26:56,531::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:26:56,531::task::993::Storage.TaskManager.Task::(_decref) Task=`197f6788-263f-4278-aa36-a6f84827b78a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:26:56,543::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:26:56,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`1812f7dc-cdb5-4654-9e84-18f6a666fca6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:26:56,543::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:26:56,543::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6dc6fa40-476c-40f0-86f8-dd0ee89bd2d1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:26:56,543::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:26:56,543::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:26:56,543::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6dc6fa40-476c-40f0-86f8-dd0ee89bd2d1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:26:56,544::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1812f7dc-cdb5-4654-9e84-18f6a666fca6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:26:56,544::task::993::Storage.TaskManager.Task::(_decref) Task=`1812f7dc-cdb5-4654-9e84-18f6a666fca6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:26:56,573::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:56,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`1812f7dc-cdb5-4654-9e84-18f6a666fca6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:26:56,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`1812f7dc-cdb5-4654-9e84-18f6a666fca6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:26:56,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:26:56,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:26:56,574::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:26:56,574::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:26:56,574::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:26:56,574::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:26:56,574::task::993::Storage.TaskManager.Task::(_decref) Task=`1812f7dc-cdb5-4654-9e84-18f6a666fca6`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) (541156) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:57,601::__init__::225::IOProcess::(_processLogs) (541156) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:57,602::__init__::225::IOProcess::(_processLogs) DEBUG|(541156) Building response >Thread-27::DEBUG::2014-08-11 17:26:57,602::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:26:57,602::__init__::225::IOProcess::(_processLogs) (541156) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:57,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:26:57,661::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:26:57,667::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00314691 s, 116 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:26:57,667::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) (541157) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:26:57,668::__init__::225::IOProcess::(_processLogs) (541157) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:26:57,670::__init__::225::IOProcess::(_processLogs) (541157) Queuing response >Thread-19::DEBUG::2014-08-11 17:26:57,670::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:26:57,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:26:58,043::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125293 s, 81.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:26:58,078::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:26:59,882::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:59,882::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:26:59,883::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:59,977::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:59,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:26:59,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:00,051::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:00,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123048 s, 83.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:27:00,553::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) (541158) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:00,722::__init__::225::IOProcess::(_processLogs) (541158) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:00,726::__init__::225::IOProcess::(_processLogs) DEBUG|(541158) Building response >Thread-19::DEBUG::2014-08-11 17:27:00,727::__init__::225::IOProcess::(_processLogs) (541158) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:00,727::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:27:00,727::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:00,727::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:27:00,812::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0140352 s, 35.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:00,812::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:00,812::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:00,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) (541159) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) (541159) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:00,813::__init__::225::IOProcess::(_processLogs) DEBUG|(541159) Building response >Thread-19::DEBUG::2014-08-11 17:27:00,814::__init__::225::IOProcess::(_processLogs) (541159) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:00,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:00,814::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:27:00,814::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:00,814::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:27:00,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) (541160) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) (541160) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) DEBUG|(541160) Building response >Thread-19::DEBUG::2014-08-11 17:27:00,815::__init__::225::IOProcess::(_processLogs) (541160) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:00,816::__init__::225::IOProcess::(_processLogs) (541161) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) (541161) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) DEBUG|(541161) Building response >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) (541161) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:00,817::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:27:00,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:00,818::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:00,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:00,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:00,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:00,819::__init__::225::IOProcess::(_processLogs) (541162) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:00,819::__init__::225::IOProcess::(_processLogs) (541162) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:00,819::__init__::225::IOProcess::(_processLogs) (541162) Building response >Thread-19::DEBUG::2014-08-11 17:27:00,819::__init__::225::IOProcess::(_processLogs) (541162) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:00,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:00,819::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:27:02,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:02,228::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370374 s, 27.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:27:04,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:04,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286788 s, 35.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:04,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:04,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:04,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:04,981::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:04,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:04,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:06,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:06,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147322 s, 69.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:06,642::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:27:06,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad8007eb-857b-4bd4-b283-05a1e2e2371e`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:06,643::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:27:06,680::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:06,680::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad8007eb-857b-4bd4-b283-05a1e2e2371e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:06,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad8007eb-857b-4bd4-b283-05a1e2e2371e`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:06,680::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:06,680::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:06,681::task::993::Storage.TaskManager.Task::(_decref) Task=`ad8007eb-857b-4bd4-b283-05a1e2e2371e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:27:06,687::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:27:06,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`285aa59d-da29-4576-86bc-ecb18aa2601d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:27:06,688::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:27:06,688::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2a954a88-5a88-4707-af0c-77a23225078f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:27:06,688::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:27:06,688::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:27:06,688::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2a954a88-5a88-4707-af0c-77a23225078f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:27:06,689::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`285aa59d-da29-4576-86bc-ecb18aa2601d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:27:06,689::task::993::Storage.TaskManager.Task::(_decref) Task=`285aa59d-da29-4576-86bc-ecb18aa2601d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:27:06,710::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:06,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`285aa59d-da29-4576-86bc-ecb18aa2601d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:06,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`285aa59d-da29-4576-86bc-ecb18aa2601d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:27:06,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:27:06,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:27:06,711::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:27:06,711::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:27:06,711::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:27:06,711::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:27:06,711::task::993::Storage.TaskManager.Task::(_decref) Task=`285aa59d-da29-4576-86bc-ecb18aa2601d`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) (541163) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) (541163) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:07,671::__init__::225::IOProcess::(_processLogs) DEBUG|(541163) Building response >Thread-19::DEBUG::2014-08-11 17:27:07,672::__init__::225::IOProcess::(_processLogs) (541163) Queuing response >Thread-27::DEBUG::2014-08-11 17:27:07,672::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:07,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:07,731::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:27:07,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000606819 s, 603 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:07,732::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) (541164) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) (541164) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:07,733::__init__::225::IOProcess::(_processLogs) DEBUG|(541164) Building response >Thread-19::DEBUG::2014-08-11 17:27:07,734::__init__::225::IOProcess::(_processLogs) (541164) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:07,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:07,734::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:27:08,068::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:27:08,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:08,533::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130096 s, 78.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:09,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:09,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:09,894::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:09,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:09,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:09,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:10,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:10,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0531499 s, 19.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:10,683::task::595::Storage.TaskManager.Task::(_updateState) Task=`540236c7-a620-4481-a018-e6a3d8493f6b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:10,684::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:27:10,684::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606819', 'lastCheck': '2.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0140352', 'lastCheck': '9.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:10,684::task::1191::Storage.TaskManager.Task::(prepare) Task=`540236c7-a620-4481-a018-e6a3d8493f6b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000606819', 'lastCheck': '2.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0140352', 'lastCheck': '9.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:10,684::task::595::Storage.TaskManager.Task::(_updateState) Task=`540236c7-a620-4481-a018-e6a3d8493f6b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:10,684::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:10,684::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:10,684::task::993::Storage.TaskManager.Task::(_decref) Task=`540236c7-a620-4481-a018-e6a3d8493f6b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:27:10,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:27:10,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:27:10,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:10,819::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:10,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:10,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:10,819::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:10,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:27:10,820::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:10,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:10,879::__init__::225::IOProcess::(_processLogs) (541165) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:10,879::__init__::225::IOProcess::(_processLogs) (541165) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:10,879::__init__::225::IOProcess::(_processLogs) (541165) Building response >Thread-19::DEBUG::2014-08-11 17:27:10,879::__init__::225::IOProcess::(_processLogs) (541165) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:10,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:10,880::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:27:11,015::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000448417 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:11,016::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:11,016::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:11,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:11,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:11,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:11,016::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) (541166) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) (541166) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) (541166) Building response >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) (541166) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:27:11,017::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) (541167) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:11,018::__init__::225::IOProcess::(_processLogs) (541167) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) (541167) Building response >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) (541167) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:11,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) (541168) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) (541168) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) (541168) Building response >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) (541168) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:11,020::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:27:11,021::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:11,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:11,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:11,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:11,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:11,021::__init__::225::IOProcess::(_processLogs) (541169) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:11,022::__init__::225::IOProcess::(_processLogs) (541169) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:11,022::__init__::225::IOProcess::(_processLogs) (541169) Building response >Thread-19::DEBUG::2014-08-11 17:27:11,022::__init__::225::IOProcess::(_processLogs) (541169) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:11,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:11,022::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:27:12,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:27:13,086::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:27:13,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530091 s, 19.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:14,899::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:14,900::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:14,900::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:14,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:14,994::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:14,994::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:15,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:15,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146623 s, 69.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:16,741::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:27:16,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`76f677ac-9bcf-4130-9943-31c6ac6ec0d0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:16,742::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:27:16,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:16,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`76f677ac-9bcf-4130-9943-31c6ac6ec0d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:16,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`76f677ac-9bcf-4130-9943-31c6ac6ec0d0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:16,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:16,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:16,756::task::993::Storage.TaskManager.Task::(_decref) Task=`76f677ac-9bcf-4130-9943-31c6ac6ec0d0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:27:16,763::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:27:16,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2377a85-f605-4ce4-892c-164b8f5e932c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:27:16,763::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:27:16,763::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0215f2cf-50ff-49b7-bf39-af63bdf660fe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:27:16,763::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:27:16,764::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:27:16,764::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0215f2cf-50ff-49b7-bf39-af63bdf660fe`::Granted request >Thread-10197::DEBUG::2014-08-11 17:27:16,764::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e2377a85-f605-4ce4-892c-164b8f5e932c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:27:16,764::task::993::Storage.TaskManager.Task::(_decref) Task=`e2377a85-f605-4ce4-892c-164b8f5e932c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:27:16,780::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:16,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2377a85-f605-4ce4-892c-164b8f5e932c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56217305088', 'isoprefix': '', 'alerts': [], 'disktotal': '621189005312', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:16,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2377a85-f605-4ce4-892c-164b8f5e932c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:27:16,780::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:27:16,780::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:27:16,780::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:27:16,780::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:27:16,780::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:27:16,781::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:27:16,781::task::993::Storage.TaskManager.Task::(_decref) Task=`e2377a85-f605-4ce4-892c-164b8f5e932c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:27:17,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:17,558::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146514 s, 69.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:17,735::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:17,735::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:17,735::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:17,735::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:17,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:17,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:17,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:17,736::__init__::225::IOProcess::(_processLogs) (541170) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:17,736::__init__::225::IOProcess::(_processLogs) (541170) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:17,736::__init__::225::IOProcess::(_processLogs) DEBUG|(541170) Building response >Thread-19::DEBUG::2014-08-11 17:27:17,737::__init__::225::IOProcess::(_processLogs) (541170) Queuing response >Thread-27::DEBUG::2014-08-11 17:27:17,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:17,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:17,795::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:27:17,809::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0105191 s, 34.8 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:17,809::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:17,809::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:17,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:17,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:17,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:17,810::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:17,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:17,810::__init__::225::IOProcess::(_processLogs) (541171) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:17,810::__init__::225::IOProcess::(_processLogs) (541171) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:17,811::__init__::225::IOProcess::(_processLogs) DEBUG|(541171) Building response >Thread-19::DEBUG::2014-08-11 17:27:17,811::__init__::225::IOProcess::(_processLogs) (541171) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:17,811::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:27:17,812::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:27:18,608::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:27:19,565::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:19,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0140062 s, 73.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:19,901::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:19,902::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:19,902::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:19,995::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:19,996::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:19,996::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:27:21,022::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:21,022::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:21,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:21,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:21,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:21,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:21,023::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:21,023::__init__::225::IOProcess::(_processLogs) (541172) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:21,023::__init__::225::IOProcess::(_processLogs) (541172) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:21,024::__init__::225::IOProcess::(_processLogs) DEBUG|(541172) Building response >Thread-19::DEBUG::2014-08-11 17:27:21,024::__init__::225::IOProcess::(_processLogs) (541172) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:21,025::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:27:21,025::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:21,026::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:27:21,093::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00403089 s, 123 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) (541173) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:21,094::__init__::225::IOProcess::(_processLogs) (541173) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:21,096::__init__::225::IOProcess::(_processLogs) DEBUG|(541173) Building response >Thread-19::DEBUG::2014-08-11 17:27:21,096::__init__::225::IOProcess::(_processLogs) (541173) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:21,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:21,096::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:21,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) (541174) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) (541174) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) (541174) Building response >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) (541174) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:27:21,098::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) (541175) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) (541175) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) (541175) Building response >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) (541175) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:21,099::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:21,100::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:21,100::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:27:21,100::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:21,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) (541176) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) (541176) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) (541176) Building response >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) (541176) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:21,101::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:27:21,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:21,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0164963 s, 62.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:27:23,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e65a293-8998-4b92-8c87-04c0a55eb6f1`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:27:23,086::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:23,087::__init__::225::IOProcess::(_processLogs) (541177) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:27:23,088::__init__::225::IOProcess::(_processLogs) (541177) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:27:23,090::__init__::225::IOProcess::(_processLogs) DEBUG|(541177) Building response >Thread-19::DEBUG::2014-08-11 17:27:23,090::__init__::225::IOProcess::(_processLogs) (541177) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:23,090::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:27:23,091::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:27:23,091::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:23,091::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:27:23,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:23,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:23,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:23,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:27:23,092::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:27:23,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:27:23,092::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e65a293-8998-4b92-8c87-04c0a55eb6f1`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:27:23,093::__init__::225::IOProcess::(_processLogs) (541178) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:27:23,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e65a293-8998-4b92-8c87-04c0a55eb6f1`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:27:23,093::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:27:23,093::__init__::225::IOProcess::(_processLogs) (541178) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:27:23,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:27:23,094::__init__::225::IOProcess::(_processLogs) (541178) Building response >Thread-10017::DEBUG::2014-08-11 17:27:23,094::task::993::Storage.TaskManager.Task::(_decref) Task=`4e65a293-8998-4b92-8c87-04c0a55eb6f1`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:27:23,095::__init__::225::IOProcess::(_processLogs) (541178) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:23,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:23,095::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:27:23,115::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:27:23,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:23,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.053833 s, 19.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:24,907::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:24,908::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:24,908::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:24,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:24,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:24,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:25,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:27:25,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`15fa339a-bd4d-4230-97b3-d7e6a519dee9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:25,941::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:27:25,942::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0105191', 'lastCheck': '8.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00403089', 'lastCheck': '4.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:25,942::task::1191::Storage.TaskManager.Task::(prepare) Task=`15fa339a-bd4d-4230-97b3-d7e6a519dee9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0105191', 'lastCheck': '8.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00403089', 'lastCheck': '4.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:25,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`15fa339a-bd4d-4230-97b3-d7e6a519dee9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:25,942::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:25,942::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:25,942::task::993::Storage.TaskManager.Task::(_decref) Task=`15fa339a-bd4d-4230-97b3-d7e6a519dee9`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:27:25,956::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:27:25,956::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:25,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0646255 s, 15.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:26,853::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:27:26,853::task::595::Storage.TaskManager.Task::(_updateState) Task=`16e5c5c4-9810-4b81-8f05-3f0daa923f7d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:26,853::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:27:26,930::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:26,930::task::1191::Storage.TaskManager.Task::(prepare) Task=`16e5c5c4-9810-4b81-8f05-3f0daa923f7d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:26,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`16e5c5c4-9810-4b81-8f05-3f0daa923f7d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:26,930::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:26,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:26,930::task::993::Storage.TaskManager.Task::(_decref) Task=`16e5c5c4-9810-4b81-8f05-3f0daa923f7d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:27:26,938::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:27:26,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`1827ad8a-5905-49f7-8270-59a034474f9a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:27:26,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:27:26,939::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5723ab5a-7843-49e0-895b-ab13e9e1d62b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:27:26,939::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:27:26,939::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:27:26,939::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5723ab5a-7843-49e0-895b-ab13e9e1d62b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:27:26,940::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1827ad8a-5905-49f7-8270-59a034474f9a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:27:26,940::task::993::Storage.TaskManager.Task::(_decref) Task=`1827ad8a-5905-49f7-8270-59a034474f9a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:27:26,957::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:26,957::task::1191::Storage.TaskManager.Task::(prepare) Task=`1827ad8a-5905-49f7-8270-59a034474f9a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:26,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`1827ad8a-5905-49f7-8270-59a034474f9a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:27:26,957::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:27:26,957::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:27:26,957::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:27:26,957::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:27:26,957::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:27:26,957::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:27:26,957::task::993::Storage.TaskManager.Task::(_decref) Task=`1827ad8a-5905-49f7-8270-59a034474f9a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:27:27,812::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:27,812::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:27,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) (541179) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) (541179) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:27,813::__init__::225::IOProcess::(_processLogs) DEBUG|(541179) Building response >Thread-19::DEBUG::2014-08-11 17:27:27,814::__init__::225::IOProcess::(_processLogs) (541179) Queuing response >Thread-27::DEBUG::2014-08-11 17:27:27,814::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:27,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:27,872::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:27:27,874::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00064768 s, 565 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:27,874::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:27,874::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) (541180) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) (541180) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:27,875::__init__::225::IOProcess::(_processLogs) DEBUG|(541180) Building response >Thread-19::DEBUG::2014-08-11 17:27:27,876::__init__::225::IOProcess::(_processLogs) (541180) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:27,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:27,876::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:27:27,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:28,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179232 s, 57.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:27:28,094::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:27:29,912::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:29,912::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:29,913::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:30,001::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:30,002::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:30,002::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:30,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:30,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0706649 s, 14.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:27:30,633::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:27:31,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:31,101::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:31,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:31,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:31,101::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:31,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:31,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:31,102::__init__::225::IOProcess::(_processLogs) (541181) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:31,102::__init__::225::IOProcess::(_processLogs) (541181) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:31,110::__init__::225::IOProcess::(_processLogs) DEBUG|(541181) Building response >Thread-19::DEBUG::2014-08-11 17:27:31,110::__init__::225::IOProcess::(_processLogs) (541181) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:31,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:31,110::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:27:31,111::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:27:31,169::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000386042 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:31,170::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:31,170::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:31,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:31,170::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:31,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:31,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:31,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:31,171::__init__::225::IOProcess::(_processLogs) (541182) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:31,171::__init__::225::IOProcess::(_processLogs) (541182) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:31,171::__init__::225::IOProcess::(_processLogs) DEBUG|(541182) Building response >Thread-19::DEBUG::2014-08-11 17:27:31,172::__init__::225::IOProcess::(_processLogs) (541182) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:31,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:31,172::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:27:31,172::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:31,172::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:27:31,172::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) (541183) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) (541183) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) (541183) Building response >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) (541183) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:31,173::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:31,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) (541184) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) (541184) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) (541184) Building response >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) (541184) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:31,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:31,176::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:31,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:31,176::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:31,176::__init__::225::IOProcess::(_processLogs) (541185) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:31,176::__init__::225::IOProcess::(_processLogs) (541185) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:31,176::__init__::225::IOProcess::(_processLogs) (541185) Building response >Thread-19::DEBUG::2014-08-11 17:27:31,177::__init__::225::IOProcess::(_processLogs) (541185) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:31,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:31,177::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:27:32,219::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:32,297::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174561 s, 58.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:27:34,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:34,436::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150262 s, 68.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:34,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:34,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:34,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:35,007::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:35,008::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:35,008::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:36,453::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:36,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130741 s, 78.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:37,074::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:27:37,074::task::595::Storage.TaskManager.Task::(_updateState) Task=`a81cceaa-effc-4b0f-993b-42542ed49695`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:37,075::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:27:37,146::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:37,146::task::1191::Storage.TaskManager.Task::(prepare) Task=`a81cceaa-effc-4b0f-993b-42542ed49695`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:37,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`a81cceaa-effc-4b0f-993b-42542ed49695`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:37,146::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:37,146::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:37,146::task::993::Storage.TaskManager.Task::(_decref) Task=`a81cceaa-effc-4b0f-993b-42542ed49695`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:27:37,159::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:27:37,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`227aef5c-d70d-4c5d-bb67-d44d5bd4da6d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:27:37,159::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:27:37,159::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4fa3f1c0-5a30-4f42-9aa9-d448e5145f6b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:27:37,159::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:27:37,159::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:27:37,160::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4fa3f1c0-5a30-4f42-9aa9-d448e5145f6b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:27:37,160::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`227aef5c-d70d-4c5d-bb67-d44d5bd4da6d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:27:37,160::task::993::Storage.TaskManager.Task::(_decref) Task=`227aef5c-d70d-4c5d-bb67-d44d5bd4da6d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:27:37,178::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:37,178::task::1191::Storage.TaskManager.Task::(prepare) Task=`227aef5c-d70d-4c5d-bb67-d44d5bd4da6d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:37,178::task::595::Storage.TaskManager.Task::(_updateState) Task=`227aef5c-d70d-4c5d-bb67-d44d5bd4da6d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:27:37,178::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:27:37,178::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:27:37,178::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:27:37,178::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:27:37,178::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:27:37,178::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:27:37,178::task::993::Storage.TaskManager.Task::(_decref) Task=`227aef5c-d70d-4c5d-bb67-d44d5bd4da6d`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:27:37,876::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) (541186) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:37,877::__init__::225::IOProcess::(_processLogs) (541186) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:37,878::__init__::225::IOProcess::(_processLogs) DEBUG|(541186) Building response >Thread-19::DEBUG::2014-08-11 17:27:37,878::__init__::225::IOProcess::(_processLogs) (541186) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:37,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:37,878::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:27:37,879::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:27:37,939::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00129541 s, 283 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:37,940::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:37,940::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:37,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:37,940::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) (541187) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) (541187) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) DEBUG|(541187) Building response >Thread-19::DEBUG::2014-08-11 17:27:37,941::__init__::225::IOProcess::(_processLogs) (541187) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:37,942::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:27:37,942::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:27:38,175::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:27:38,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:38,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387128 s, 26.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:39,925::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:39,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:39,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:40,014::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:40,014::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:40,014::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:40,649::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) (541188) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:41,177::__init__::225::IOProcess::(_processLogs) (541188) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:41,187::__init__::225::IOProcess::(_processLogs) DEBUG|(541188) Building response >Thread-19::DEBUG::2014-08-11 17:27:41,188::__init__::225::IOProcess::(_processLogs) (541188) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:41,188::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:41,188::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:27:41,188::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:41,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.179102 s, 5.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:41,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`29e77099-b600-4e18-b0a7-722a976c0ca1`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:41,383::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:27:41,384::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129541', 'lastCheck': '3.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386042', 'lastCheck': '10.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:41,384::task::1191::Storage.TaskManager.Task::(prepare) Task=`29e77099-b600-4e18-b0a7-722a976c0ca1`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129541', 'lastCheck': '3.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000386042', 'lastCheck': '10.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:41,384::task::595::Storage.TaskManager.Task::(_updateState) Task=`29e77099-b600-4e18-b0a7-722a976c0ca1`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:41,384::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:41,384::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:41,384::task::993::Storage.TaskManager.Task::(_decref) Task=`29e77099-b600-4e18-b0a7-722a976c0ca1`::ref 0 aborting False >Thread-28::DEBUG::2014-08-11 17:27:41,386::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0209706 s, 23.6 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) (541189) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:41,387::__init__::225::IOProcess::(_processLogs) (541189) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:41,388::__init__::225::IOProcess::(_processLogs) DEBUG|(541189) Building response >Thread-19::DEBUG::2014-08-11 17:27:41,388::__init__::225::IOProcess::(_processLogs) (541189) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:41,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:41,388::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:27:41,388::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) (541190) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:41,389::__init__::225::IOProcess::(_processLogs) (541190) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) (541190) Building response >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) (541190) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:41,390::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) (541191) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) (541191) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) (541191) Building response >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) (541191) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:41,391::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) (541192) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) (541192) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) (541192) Building response >Thread-19::DEBUG::2014-08-11 17:27:41,392::__init__::225::IOProcess::(_processLogs) DEBUG|(541192) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:41,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:41,393::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:27:41,403::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:27:41,403::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10102::DEBUG::2014-08-11 17:27:43,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07d77e6-8a90-42ac-b30b-3456c9787486`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:27:43,096::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:27:43,096::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:43,096::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:27:43,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:43,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:43,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:43,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:43,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:43,097::__init__::225::IOProcess::(_processLogs) (541193) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:27:43,097::__init__::225::IOProcess::(_processLogs) (541193) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:27:43,099::__init__::225::IOProcess::(_processLogs) DEBUG|(541193) Building response >Thread-19::DEBUG::2014-08-11 17:27:43,099::__init__::225::IOProcess::(_processLogs) (541193) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:43,100::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:27:43,101::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:27:43,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:43,101::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:27:43,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:43,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:43,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:43,102::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:27:43,102::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:27:43,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:27:43,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`b07d77e6-8a90-42ac-b30b-3456c9787486`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:27:43,103::__init__::225::IOProcess::(_processLogs) (541194) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:27:43,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07d77e6-8a90-42ac-b30b-3456c9787486`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:27:43,103::__init__::225::IOProcess::(_processLogs) (541194) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:27:43,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:27:43,104::__init__::225::IOProcess::(_processLogs) (541194) Building response >Thread-10102::DEBUG::2014-08-11 17:27:43,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:27:43,104::__init__::225::IOProcess::(_processLogs) (541194) Queuing response >Thread-10102::DEBUG::2014-08-11 17:27:43,105::task::993::Storage.TaskManager.Task::(_decref) Task=`b07d77e6-8a90-42ac-b30b-3456c9787486`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:27:43,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:43,105::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:27:43,126::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:27:43,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:43,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155152 s, 66.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:44,932::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:44,932::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:44,933::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:45,020::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:45,020::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:45,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:45,455::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:45,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139038 s, 73.6 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:47,234::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:27:47,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4372cf5-2aff-4954-954b-7c5beaf5e421`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:47,234::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:27:47,262::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:47,262::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4372cf5-2aff-4954-954b-7c5beaf5e421`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:47,262::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4372cf5-2aff-4954-954b-7c5beaf5e421`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:47,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:47,262::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:47,262::task::993::Storage.TaskManager.Task::(_decref) Task=`d4372cf5-2aff-4954-954b-7c5beaf5e421`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:27:47,269::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:27:47,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`daed8da6-d92f-4f72-a147-eff53d2cc98d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:27:47,269::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:27:47,270::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2526e4d1-f257-4f48-bc13-f8c1971edbe8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:27:47,270::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:27:47,270::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:27:47,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2526e4d1-f257-4f48-bc13-f8c1971edbe8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:27:47,270::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`daed8da6-d92f-4f72-a147-eff53d2cc98d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:27:47,270::task::993::Storage.TaskManager.Task::(_decref) Task=`daed8da6-d92f-4f72-a147-eff53d2cc98d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:27:47,288::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:47,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`daed8da6-d92f-4f72-a147-eff53d2cc98d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56194236416', 'isoprefix': '', 'alerts': [], 'disktotal': '621165936640', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:47,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`daed8da6-d92f-4f72-a147-eff53d2cc98d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:27:47,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:27:47,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:27:47,289::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:27:47,289::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:27:47,289::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:27:47,289::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:27:47,289::task::993::Storage.TaskManager.Task::(_decref) Task=`daed8da6-d92f-4f72-a147-eff53d2cc98d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:27:47,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:47,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133575 s, 76.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:47,943::__init__::225::IOProcess::(_processLogs) (541195) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:47,944::__init__::225::IOProcess::(_processLogs) (541195) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:47,944::__init__::225::IOProcess::(_processLogs) DEBUG|(541195) Building response >Thread-27::DEBUG::2014-08-11 17:27:47,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:47,944::__init__::225::IOProcess::(_processLogs) (541195) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:48,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:48,004::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:27:48,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0197997 s, 18.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:48,023::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) (541196) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) (541196) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:48,024::__init__::225::IOProcess::(_processLogs) DEBUG|(541196) Building response >Thread-19::DEBUG::2014-08-11 17:27:48,025::__init__::225::IOProcess::(_processLogs) (541196) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:48,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:48,025::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:27:48,651::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:27:49,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:49,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123542 s, 82.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:49,938::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:49,938::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:49,938::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:50,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:50,022::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:50,022::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:27:51,393::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:51,393::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:51,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) (541197) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) (541197) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:51,394::__init__::225::IOProcess::(_processLogs) DEBUG|(541197) Building response >Thread-28::DEBUG::2014-08-11 17:27:51,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:51,395::__init__::225::IOProcess::(_processLogs) (541197) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:51,453::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:51,453::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:27:51,471::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0113353 s, 43.7 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) (541198) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:51,472::__init__::225::IOProcess::(_processLogs) (541198) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:51,474::__init__::225::IOProcess::(_processLogs) DEBUG|(541198) Building response >Thread-19::DEBUG::2014-08-11 17:27:51,474::__init__::225::IOProcess::(_processLogs) (541198) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:51,475::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:27:51,475::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:27:51,475::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:51,475::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:27:51,475::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) (541199) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) (541199) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) (541199) Building response >Thread-19::DEBUG::2014-08-11 17:27:51,476::__init__::225::IOProcess::(_processLogs) (541199) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:51,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) (541200) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) (541200) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) (541200) Building response >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) (541200) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:51,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:51,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:51,479::__init__::225::IOProcess::(_processLogs) (541201) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:27:51,479::__init__::225::IOProcess::(_processLogs) (541201) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:27:51,479::__init__::225::IOProcess::(_processLogs) (541201) Building response >Thread-19::DEBUG::2014-08-11 17:27:51,479::__init__::225::IOProcess::(_processLogs) (541201) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:51,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:51,480::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:27:51,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:51,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147254 s, 69.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:27:53,182::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:27:53,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:53,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0718065 s, 14.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:54,944::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:54,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:54,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:55,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:55,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:27:55,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:27:55,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:27:55,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173039 s, 59.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:27:56,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`9592f107-1c0e-4de1-b29f-5763357722b0`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:56,637::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:27:56,637::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0197997', 'lastCheck': '8.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113353', 'lastCheck': '5.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:56,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`9592f107-1c0e-4de1-b29f-5763357722b0`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0197997', 'lastCheck': '8.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0113353', 'lastCheck': '5.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:27:56,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`9592f107-1c0e-4de1-b29f-5763357722b0`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:56,638::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:56,638::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:56,638::task::993::Storage.TaskManager.Task::(_decref) Task=`9592f107-1c0e-4de1-b29f-5763357722b0`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:27:56,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:27:56,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:27:57,324::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:27:57,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca2d81a9-c94f-4dc9-aef2-c58dcd50deed`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:27:57,324::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:27:57,381::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:57,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca2d81a9-c94f-4dc9-aef2-c58dcd50deed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:27:57,381::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca2d81a9-c94f-4dc9-aef2-c58dcd50deed`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:27:57,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:27:57,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:27:57,381::task::993::Storage.TaskManager.Task::(_decref) Task=`ca2d81a9-c94f-4dc9-aef2-c58dcd50deed`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:27:57,445::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:27:57,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`39efa7e9-1f6c-4d52-8a3d-26c0fa343f16`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:27:57,445::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:27:57,446::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9d5d85e3-41de-43a8-903a-f440435525ab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:27:57,446::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:27:57,446::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:27:57,446::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9d5d85e3-41de-43a8-903a-f440435525ab`::Granted request >Thread-10197::DEBUG::2014-08-11 17:27:57,446::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39efa7e9-1f6c-4d52-8a3d-26c0fa343f16`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:27:57,447::task::993::Storage.TaskManager.Task::(_decref) Task=`39efa7e9-1f6c-4d52-8a3d-26c0fa343f16`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:27:57,477::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:57,477::task::1191::Storage.TaskManager.Task::(prepare) Task=`39efa7e9-1f6c-4d52-8a3d-26c0fa343f16`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:27:57,477::task::595::Storage.TaskManager.Task::(_updateState) Task=`39efa7e9-1f6c-4d52-8a3d-26c0fa343f16`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:27:57,477::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:27:57,477::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:27:57,477::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:27:57,478::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:27:57,478::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:27:57,478::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:27:57,478::task::993::Storage.TaskManager.Task::(_decref) Task=`39efa7e9-1f6c-4d52-8a3d-26c0fa343f16`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:27:58,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:58,063::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:58,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:58,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:27:58,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:58,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:58,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:58,070::__init__::225::IOProcess::(_processLogs) (541202) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:58,071::__init__::225::IOProcess::(_processLogs) (541202) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:58,072::__init__::225::IOProcess::(_processLogs) (541202) Queuing response >Thread-27::DEBUG::2014-08-11 17:27:58,073::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:27:58,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:58,134::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:27:58,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0721306 s, 14.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:27:58,141::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-27::DEBUG::2014-08-11 17:27:58,156::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.017362 s, 21.1 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:27:58,156::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:27:58,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:27:58,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:27:58,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:27:58,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:27:58,157::__init__::225::IOProcess::(_processLogs) (541203) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:27:58,157::__init__::225::IOProcess::(_processLogs) (541203) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:27:58,157::__init__::225::IOProcess::(_processLogs) (541203) Queuing response >Thread-19::DEBUG::2014-08-11 17:27:58,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:27:58,158::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:27:59,947::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:59,948::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:27:59,948::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:00,034::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:00,034::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:00,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:00,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:00,268::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0610771 s, 16.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:28:00,684::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-28::DEBUG::2014-08-11 17:28:01,479::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:28:01,481::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:28:01,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,481::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,482::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:01,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,482::__init__::225::IOProcess::(_processLogs) (541204) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:28:01,482::__init__::225::IOProcess::(_processLogs) (541204) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:28:01,482::__init__::225::IOProcess::(_processLogs) (541204) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,483::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:28:01,484::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:01,485::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:28:01,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:01,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,489::__init__::225::IOProcess::(_processLogs) (541205) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:28:01,490::__init__::225::IOProcess::(_processLogs) (541205) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:28:01,491::__init__::225::IOProcess::(_processLogs) (541205) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,493::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:28:01,495::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:28:01,495::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:28:01,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,495::__init__::225::IOProcess::(_processLogs) (541206) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:28:01,496::__init__::225::IOProcess::(_processLogs) (541206) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:28:01,578::__init__::225::IOProcess::(_processLogs) (541206) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,578::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:28:01,578::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:28:01,578::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:28:01,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,578::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,579::__init__::225::IOProcess::(_processLogs) (541207) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:28:01,579::__init__::225::IOProcess::(_processLogs) (541207) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:28:01,586::__init__::225::IOProcess::(_processLogs) (541207) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,586::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-28::DEBUG::2014-08-11 17:28:01,586::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:28:01,587::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:28:01,587::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) (541208) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) (541208) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) (541208) Building response >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) (541208) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,588::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:01,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,589::__init__::225::IOProcess::(_processLogs) (541209) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:28:01,589::__init__::225::IOProcess::(_processLogs) (541209) Got request for method 'glob' >Thread-28::DEBUG::2014-08-11 17:28:01,589::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:28:01,589::__init__::225::IOProcess::(_processLogs) (541209) Queuing response >Thread-28::INFO::2014-08-11 17:28:01,590::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-28::INFO::2014-08-11 17:28:01,590::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:28:01,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) (541210) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:01,591::__init__::225::IOProcess::(_processLogs) (541210) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:01,592::__init__::225::IOProcess::(_processLogs) (541210) Queuing response >Thread-28::DEBUG::2014-08-11 17:28:01,592::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:01,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,651::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:28:01,651::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000356232 s, 1.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) (541211) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:01,652::__init__::225::IOProcess::(_processLogs) (541211) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:01,653::__init__::225::IOProcess::(_processLogs) (541211) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,653::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) (541212) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) (541212) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:01,654::__init__::225::IOProcess::(_processLogs) (541212) Building response >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) (541212) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) (541213) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) (541213) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) (541213) Building response >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) (541213) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:01,656::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:01,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:01,657::__init__::225::IOProcess::(_processLogs) (541214) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:01,657::__init__::225::IOProcess::(_processLogs) (541214) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:01,657::__init__::225::IOProcess::(_processLogs) (541214) Building response >Thread-19::DEBUG::2014-08-11 17:28:01,657::__init__::225::IOProcess::(_processLogs) (541214) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:01,658::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:01,658::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:28:02,277::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:02,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189642 s, 54.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:28:04,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:04,503::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249798 s, 41.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:04,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:04,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:04,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:05,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:05,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:05,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:06,512::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:06,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056365 s, 18.2 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:07,521::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:28:07,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a0f6e05-7fe5-4c94-bdc9-a57afbf3fc6c`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:07,521::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:28:07,612::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:07,613::task::1191::Storage.TaskManager.Task::(prepare) Task=`3a0f6e05-7fe5-4c94-bdc9-a57afbf3fc6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:07,613::task::595::Storage.TaskManager.Task::(_updateState) Task=`3a0f6e05-7fe5-4c94-bdc9-a57afbf3fc6c`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:07,613::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:07,613::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:07,613::task::993::Storage.TaskManager.Task::(_decref) Task=`3a0f6e05-7fe5-4c94-bdc9-a57afbf3fc6c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:28:07,625::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:28:07,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`8719ac07-f9c4-43be-98e2-a03648fd01fc`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:28:07,625::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:28:07,625::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`49efc1b3-0285-431a-a7d0-c1c46200992b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:28:07,625::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:28:07,626::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:28:07,626::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`49efc1b3-0285-431a-a7d0-c1c46200992b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:28:07,626::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8719ac07-f9c4-43be-98e2-a03648fd01fc`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:28:07,626::task::993::Storage.TaskManager.Task::(_decref) Task=`8719ac07-f9c4-43be-98e2-a03648fd01fc`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:28:07,646::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:07,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`8719ac07-f9c4-43be-98e2-a03648fd01fc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:07,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`8719ac07-f9c4-43be-98e2-a03648fd01fc`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:28:07,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:28:07,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:28:07,646::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:28:07,646::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:28:07,646::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:28:07,646::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:28:07,646::task::993::Storage.TaskManager.Task::(_decref) Task=`8719ac07-f9c4-43be-98e2-a03648fd01fc`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:28:08,158::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:08,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:08,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:08,159::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:08,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:08,159::__init__::225::IOProcess::(_processLogs) (541215) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:08,159::__init__::225::IOProcess::(_processLogs) (541215) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:08,160::__init__::225::IOProcess::(_processLogs) (541215) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:08,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:28:08,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:28:08,224::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-27::DEBUG::2014-08-11 17:28:08,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0118004 s, 31.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:08,231::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:08,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:08,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:08,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:08,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:08,232::__init__::225::IOProcess::(_processLogs) (541216) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:08,232::__init__::225::IOProcess::(_processLogs) (541216) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:08,232::__init__::225::IOProcess::(_processLogs) (541216) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:08,232::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:28:08,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:08,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0533831 s, 19.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:09,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:09,960::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:09,960::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:10,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:10,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:10,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:10,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:10,842::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292616 s, 35.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) (541217) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:11,658::__init__::225::IOProcess::(_processLogs) (541217) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:11,659::__init__::225::IOProcess::(_processLogs) (541217) Queuing response >Thread-28::DEBUG::2014-08-11 17:28:11,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:11,659::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:11,718::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:28:11,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0163125 s, 30.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:11,736::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:11,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:11,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:11,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:11,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:11,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:11,737::__init__::225::IOProcess::(_processLogs) (541218) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:11,737::__init__::225::IOProcess::(_processLogs) (541218) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:11,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541218) Building response >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) (541218) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:11,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) (541219) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) (541219) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) (541219) Building response >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) (541219) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:11,739::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:11,740::__init__::225::IOProcess::(_processLogs) (541220) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) (541220) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) (541220) Building response >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) (541220) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:11,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) (541221) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) (541221) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) (541221) Building response >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) (541221) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:11,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:11,743::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:28:12,071::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fe163c7-92a9-47a8-8ca3-6a70d86f4c57`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:12,071::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:28:12,071::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118004', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0163125', 'lastCheck': '0.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:12,072::task::1191::Storage.TaskManager.Task::(prepare) Task=`4fe163c7-92a9-47a8-8ca3-6a70d86f4c57`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0118004', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0163125', 'lastCheck': '0.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:12,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`4fe163c7-92a9-47a8-8ca3-6a70d86f4c57`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:12,072::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:12,072::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:12,072::task::993::Storage.TaskManager.Task::(_decref) Task=`4fe163c7-92a9-47a8-8ca3-6a70d86f4c57`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:28:12,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:28:12,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:12,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:12,960::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051382 s, 19.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:28:13,149::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:28:14,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:14,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:14,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:14,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:15,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0148907 s, 68.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:15,052::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:15,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:15,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:17,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:17,124::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0162892 s, 62.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:17,691::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:28:17,691::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d186b9a-9042-48c6-8e9d-5ee3a127ed58`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:17,692::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:28:17,710::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:17,710::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d186b9a-9042-48c6-8e9d-5ee3a127ed58`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:17,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d186b9a-9042-48c6-8e9d-5ee3a127ed58`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:17,710::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:17,710::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:17,710::task::993::Storage.TaskManager.Task::(_decref) Task=`8d186b9a-9042-48c6-8e9d-5ee3a127ed58`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:28:17,717::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:28:17,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fe5c05-18a9-4581-be81-3f338cbdea05`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:28:17,717::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:28:17,717::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e2d76cb9-bfb6-4fe8-a0de-62518b71d115`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:28:17,717::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:28:17,717::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:28:17,717::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e2d76cb9-bfb6-4fe8-a0de-62518b71d115`::Granted request >Thread-10197::DEBUG::2014-08-11 17:28:17,718::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`27fe5c05-18a9-4581-be81-3f338cbdea05`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:28:17,718::task::993::Storage.TaskManager.Task::(_decref) Task=`27fe5c05-18a9-4581-be81-3f338cbdea05`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:28:17,735::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:17,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`27fe5c05-18a9-4581-be81-3f338cbdea05`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56117690368', 'isoprefix': '', 'alerts': [], 'disktotal': '621089390592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:17,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`27fe5c05-18a9-4581-be81-3f338cbdea05`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:28:17,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:28:17,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:28:17,735::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:28:17,735::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:28:17,735::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:28:17,735::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:28:17,736::task::993::Storage.TaskManager.Task::(_decref) Task=`27fe5c05-18a9-4581-be81-3f338cbdea05`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:28:18,233::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:18,233::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:18,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:18,233::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:18,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:18,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:18,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:18,234::__init__::225::IOProcess::(_processLogs) (541222) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:18,234::__init__::225::IOProcess::(_processLogs) (541222) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:18,234::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541222) Building response >Thread-19::DEBUG::2014-08-11 17:28:18,235::__init__::225::IOProcess::(_processLogs) (541222) Queuing response >Thread-27::DEBUG::2014-08-11 17:28:18,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:18,235::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:18,294::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:28:18,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000464006 s, 789 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:18,299::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:18,300::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:18,301::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:18,302::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:18,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:18,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:18,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:18,303::__init__::225::IOProcess::(_processLogs) (541223) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:18,304::__init__::225::IOProcess::(_processLogs) (541223) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:18,305::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541223) Building response >Thread-19::DEBUG::2014-08-11 17:28:18,306::__init__::225::IOProcess::(_processLogs) (541223) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:18,306::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:18,307::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:28:18,725::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:28:19,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:19,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0663822 s, 15.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:19,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:19,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:19,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:20,059::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:20,059::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:20,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:21,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:21,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561936 s, 18.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:21,742::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) (541224) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:21,743::__init__::225::IOProcess::(_processLogs) (541224) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:21,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541224) Building response >Thread-19::DEBUG::2014-08-11 17:28:21,744::__init__::225::IOProcess::(_processLogs) (541224) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:21,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:28:21,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:21,745::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:28:21,805::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000960307 s, 515 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:21,805::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) (541225) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:21,806::__init__::225::IOProcess::(_processLogs) (541225) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:21,807::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541225) Building response >Thread-19::DEBUG::2014-08-11 17:28:21,807::__init__::225::IOProcess::(_processLogs) (541225) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:21,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:21,807::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:21,807::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) (541226) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:21,808::__init__::225::IOProcess::(_processLogs) (541226) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) (541226) Building response >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) (541226) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:21,809::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) (541227) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) (541227) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) (541227) Building response >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) (541227) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:21,810::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:21,811::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:28:21,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:21,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:21,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:21,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) (541228) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) (541228) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) (541228) Building response >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) (541228) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:21,812::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:28:23,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`0def876d-2626-4e4e-a0ec-21c8f1067f82`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:28:23,226::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:23,227::__init__::225::IOProcess::(_processLogs) (541229) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:28:23,228::__init__::225::IOProcess::(_processLogs) (541229) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:28:23,229::__init__::225::IOProcess::(_processLogs) DEBUG|(541229) Building response >Thread-19::DEBUG::2014-08-11 17:28:23,229::__init__::225::IOProcess::(_processLogs) (541229) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:23,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:23,229::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:28:23,230::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:23,230::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:28:23,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:23,230::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:23,230::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-10017::INFO::2014-08-11 17:28:23,230::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:28:23,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:28:23,231::task::1191::Storage.TaskManager.Task::(prepare) Task=`0def876d-2626-4e4e-a0ec-21c8f1067f82`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:28:23,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:28:23,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`0def876d-2626-4e4e-a0ec-21c8f1067f82`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:28:23,232::__init__::225::IOProcess::(_processLogs) (541230) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:28:23,232::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:28:23,232::__init__::225::IOProcess::(_processLogs) (541230) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:28:23,232::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:28:23,233::__init__::225::IOProcess::(_processLogs) (541230) Building response >Thread-10017::DEBUG::2014-08-11 17:28:23,233::task::993::Storage.TaskManager.Task::(_decref) Task=`0def876d-2626-4e4e-a0ec-21c8f1067f82`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:28:23,233::__init__::225::IOProcess::(_processLogs) (541230) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:23,234::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:23,234::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:28:23,254::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:28:23,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:23,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494097 s, 20.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:24,975::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:24,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:24,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:25,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:25,062::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:25,062::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:25,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:25,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0591682 s, 17.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:27,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a9b49d-b19b-481e-9041-028b79cb028f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:27,349::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:28:27,349::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464006', 'lastCheck': '9.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000960307', 'lastCheck': '5.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:27,349::task::1191::Storage.TaskManager.Task::(prepare) Task=`12a9b49d-b19b-481e-9041-028b79cb028f`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000464006', 'lastCheck': '9.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000960307', 'lastCheck': '5.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:27,349::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a9b49d-b19b-481e-9041-028b79cb028f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:27,349::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:27,349::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:27,349::task::993::Storage.TaskManager.Task::(_decref) Task=`12a9b49d-b19b-481e-9041-028b79cb028f`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:28:27,363::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:28:27,364::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:27,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:27,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273687 s, 37.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:27,848::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:28:27,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`d609b3c0-a73c-4f8e-81e2-5f69acf77b7f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:27,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:28:27,878::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:27,878::task::1191::Storage.TaskManager.Task::(prepare) Task=`d609b3c0-a73c-4f8e-81e2-5f69acf77b7f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:27,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`d609b3c0-a73c-4f8e-81e2-5f69acf77b7f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:27,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:27,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:27,878::task::993::Storage.TaskManager.Task::(_decref) Task=`d609b3c0-a73c-4f8e-81e2-5f69acf77b7f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:28:27,886::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:28:27,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`495d1621-e28e-436b-a9bb-f5726f61a8b5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:28:27,886::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:28:27,887::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0cb649d9-88f2-4dd2-a7c2-a1cd3b9a8532`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:28:27,887::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:28:27,887::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:28:27,887::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0cb649d9-88f2-4dd2-a7c2-a1cd3b9a8532`::Granted request >Thread-10197::DEBUG::2014-08-11 17:28:27,887::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`495d1621-e28e-436b-a9bb-f5726f61a8b5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:28:27,887::task::993::Storage.TaskManager.Task::(_decref) Task=`495d1621-e28e-436b-a9bb-f5726f61a8b5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:28:27,913::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:27,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`495d1621-e28e-436b-a9bb-f5726f61a8b5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:27,913::task::595::Storage.TaskManager.Task::(_updateState) Task=`495d1621-e28e-436b-a9bb-f5726f61a8b5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:28:27,913::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:28:27,913::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:28:27,913::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:28:27,914::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:28:27,914::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:28:27,914::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:28:27,914::task::993::Storage.TaskManager.Task::(_decref) Task=`495d1621-e28e-436b-a9bb-f5726f61a8b5`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:28:28,197::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:28:28,306::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) (541231) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) (541231) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:28,307::__init__::225::IOProcess::(_processLogs) DEBUG|(541231) Building response >Thread-19::DEBUG::2014-08-11 17:28:28,308::__init__::225::IOProcess::(_processLogs) (541231) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:28,308::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:28:28,309::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:28,309::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:28:28,380::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0110677 s, 33.1 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:28,381::__init__::225::IOProcess::(_processLogs) (541232) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:28,382::__init__::225::IOProcess::(_processLogs) (541232) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:28,382::__init__::225::IOProcess::(_processLogs) DEBUG|(541232) Building response >Thread-19::DEBUG::2014-08-11 17:28:28,383::__init__::225::IOProcess::(_processLogs) (541232) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:28,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:28,383::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:28:29,725::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:29,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137984 s, 74.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:29,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:29,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:29,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:30,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:30,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:30,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:28:30,783::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:28:31,806::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:31,865::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:31,865::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:31,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:31,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:31,867::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:31,868::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:28:31,869::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:31,869::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:31,928::__init__::225::IOProcess::(_processLogs) (541233) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:31,929::__init__::225::IOProcess::(_processLogs) (541233) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:31,930::__init__::225::IOProcess::(_processLogs) (541233) Building response >Thread-19::DEBUG::2014-08-11 17:28:31,931::__init__::225::IOProcess::(_processLogs) (541233) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:31,932::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:31,932::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:28:31,937::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0712449 s, 14.4 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:28:31,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.031876 s, 15.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:31,962::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:31,963::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:31,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:31,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:31,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:31,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:31,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:31,969::__init__::225::IOProcess::(_processLogs) (541234) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:31,970::__init__::225::IOProcess::(_processLogs) (541234) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:31,972::__init__::225::IOProcess::(_processLogs) DEBUG|(541234) Building response >Thread-19::DEBUG::2014-08-11 17:28:31,973::__init__::225::IOProcess::(_processLogs) (541234) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:31,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:31,975::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:31,977::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:31,978::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:28:31,979::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:31,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:31,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:31,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:31,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:31,984::__init__::225::IOProcess::(_processLogs) (541235) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:31,985::__init__::225::IOProcess::(_processLogs) (541235) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:31,987::__init__::225::IOProcess::(_processLogs) (541235) Building response >Thread-19::DEBUG::2014-08-11 17:28:31,988::__init__::225::IOProcess::(_processLogs) (541235) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:31,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:31,990::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:31,992::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:31,993::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:28:31,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:31,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:31,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:31,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:31,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:32,000::__init__::225::IOProcess::(_processLogs) (541236) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:32,001::__init__::225::IOProcess::(_processLogs) (541236) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:32,002::__init__::225::IOProcess::(_processLogs) (541236) Building response >Thread-19::DEBUG::2014-08-11 17:28:32,003::__init__::225::IOProcess::(_processLogs) (541236) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:32,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:32,005::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:32,007::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:32,008::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:28:32,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:32,010::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:32,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:32,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:32,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:32,015::__init__::225::IOProcess::(_processLogs) (541237) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:32,016::__init__::225::IOProcess::(_processLogs) (541237) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:32,017::__init__::225::IOProcess::(_processLogs) (541237) Building response >Thread-19::DEBUG::2014-08-11 17:28:32,018::__init__::225::IOProcess::(_processLogs) (541237) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:32,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:32,020::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:28:34,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:34,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175126 s, 58.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:34,981::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:34,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:34,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:35,071::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:35,072::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:35,072::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:36,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:36,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335931 s, 30.5 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:37,937::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:28:37,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`885ccfbf-1df3-4080-a09c-c81600edf8a8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:37,937::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:28:37,951::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:37,951::task::1191::Storage.TaskManager.Task::(prepare) Task=`885ccfbf-1df3-4080-a09c-c81600edf8a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:37,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`885ccfbf-1df3-4080-a09c-c81600edf8a8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:37,951::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:37,951::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:37,951::task::993::Storage.TaskManager.Task::(_decref) Task=`885ccfbf-1df3-4080-a09c-c81600edf8a8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:28:37,961::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:28:37,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab813de8-5d38-4840-9163-40b1319584b5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:28:37,961::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:28:37,962::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fcee17ef-a391-4423-950c-eeeeb6cd0c98`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:28:37,962::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:28:37,962::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:28:37,962::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fcee17ef-a391-4423-950c-eeeeb6cd0c98`::Granted request >Thread-10197::DEBUG::2014-08-11 17:28:37,962::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ab813de8-5d38-4840-9163-40b1319584b5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:28:37,962::task::993::Storage.TaskManager.Task::(_decref) Task=`ab813de8-5d38-4840-9163-40b1319584b5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:28:37,980::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:37,980::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab813de8-5d38-4840-9163-40b1319584b5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:37,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab813de8-5d38-4840-9163-40b1319584b5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:28:37,980::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:28:37,980::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:28:37,980::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:28:37,980::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:28:37,980::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:28:37,980::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:28:37,981::task::993::Storage.TaskManager.Task::(_decref) Task=`ab813de8-5d38-4840-9163-40b1319584b5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:28:38,226::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:28:38,291::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:28:38,298::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122828 s, 83.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:38,383::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:38,383::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:38,383::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) (541238) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) (541238) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) (541238) Building response >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) (541238) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:38,384::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:28:38,385::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:28:38,447::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00266273 s, 137 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:38,448::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:38,449::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:38,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:38,449::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:38,449::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:38,450::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:38,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:38,450::__init__::225::IOProcess::(_processLogs) (541239) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:38,450::__init__::225::IOProcess::(_processLogs) (541239) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:38,450::__init__::225::IOProcess::(_processLogs) DEBUG|(541239) Building response >Thread-19::DEBUG::2014-08-11 17:28:38,450::__init__::225::IOProcess::(_processLogs) (541239) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:38,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:38,451::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:39,987::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:39,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:39,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:40,077::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:40,078::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:40,078::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:40,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:40,760::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244271 s, 41.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:42,022::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) (541240) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) (541240) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:42,023::__init__::225::IOProcess::(_processLogs) DEBUG|(541240) Building response >Thread-19::DEBUG::2014-08-11 17:28:42,024::__init__::225::IOProcess::(_processLogs) (541240) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:42,024::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:42,024::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:28:42,024::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:28:42,084::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000682212 s, 726 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) (541241) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) (541241) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:42,085::__init__::225::IOProcess::(_processLogs) DEBUG|(541241) Building response >Thread-19::DEBUG::2014-08-11 17:28:42,086::__init__::225::IOProcess::(_processLogs) (541241) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:42,086::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:42,086::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:42,086::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) (541242) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) (541242) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:42,087::__init__::225::IOProcess::(_processLogs) (541242) Building response >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) (541242) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:42,088::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) (541243) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) (541243) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) (541243) Building response >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) (541243) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:28:42,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:42,090::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:42,090::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:42,090::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:42,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:42,090::__init__::225::IOProcess::(_processLogs) (541244) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:42,090::__init__::225::IOProcess::(_processLogs) (541244) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:42,091::__init__::225::IOProcess::(_processLogs) DEBUG|(541244) Building response >Thread-19::DEBUG::2014-08-11 17:28:42,091::__init__::225::IOProcess::(_processLogs) (541244) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:42,091::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:28:42,091::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10205::DEBUG::2014-08-11 17:28:42,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`57c64c04-705b-4441-8a12-7b4ae2ae7025`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:42,528::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:28:42,528::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00266273', 'lastCheck': '4.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682212', 'lastCheck': '0.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:42,528::task::1191::Storage.TaskManager.Task::(prepare) Task=`57c64c04-705b-4441-8a12-7b4ae2ae7025`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00266273', 'lastCheck': '4.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000682212', 'lastCheck': '0.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:42,529::task::595::Storage.TaskManager.Task::(_updateState) Task=`57c64c04-705b-4441-8a12-7b4ae2ae7025`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:42,529::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:42,529::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:42,529::task::993::Storage.TaskManager.Task::(_decref) Task=`57c64c04-705b-4441-8a12-7b4ae2ae7025`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:28:42,548::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:28:42,548::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:42,768::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:42,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135672 s, 75.5 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:28:43,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`af15e0ce-5c3c-43bc-8976-ad006b3e6c7d`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:28:43,218::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:43,219::__init__::225::IOProcess::(_processLogs) (541245) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:28:43,220::__init__::225::IOProcess::(_processLogs) (541245) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:28:43,220::__init__::225::IOProcess::(_processLogs) DEBUG|(541245) Building response >Thread-19::DEBUG::2014-08-11 17:28:43,220::__init__::225::IOProcess::(_processLogs) (541245) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:43,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:43,220::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:28:43,221::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:43,221::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:28:43,221::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:43,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:43,221::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-10102::INFO::2014-08-11 17:28:43,221::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:28:43,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:28:43,222::task::1191::Storage.TaskManager.Task::(prepare) Task=`af15e0ce-5c3c-43bc-8976-ad006b3e6c7d`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:28:43,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:28:43,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`af15e0ce-5c3c-43bc-8976-ad006b3e6c7d`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:28:43,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:28:43,223::__init__::225::IOProcess::(_processLogs) (541246) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:28:43,223::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:28:43,224::__init__::225::IOProcess::(_processLogs) (541246) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:28:43,224::task::993::Storage.TaskManager.Task::(_decref) Task=`af15e0ce-5c3c-43bc-8976-ad006b3e6c7d`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:28:43,224::__init__::225::IOProcess::(_processLogs) (541246) Building response >Thread-19::DEBUG::2014-08-11 17:28:43,225::__init__::225::IOProcess::(_processLogs) (541246) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:43,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:43,225::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:28:43,247::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:28:44,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:44,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136478 s, 75.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:44,990::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:44,990::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:44,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:45,079::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:45,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:45,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:46,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:47,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0234574 s, 43.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:48,068::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:28:48,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`acad7dc2-bbe0-416d-8da9-f604b30977a9`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:48,068::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:28:48,085::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:48,086::task::1191::Storage.TaskManager.Task::(prepare) Task=`acad7dc2-bbe0-416d-8da9-f604b30977a9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:48,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`acad7dc2-bbe0-416d-8da9-f604b30977a9`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:48,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:48,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:48,086::task::993::Storage.TaskManager.Task::(_decref) Task=`acad7dc2-bbe0-416d-8da9-f604b30977a9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:28:48,095::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:28:48,096::task::595::Storage.TaskManager.Task::(_updateState) Task=`58d136c6-9ffa-4c80-a1b8-3b3060ef6836`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:28:48,096::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:28:48,096::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f9a61cbf-b4fc-48e1-8d49-15049babd441`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:28:48,096::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:28:48,096::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:28:48,096::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f9a61cbf-b4fc-48e1-8d49-15049babd441`::Granted request >Thread-10197::DEBUG::2014-08-11 17:28:48,096::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`58d136c6-9ffa-4c80-a1b8-3b3060ef6836`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:28:48,097::task::993::Storage.TaskManager.Task::(_decref) Task=`58d136c6-9ffa-4c80-a1b8-3b3060ef6836`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:28:48,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:48,115::task::1191::Storage.TaskManager.Task::(prepare) Task=`58d136c6-9ffa-4c80-a1b8-3b3060ef6836`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56092524544', 'isoprefix': '', 'alerts': [], 'disktotal': '621064224768', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:48,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`58d136c6-9ffa-4c80-a1b8-3b3060ef6836`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:28:48,115::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:28:48,115::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:28:48,115::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:28:48,115::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:28:48,115::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:28:48,115::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:28:48,116::task::993::Storage.TaskManager.Task::(_decref) Task=`58d136c6-9ffa-4c80-a1b8-3b3060ef6836`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:28:48,451::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:48,452::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:48,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:48,452::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:48,453::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-27::DEBUG::2014-08-11 17:28:48,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:48,453::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:48,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:48,512::__init__::225::IOProcess::(_processLogs) (541247) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:48,514::__init__::225::IOProcess::(_processLogs) (541247) Got request for method 'statvfs' >Thread-27::DEBUG::2014-08-11 17:28:48,514::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000508659 s, 720 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:48,515::__init__::225::IOProcess::(_processLogs) (541247) Building response >Thread-19::DEBUG::2014-08-11 17:28:48,516::__init__::225::IOProcess::(_processLogs) (541247) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:48,517::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:48,517::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:48,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:48,519::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:48,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:48,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:48,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:48,521::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:48,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:48,523::__init__::225::IOProcess::(_processLogs) (541248) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:48,523::__init__::225::IOProcess::(_processLogs) (541248) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:48,524::__init__::225::IOProcess::(_processLogs) (541248) Building response >Thread-19::DEBUG::2014-08-11 17:28:48,524::__init__::225::IOProcess::(_processLogs) (541248) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:48,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:48,524::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:28:48,831::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:28:49,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:49,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0758111 s, 13.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:49,996::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:49,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:49,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:50,081::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:50,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:50,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:51,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:51,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014046 s, 72.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:52,092::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:52,092::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:52,092::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:52,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:52,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:52,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:52,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:52,093::__init__::225::IOProcess::(_processLogs) (541249) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:52,093::__init__::225::IOProcess::(_processLogs) (541249) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:52,093::__init__::225::IOProcess::(_processLogs) DEBUG|(541249) Building response >Thread-19::DEBUG::2014-08-11 17:28:52,093::__init__::225::IOProcess::(_processLogs) (541249) Queuing response >Thread-28::DEBUG::2014-08-11 17:28:52,094::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:28:52,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:52,152::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:28:52,155::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00118195 s, 419 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) (541250) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:52,156::__init__::225::IOProcess::(_processLogs) (541250) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:52,157::__init__::225::IOProcess::(_processLogs) (541250) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:52,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:52,157::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:28:52,157::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) (541251) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) (541251) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:52,158::__init__::225::IOProcess::(_processLogs) (541251) Building response >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) (541251) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:52,159::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) (541252) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) (541252) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) (541252) Building response >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) (541252) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:52,160::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:28:52,161::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:52,161::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:52,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:52,161::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:52,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:52,161::__init__::225::IOProcess::(_processLogs) (541253) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:28:52,162::__init__::225::IOProcess::(_processLogs) (541253) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:28:52,162::__init__::225::IOProcess::(_processLogs) (541253) Building response >Thread-19::DEBUG::2014-08-11 17:28:52,162::__init__::225::IOProcess::(_processLogs) (541253) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:52,162::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:52,162::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:28:53,247::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:28:53,310::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:28:53,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0575281 s, 17.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:28:54,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:55,000::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:28:55,000::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:55,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:55,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:28:55,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:28:55,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:55,446::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0151967 s, 67.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:28:57,454::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:57,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0649325 s, 15.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:28:57,734::task::595::Storage.TaskManager.Task::(_updateState) Task=`639f580c-4c05-4480-b87e-90d51fc25404`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:57,734::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:28:57,735::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508659', 'lastCheck': '9.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118195', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:57,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`639f580c-4c05-4480-b87e-90d51fc25404`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000508659', 'lastCheck': '9.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118195', 'lastCheck': '5.6', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:28:57,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`639f580c-4c05-4480-b87e-90d51fc25404`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:57,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:57,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:57,735::task::993::Storage.TaskManager.Task::(_decref) Task=`639f580c-4c05-4480-b87e-90d51fc25404`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:28:57,752::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:28:57,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:28:58,146::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:28:58,146::task::595::Storage.TaskManager.Task::(_updateState) Task=`659129d2-6a90-4633-9577-8c2268f37538`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:28:58,146::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:28:58,225::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:58,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`659129d2-6a90-4633-9577-8c2268f37538`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:28:58,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`659129d2-6a90-4633-9577-8c2268f37538`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:28:58,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:28:58,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:28:58,226::task::993::Storage.TaskManager.Task::(_decref) Task=`659129d2-6a90-4633-9577-8c2268f37538`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:28:58,232::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:28:58,232::task::595::Storage.TaskManager.Task::(_updateState) Task=`26af0920-6099-45d4-b563-ea52535c70f4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:28:58,232::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:28:58,233::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3c1f8753-7506-4c9b-8b48-2e169ec21b14`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:28:58,233::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:28:58,233::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:28:58,233::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3c1f8753-7506-4c9b-8b48-2e169ec21b14`::Granted request >Thread-10197::DEBUG::2014-08-11 17:28:58,233::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`26af0920-6099-45d4-b563-ea52535c70f4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:28:58,233::task::993::Storage.TaskManager.Task::(_decref) Task=`26af0920-6099-45d4-b563-ea52535c70f4`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:28:58,263::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:58,263::task::1191::Storage.TaskManager.Task::(prepare) Task=`26af0920-6099-45d4-b563-ea52535c70f4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:28:58,263::task::595::Storage.TaskManager.Task::(_updateState) Task=`26af0920-6099-45d4-b563-ea52535c70f4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:28:58,263::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:28:58,263::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:28:58,263::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:28:58,263::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:28:58,263::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:28:58,263::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:28:58,263::task::993::Storage.TaskManager.Task::(_decref) Task=`26af0920-6099-45d4-b563-ea52535c70f4`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:28:58,312::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:28:58,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:58,522::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:58,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) (541254) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) (541254) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) DEBUG|(541254) Building response >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) (541254) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:58,523::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:28:58,524::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:28:58,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000579334 s, 632 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:28:58,615::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:28:58,616::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:28:58,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:28:58,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:28:58,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:28:58,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:28:58,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:28:58,619::__init__::225::IOProcess::(_processLogs) (541255) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:28:58,619::__init__::225::IOProcess::(_processLogs) (541255) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:28:58,621::__init__::225::IOProcess::(_processLogs) DEBUG|(541255) Building response >Thread-19::DEBUG::2014-08-11 17:28:58,622::__init__::225::IOProcess::(_processLogs) (541255) Queuing response >Thread-19::DEBUG::2014-08-11 17:28:58,623::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:28:58,624::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:28:59,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:28:59,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0674568 s, 15.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:00,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:00,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:00,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:00,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:00,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:00,091::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:29:00,842::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:29:01,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:01,843::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0622051 s, 16.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:02,162::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:02,163::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:02,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:02,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:02,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:02,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:02,167::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:02,168::__init__::225::IOProcess::(_processLogs) (541256) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:02,169::__init__::225::IOProcess::(_processLogs) (541256) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:02,173::__init__::225::IOProcess::(_processLogs) DEBUG|(541256) Building response >Thread-19::DEBUG::2014-08-11 17:29:02,173::__init__::225::IOProcess::(_processLogs) (541256) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:02,174::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:29:02,175::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:02,175::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:29:02,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000408334 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:02,236::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:02,237::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:02,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:02,237::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:02,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:02,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:02,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:02,239::__init__::225::IOProcess::(_processLogs) (541257) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:02,240::__init__::225::IOProcess::(_processLogs) (541257) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:02,240::__init__::225::IOProcess::(_processLogs) DEBUG|(541257) Building response >Thread-19::DEBUG::2014-08-11 17:29:02,241::__init__::225::IOProcess::(_processLogs) (541257) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:02,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:02,242::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:29:02,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:02,243::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:29:02,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:02,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:02,245::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:02,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:02,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:02,246::__init__::225::IOProcess::(_processLogs) (541258) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:02,247::__init__::225::IOProcess::(_processLogs) (541258) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:02,247::__init__::225::IOProcess::(_processLogs) DEBUG|(541258) Building response >Thread-19::DEBUG::2014-08-11 17:29:02,248::__init__::225::IOProcess::(_processLogs) (541258) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:02,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:02,249::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:02,250::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:02,250::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:29:02,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:02,251::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:02,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:02,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:02,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:02,253::__init__::225::IOProcess::(_processLogs) (541259) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:02,253::__init__::225::IOProcess::(_processLogs) (541259) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:02,254::__init__::225::IOProcess::(_processLogs) DEBUG|(541259) Building response >Thread-19::DEBUG::2014-08-11 17:29:02,255::__init__::225::IOProcess::(_processLogs) (541259) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:02,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:02,256::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:02,256::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:02,257::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:29:02,257::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:02,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:02,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:02,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:02,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:02,260::__init__::225::IOProcess::(_processLogs) (541260) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:02,260::__init__::225::IOProcess::(_processLogs) (541260) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:02,261::__init__::225::IOProcess::(_processLogs) (541260) Building response >Thread-19::DEBUG::2014-08-11 17:29:02,261::__init__::225::IOProcess::(_processLogs) (541260) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:02,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:02,262::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:29:03,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:04,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424803 s, 24.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:05,012::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:05,012::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:05,013::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:05,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:05,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:05,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:06,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:06,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0735546 s, 13.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:29:08,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:29:08,292::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:29:08,293::task::595::Storage.TaskManager.Task::(_updateState) Task=`41eed958-fa23-46a7-825f-a2ff51875da8`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:08,293::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:29:08,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0741874 s, 13.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:29:08,317::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::INFO::2014-08-11 17:29:08,324::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:08,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`41eed958-fa23-46a7-825f-a2ff51875da8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:08,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`41eed958-fa23-46a7-825f-a2ff51875da8`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:08,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:08,324::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:08,324::task::993::Storage.TaskManager.Task::(_decref) Task=`41eed958-fa23-46a7-825f-a2ff51875da8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:29:08,332::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:29:08,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd2ad696-e77a-4c51-bce7-3b1f2e2068cd`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:29:08,332::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:29:08,332::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5ee6268d-699a-41f1-9c6d-f7420f5a0709`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:29:08,333::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:29:08,333::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:29:08,333::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5ee6268d-699a-41f1-9c6d-f7420f5a0709`::Granted request >Thread-10197::DEBUG::2014-08-11 17:29:08,333::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cd2ad696-e77a-4c51-bce7-3b1f2e2068cd`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:29:08,333::task::993::Storage.TaskManager.Task::(_decref) Task=`cd2ad696-e77a-4c51-bce7-3b1f2e2068cd`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:29:08,352::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:08,352::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd2ad696-e77a-4c51-bce7-3b1f2e2068cd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:08,352::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd2ad696-e77a-4c51-bce7-3b1f2e2068cd`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:29:08,352::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:29:08,352::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:29:08,352::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:29:08,352::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:29:08,352::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:29:08,352::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:29:08,352::task::993::Storage.TaskManager.Task::(_decref) Task=`cd2ad696-e77a-4c51-bce7-3b1f2e2068cd`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:08,623::__init__::225::IOProcess::(_processLogs) (541261) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:08,624::__init__::225::IOProcess::(_processLogs) (541261) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:08,624::__init__::225::IOProcess::(_processLogs) DEBUG|(541261) Building response >Thread-19::DEBUG::2014-08-11 17:29:08,624::__init__::225::IOProcess::(_processLogs) (541261) Queuing response >Thread-27::DEBUG::2014-08-11 17:29:08,624::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:08,625::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:08,684::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:29:08,687::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00157416 s, 233 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:08,688::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:08,690::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:08,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:08,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:08,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:08,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:08,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:08,701::__init__::225::IOProcess::(_processLogs) (541262) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:08,702::__init__::225::IOProcess::(_processLogs) (541262) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:08,703::__init__::225::IOProcess::(_processLogs) DEBUG|(541262) Building response >Thread-19::DEBUG::2014-08-11 17:29:08,704::__init__::225::IOProcess::(_processLogs) (541262) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:08,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:08,704::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:10,019::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:10,019::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:10,019::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:10,102::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:10,102::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:10,102::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:10,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:10,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129515 s, 79.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) (541263) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:12,264::__init__::225::IOProcess::(_processLogs) (541263) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:12,267::__init__::225::IOProcess::(_processLogs) DEBUG|(541263) Building response >Thread-19::DEBUG::2014-08-11 17:29:12,267::__init__::225::IOProcess::(_processLogs) (541263) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:12,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:12,267::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:29:12,268::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:29:12,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000401456 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:12,327::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:12,327::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) (541264) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:12,328::__init__::225::IOProcess::(_processLogs) (541264) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:12,329::__init__::225::IOProcess::(_processLogs) DEBUG|(541264) Building response >Thread-19::DEBUG::2014-08-11 17:29:12,329::__init__::225::IOProcess::(_processLogs) (541264) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:12,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:12,329::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:29:12,329::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) (541265) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:12,330::__init__::225::IOProcess::(_processLogs) (541265) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) (541265) Building response >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) (541265) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:12,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) (541266) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) (541266) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) (541266) Building response >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) (541266) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:12,332::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) (541267) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) (541267) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) (541267) Building response >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) (541267) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:12,333::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:29:12,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:12,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500964 s, 20.4 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:29:13,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`48e9b648-4152-4bc3-a5d4-6e5356f55a5b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:13,013::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:29:13,013::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157416', 'lastCheck': '4.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401456', 'lastCheck': '0.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:13,013::task::1191::Storage.TaskManager.Task::(prepare) Task=`48e9b648-4152-4bc3-a5d4-6e5356f55a5b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157416', 'lastCheck': '4.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401456', 'lastCheck': '0.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:13,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`48e9b648-4152-4bc3-a5d4-6e5356f55a5b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:13,014::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:13,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:13,014::task::993::Storage.TaskManager.Task::(_decref) Task=`48e9b648-4152-4bc3-a5d4-6e5356f55a5b`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:29:13,030::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:29:13,031::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10102::DEBUG::2014-08-11 17:29:13,320::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:29:14,541::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:14,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0666264 s, 15.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:15,025::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:15,026::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:15,026::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:15,108::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:15,108::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:15,109::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:16,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:16,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0789417 s, 13.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:29:18,391::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:29:18,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f3f3f61-85ff-4122-aa71-7cc4e023c9f6`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:18,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:29:18,405::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:18,406::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f3f3f61-85ff-4122-aa71-7cc4e023c9f6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:18,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f3f3f61-85ff-4122-aa71-7cc4e023c9f6`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:18,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:18,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:18,406::task::993::Storage.TaskManager.Task::(_decref) Task=`9f3f3f61-85ff-4122-aa71-7cc4e023c9f6`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:29:18,416::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:29:18,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`6aca65e2-cd58-4287-ab55-bbf1c8daebcd`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:29:18,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:29:18,417::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`33e9bae9-f11b-46d0-aaef-d312fb3b42fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:29:18,417::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:29:18,417::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:29:18,417::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`33e9bae9-f11b-46d0-aaef-d312fb3b42fa`::Granted request >Thread-10197::DEBUG::2014-08-11 17:29:18,417::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6aca65e2-cd58-4287-ab55-bbf1c8daebcd`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:29:18,417::task::993::Storage.TaskManager.Task::(_decref) Task=`6aca65e2-cd58-4287-ab55-bbf1c8daebcd`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:29:18,435::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:18,436::task::1191::Storage.TaskManager.Task::(prepare) Task=`6aca65e2-cd58-4287-ab55-bbf1c8daebcd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56053727232', 'isoprefix': '', 'alerts': [], 'disktotal': '621025427456', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:18,436::task::595::Storage.TaskManager.Task::(_updateState) Task=`6aca65e2-cd58-4287-ab55-bbf1c8daebcd`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:29:18,436::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:29:18,436::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:29:18,436::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:29:18,436::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:29:18,436::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:29:18,436::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:29:18,436::task::993::Storage.TaskManager.Task::(_decref) Task=`6aca65e2-cd58-4287-ab55-bbf1c8daebcd`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:18,704::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:18,705::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:18,705::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:18,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:18,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:18,705::__init__::225::IOProcess::(_processLogs) (541268) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:18,705::__init__::225::IOProcess::(_processLogs) (541268) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:18,706::__init__::225::IOProcess::(_processLogs) (541268) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:18,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:29:18,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:29:18,768::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000820566 s, 446 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:18,771::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:18,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:18,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:18,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:18,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:18,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:18,776::__init__::225::IOProcess::(_processLogs) (541269) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:18,776::__init__::225::IOProcess::(_processLogs) (541269) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:18,777::__init__::225::IOProcess::(_processLogs) (541269) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:18,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:18,779::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:29:18,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:29:18,878::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:29:18,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241259 s, 42.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:20,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:20,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:20,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:20,109::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:20,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:20,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:20,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:21,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0972673 s, 10.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:22,334::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:22,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:22,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:22,335::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:22,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:22,335::__init__::225::IOProcess::(_processLogs) (541270) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:22,335::__init__::225::IOProcess::(_processLogs) (541270) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:22,335::__init__::225::IOProcess::(_processLogs) (541270) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:22,335::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:29:22,336::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:22,336::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:29:22,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00092228 s, 537 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:22,397::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:22,397::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:22,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:22,397::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:22,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:22,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:22,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:22,398::__init__::225::IOProcess::(_processLogs) (541271) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:22,398::__init__::225::IOProcess::(_processLogs) (541271) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:22,398::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(541271) Building response >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) (541271) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:22,399::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) (541272) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) (541272) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) (541272) Building response >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) (541272) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:22,400::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) (541273) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) (541273) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:22,401::__init__::225::IOProcess::(_processLogs) (541273) Building response >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) (541273) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:22,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) (541274) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) (541274) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) (541274) Building response >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) (541274) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:22,403::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:29:23,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:23,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.037936 s, 27.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:29:23,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d21825e-a40e-4d0f-b313-e3a2787ffb6a`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:29:23,320::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:29:23,320::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:23,320::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:29:23,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:23,321::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:23,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:23,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:23,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:23,321::__init__::225::IOProcess::(_processLogs) (541275) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:29:23,321::__init__::225::IOProcess::(_processLogs) (541275) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:29:23,323::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|(541275) Building response >Thread-19::DEBUG::2014-08-11 17:29:23,324::__init__::225::IOProcess::(_processLogs) (541275) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:23,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:23,324::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:29:23,324::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:23,324::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:29:23,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:23,325::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:23,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:23,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:29:23,325::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:29:23,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:29:23,326::task::1191::Storage.TaskManager.Task::(prepare) Task=`7d21825e-a40e-4d0f-b313-e3a2787ffb6a`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:29:23,326::__init__::225::IOProcess::(_processLogs) (541276) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:29:23,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`7d21825e-a40e-4d0f-b313-e3a2787ffb6a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:29:23,327::__init__::225::IOProcess::(_processLogs) (541276) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:29:23,327::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:29:23,327::__init__::225::IOProcess::(_processLogs) (541276) Building response >Thread-10017::DEBUG::2014-08-11 17:29:23,327::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:29:23,328::__init__::225::IOProcess::(_processLogs) (541276) Queuing response >Thread-10017::DEBUG::2014-08-11 17:29:23,328::task::993::Storage.TaskManager.Task::(_decref) Task=`7d21825e-a40e-4d0f-b313-e3a2787ffb6a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:23,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:23,328::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:29:23,348::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:29:25,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:25,036::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:25,037::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:25,115::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:25,116::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:25,116::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:25,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:25,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137964 s, 74.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:29:27,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:27,352::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120475 s, 85.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:29:28,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f4b3d2c-6f40-4875-9884-f0e5b8a0a6c3`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:28,282::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:29:28,283::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820566', 'lastCheck': '9.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00092228', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:28,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f4b3d2c-6f40-4875-9884-f0e5b8a0a6c3`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000820566', 'lastCheck': '9.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00092228', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:28,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f4b3d2c-6f40-4875-9884-f0e5b8a0a6c3`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:28,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:28,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:28,284::task::993::Storage.TaskManager.Task::(_decref) Task=`4f4b3d2c-6f40-4875-9884-f0e5b8a0a6c3`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:29:28,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:29:28,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10102::DEBUG::2014-08-11 17:29:28,345::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:29:28,489::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:29:28,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4725dad-4aaa-483e-9de3-22f1c35027eb`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:28,489::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:29:28,506::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:28,506::task::1191::Storage.TaskManager.Task::(prepare) Task=`c4725dad-4aaa-483e-9de3-22f1c35027eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:28,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`c4725dad-4aaa-483e-9de3-22f1c35027eb`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:28,506::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:28,506::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:28,506::task::993::Storage.TaskManager.Task::(_decref) Task=`c4725dad-4aaa-483e-9de3-22f1c35027eb`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:29:28,517::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:29:28,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`539958cf-feb0-4d60-947d-d2c3b312bbb5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:29:28,518::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:29:28,518::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4d095ccd-a25c-46f0-bcc1-91b54c64e660`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:29:28,518::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:29:28,518::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:29:28,518::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4d095ccd-a25c-46f0-bcc1-91b54c64e660`::Granted request >Thread-10197::DEBUG::2014-08-11 17:29:28,519::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`539958cf-feb0-4d60-947d-d2c3b312bbb5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:29:28,519::task::993::Storage.TaskManager.Task::(_decref) Task=`539958cf-feb0-4d60-947d-d2c3b312bbb5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:29:28,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:28,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`539958cf-feb0-4d60-947d-d2c3b312bbb5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:28,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`539958cf-feb0-4d60-947d-d2c3b312bbb5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:29:28,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:29:28,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:29:28,537::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:29:28,538::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:29:28,538::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:29:28,538::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:29:28,538::task::993::Storage.TaskManager.Task::(_decref) Task=`539958cf-feb0-4d60-947d-d2c3b312bbb5`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) (541277) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:28,779::__init__::225::IOProcess::(_processLogs) (541277) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:28,782::__init__::225::IOProcess::(_processLogs) (541277) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:28,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:29:28,782::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:29:28,841::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000321552 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:28,843::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:28,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:28,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:28,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:28,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:28,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:28,846::__init__::225::IOProcess::(_processLogs) (541278) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:28,846::__init__::225::IOProcess::(_processLogs) (541278) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:28,847::__init__::225::IOProcess::(_processLogs) (541278) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:28,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:28,849::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:29:29,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:29,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0346202 s, 29.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:30,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:30,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:30,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:30,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:30,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:30,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:29:30,891::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:29:31,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:31,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0186701 s, 54.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:32,404::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:32,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:32,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:32,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:32,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:32,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-28::DEBUG::2014-08-11 17:29:32,407::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:32,407::__init__::225::IOProcess::(_processLogs) (541279) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:32,466::__init__::225::IOProcess::(_processLogs) (541279) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:32,467::__init__::225::IOProcess::(_processLogs) (541279) Building response >Thread-19::DEBUG::2014-08-11 17:29:32,467::__init__::225::IOProcess::(_processLogs) (541279) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:32,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:32,468::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:29:32,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0333861 s, 14.8 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:32,503::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:32,503::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:32,504::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:32,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:32,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:32,506::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:32,507::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:32,507::__init__::225::IOProcess::(_processLogs) (541280) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:32,508::__init__::225::IOProcess::(_processLogs) (541280) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:32,508::__init__::225::IOProcess::(_processLogs) (541280) Building response >Thread-19::DEBUG::2014-08-11 17:29:32,508::__init__::225::IOProcess::(_processLogs) (541280) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:32,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:32,509::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:29:32,510::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:32,511::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:29:32,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:32,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:32,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:32,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:32,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:32,513::__init__::225::IOProcess::(_processLogs) (541281) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:32,514::__init__::225::IOProcess::(_processLogs) (541281) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:32,514::__init__::225::IOProcess::(_processLogs) (541281) Building response >Thread-19::DEBUG::2014-08-11 17:29:32,515::__init__::225::IOProcess::(_processLogs) (541281) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:32,515::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:29:32,516::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:32,517::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:32,517::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:29:32,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:32,518::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:32,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:32,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:32,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:32,520::__init__::225::IOProcess::(_processLogs) (541282) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:32,521::__init__::225::IOProcess::(_processLogs) (541282) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:32,521::__init__::225::IOProcess::(_processLogs) (541282) Building response >Thread-19::DEBUG::2014-08-11 17:29:32,522::__init__::225::IOProcess::(_processLogs) (541282) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:32,522::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:32,523::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:32,523::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:32,524::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:29:32,524::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:32,525::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:32,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:32,526::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:32,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:32,526::__init__::225::IOProcess::(_processLogs) (541283) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:32,527::__init__::225::IOProcess::(_processLogs) (541283) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:32,528::__init__::225::IOProcess::(_processLogs) (541283) Building response >Thread-19::DEBUG::2014-08-11 17:29:32,529::__init__::225::IOProcess::(_processLogs) (541283) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:32,529::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:32,529::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:29:33,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:33,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132224 s, 77.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:35,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:35,046::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:35,046::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:35,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:35,128::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:35,128::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:35,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:35,715::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128064 s, 80.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:29:37,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:37,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013931 s, 73.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:29:38,355::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:29:38,567::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:29:38,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`8155eeac-d35c-40af-a963-db50f06a781d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:38,568::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:29:38,581::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:38,581::task::1191::Storage.TaskManager.Task::(prepare) Task=`8155eeac-d35c-40af-a963-db50f06a781d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:38,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`8155eeac-d35c-40af-a963-db50f06a781d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:38,581::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:38,581::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:38,581::task::993::Storage.TaskManager.Task::(_decref) Task=`8155eeac-d35c-40af-a963-db50f06a781d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:29:38,590::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:29:38,590::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f107b7d-1c6d-47eb-8995-d73c875ffa8a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:29:38,590::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:29:38,591::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`19fbc99e-c532-415f-b180-10eff5e9d7f2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:29:38,591::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:29:38,591::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:29:38,591::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`19fbc99e-c532-415f-b180-10eff5e9d7f2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:29:38,591::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3f107b7d-1c6d-47eb-8995-d73c875ffa8a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:29:38,591::task::993::Storage.TaskManager.Task::(_decref) Task=`3f107b7d-1c6d-47eb-8995-d73c875ffa8a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:29:38,607::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:38,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f107b7d-1c6d-47eb-8995-d73c875ffa8a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:38,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f107b7d-1c6d-47eb-8995-d73c875ffa8a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:29:38,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:29:38,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:29:38,608::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:29:38,608::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:29:38,608::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:29:38,608::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:29:38,608::task::993::Storage.TaskManager.Task::(_decref) Task=`3f107b7d-1c6d-47eb-8995-d73c875ffa8a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:38,848::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:38,848::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) (541284) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:38,849::__init__::225::IOProcess::(_processLogs) (541284) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:38,852::__init__::225::IOProcess::(_processLogs) DEBUG|(541284) Building response >Thread-19::DEBUG::2014-08-11 17:29:38,852::__init__::225::IOProcess::(_processLogs) (541284) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:38,852::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:29:38,853::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:38,853::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:29:38,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00231779 s, 158 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) (541285) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:38,919::__init__::225::IOProcess::(_processLogs) (541285) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:38,920::__init__::225::IOProcess::(_processLogs) DEBUG|(541285) Building response >Thread-19::DEBUG::2014-08-11 17:29:38,920::__init__::225::IOProcess::(_processLogs) (541285) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:38,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:38,921::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:29:39,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:39,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0649846 s, 15.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:40,052::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:40,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:40,053::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:40,131::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:40,131::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:40,131::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:41,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:42,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0671381 s, 15.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:42,528::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) (541286) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:42,529::__init__::225::IOProcess::(_processLogs) (541286) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:42,586::__init__::225::IOProcess::(_processLogs) DEBUG|(541286) Building response >Thread-19::DEBUG::2014-08-11 17:29:42,586::__init__::225::IOProcess::(_processLogs) (541286) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:42,586::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:29:42,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:42,587::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:29:42,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00132037 s, 375 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:42,648::__init__::225::IOProcess::(_processLogs) (541287) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:42,649::__init__::225::IOProcess::(_processLogs) (541287) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:42,649::__init__::225::IOProcess::(_processLogs) DEBUG|(541287) Building response >Thread-19::DEBUG::2014-08-11 17:29:42,649::__init__::225::IOProcess::(_processLogs) (541287) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:42,649::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:42,649::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:29:42,650::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:42,650::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:29:42,650::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:42,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:42,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) (541288) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) (541288) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) (541288) Building response >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) (541288) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:42,651::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:42,652::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:29:42,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:42,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:42,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:42,652::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:42,653::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) (541289) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) (541289) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) (541289) Building response >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) (541289) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:42,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:42,655::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:42,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:42,655::__init__::225::IOProcess::(_processLogs) (541290) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:42,655::__init__::225::IOProcess::(_processLogs) (541290) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:42,655::__init__::225::IOProcess::(_processLogs) DEBUG|(541290) Building response >Thread-19::DEBUG::2014-08-11 17:29:42,656::__init__::225::IOProcess::(_processLogs) (541290) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:42,656::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:29:42,656::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:29:43,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`e42d302d-c6ee-4c8b-8a7a-da75a585ad1e`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:29:43,348::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:43,348::__init__::225::IOProcess::(_processLogs) (541291) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:29:43,349::__init__::225::IOProcess::(_processLogs) (541291) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:29:43,378::__init__::225::IOProcess::(_processLogs) Message size is 260DEBUG|(541291) Building response >Thread-19::DEBUG::2014-08-11 17:29:43,378::__init__::225::IOProcess::(_processLogs) (541291) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:43,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:43,378::__init__::225::IOProcess::(_processLogs) Message size is 260DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:29:43,378::__init__::225::IOProcess::(_processLogs) Message size is 260DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:29:43,379::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:29:43,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:43,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:43,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:29:43,379::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:29:43,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:29:43,380::task::1191::Storage.TaskManager.Task::(prepare) Task=`e42d302d-c6ee-4c8b-8a7a-da75a585ad1e`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:29:43,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:29:43,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`e42d302d-c6ee-4c8b-8a7a-da75a585ad1e`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:29:43,381::__init__::225::IOProcess::(_processLogs) (541292) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:29:43,381::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:29:43,381::__init__::225::IOProcess::(_processLogs) (541292) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:29:43,381::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:29:43,382::__init__::225::IOProcess::(_processLogs) (541292) Building response >Thread-10102::DEBUG::2014-08-11 17:29:43,382::task::993::Storage.TaskManager.Task::(_decref) Task=`e42d302d-c6ee-4c8b-8a7a-da75a585ad1e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:43,382::__init__::225::IOProcess::(_processLogs) (541292) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:43,382::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:43,383::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:29:43,404::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:29:43,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a6823cd-c932-4e26-abaf-8ca28ccc4f39`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:43,442::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:29:43,443::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00231779', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132037', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:43,443::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a6823cd-c932-4e26-abaf-8ca28ccc4f39`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00231779', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132037', 'lastCheck': '0.8', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:43,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a6823cd-c932-4e26-abaf-8ca28ccc4f39`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:43,443::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:43,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:43,443::task::993::Storage.TaskManager.Task::(_decref) Task=`1a6823cd-c932-4e26-abaf-8ca28ccc4f39`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:29:43,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:29:43,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:44,091::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:44,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0639648 s, 16.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:45,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:45,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:45,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:45,136::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:45,137::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:45,137::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:46,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:46,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144652 s, 70.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:29:48,303::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:48,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137817 s, 74.3 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:29:48,671::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:29:48,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ba9d38b-8b69-4b29-a0eb-25c06abbea09`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:48,672::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:29:48,703::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:48,703::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ba9d38b-8b69-4b29-a0eb-25c06abbea09`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:48,703::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ba9d38b-8b69-4b29-a0eb-25c06abbea09`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:48,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:48,704::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:48,704::task::993::Storage.TaskManager.Task::(_decref) Task=`4ba9d38b-8b69-4b29-a0eb-25c06abbea09`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:29:48,710::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:29:48,710::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc481a9a-1ed8-4ef2-bead-cd6684c7d2be`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:29:48,711::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:29:48,711::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9694a766-04d8-43fb-80b0-acb0ecd14ee2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:29:48,711::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:29:48,711::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:29:48,711::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9694a766-04d8-43fb-80b0-acb0ecd14ee2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:29:48,712::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cc481a9a-1ed8-4ef2-bead-cd6684c7d2be`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:29:48,712::task::993::Storage.TaskManager.Task::(_decref) Task=`cc481a9a-1ed8-4ef2-bead-cd6684c7d2be`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:29:48,728::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:48,728::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc481a9a-1ed8-4ef2-bead-cd6684c7d2be`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56015978496', 'isoprefix': '', 'alerts': [], 'disktotal': '620987678720', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:48,728::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc481a9a-1ed8-4ef2-bead-cd6684c7d2be`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:29:48,728::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:29:48,728::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:29:48,728::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:29:48,728::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:29:48,728::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:29:48,728::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:29:48,728::task::993::Storage.TaskManager.Task::(_decref) Task=`cc481a9a-1ed8-4ef2-bead-cd6684c7d2be`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) (541293) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:48,921::__init__::225::IOProcess::(_processLogs) (541293) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:48,922::__init__::225::IOProcess::(_processLogs) (541293) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:48,922::__init__::225::IOProcess::(_processLogs) Generating json... >VM Channels Listener::DEBUG::2014-08-11 17:29:48,923::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-27::DEBUG::2014-08-11 17:29:48,923::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:29:48,985::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00271371 s, 135 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) (541294) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:48,986::__init__::225::IOProcess::(_processLogs) (541294) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:48,987::__init__::225::IOProcess::(_processLogs) (541294) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:48,987::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-vm::DEBUG::2014-08-11 17:29:50,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:50,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:50,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:50,143::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:50,143::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:50,144::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:50,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:50,507::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0638025 s, 16.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:29:52,515::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:52,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0645881 s, 15.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:52,657::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) (541295) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) (541295) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:52,658::__init__::225::IOProcess::(_processLogs) (541295) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:52,659::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:29:52,659::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:29:52,720::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00187846 s, 264 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) (541296) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:52,721::__init__::225::IOProcess::(_processLogs) (541296) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:52,722::__init__::225::IOProcess::(_processLogs) (541296) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:52,722::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:29:52,722::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) (541297) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) (541297) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) (541297) Building response >Thread-19::DEBUG::2014-08-11 17:29:52,723::__init__::225::IOProcess::(_processLogs) (541297) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:52,724::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) (541298) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) (541298) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) (541298) Building response >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) (541298) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:52,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:52,726::__init__::225::IOProcess::(_processLogs) (541299) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:29:52,726::__init__::225::IOProcess::(_processLogs) (541299) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:29:52,726::__init__::225::IOProcess::(_processLogs) (541299) Building response >Thread-19::DEBUG::2014-08-11 17:29:52,726::__init__::225::IOProcess::(_processLogs) (541299) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:52,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:52,726::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:29:53,362::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:29:54,660::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:54,731::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130013 s, 78.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:29:55,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:55,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:29:55,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:55,149::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:55,150::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:29:55,150::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:29:56,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:56,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0700929 s, 14.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:29:58,411::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:29:58,595::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8ff4ad4-22b3-4790-89ae-01f4782a961d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:58,595::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:29:58,595::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00271371', 'lastCheck': '9.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00187846', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:58,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`f8ff4ad4-22b3-4790-89ae-01f4782a961d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00271371', 'lastCheck': '9.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00187846', 'lastCheck': '5.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:29:58,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`f8ff4ad4-22b3-4790-89ae-01f4782a961d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:58,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:58,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:58,596::task::993::Storage.TaskManager.Task::(_decref) Task=`f8ff4ad4-22b3-4790-89ae-01f4782a961d`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:29:58,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:29:58,615::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:29:58,762::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:29:58,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`687b3e8e-270e-40e1-9979-3e7a8773905f`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:29:58,762::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:29:58,777::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:58,777::task::1191::Storage.TaskManager.Task::(prepare) Task=`687b3e8e-270e-40e1-9979-3e7a8773905f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:29:58,777::task::595::Storage.TaskManager.Task::(_updateState) Task=`687b3e8e-270e-40e1-9979-3e7a8773905f`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:29:58,777::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:29:58,777::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:29:58,778::task::993::Storage.TaskManager.Task::(_decref) Task=`687b3e8e-270e-40e1-9979-3e7a8773905f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:29:58,787::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:29:58,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`aacd46e2-9ec7-4a97-8af7-27d96ec646d9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:29:58,787::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:29:58,788::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d8775d76-b397-4bf2-82b0-db8c7529eab9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:29:58,788::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:29:58,788::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:29:58,788::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d8775d76-b397-4bf2-82b0-db8c7529eab9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:29:58,788::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aacd46e2-9ec7-4a97-8af7-27d96ec646d9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:29:58,788::task::993::Storage.TaskManager.Task::(_decref) Task=`aacd46e2-9ec7-4a97-8af7-27d96ec646d9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:29:58,805::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:58,805::task::1191::Storage.TaskManager.Task::(prepare) Task=`aacd46e2-9ec7-4a97-8af7-27d96ec646d9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:29:58,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`aacd46e2-9ec7-4a97-8af7-27d96ec646d9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:29:58,805::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:29:58,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:29:58,806::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:29:58,806::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:29:58,806::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:29:58,806::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:29:58,806::task::993::Storage.TaskManager.Task::(_decref) Task=`aacd46e2-9ec7-4a97-8af7-27d96ec646d9`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:29:58,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:29:58,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136371 s, 75.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) (541300) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:58,988::__init__::225::IOProcess::(_processLogs) (541300) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:58,989::__init__::225::IOProcess::(_processLogs) (541300) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:58,989::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:29:58,989::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:29:58,990::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:29:59,050::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000842985 s, 434 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:29:59,051::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:29:59,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:29:59,053::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:29:59,053::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:29:59,053::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:29:59,054::__init__::225::IOProcess::(_processLogs) (541301) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:29:59,055::__init__::225::IOProcess::(_processLogs) (541301) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:29:59,056::__init__::225::IOProcess::(_processLogs) (541301) Building response >Thread-19::DEBUG::2014-08-11 17:29:59,056::__init__::225::IOProcess::(_processLogs) (541301) Queuing response >Thread-19::DEBUG::2014-08-11 17:29:59,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:29:59,057::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:00,070::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:00,071::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:00,071::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:00,155::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:00,156::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:00,156::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:30:00,935::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:30:00,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:01,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0610188 s, 16.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) (541302) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:02,727::__init__::225::IOProcess::(_processLogs) (541302) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:02,728::__init__::225::IOProcess::(_processLogs) (541302) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:02,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:30:02,729::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:30:02,788::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000401084 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:02,788::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:02,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:02,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:02,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:02,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:02,789::__init__::225::IOProcess::(_processLogs) (541303) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:02,789::__init__::225::IOProcess::(_processLogs) (541303) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:02,789::__init__::225::IOProcess::(_processLogs) (541303) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:02,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) (541304) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) (541304) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) (541304) Building response >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) (541304) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:30:02,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) (541305) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) (541305) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) (541305) Building response >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) (541305) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:02,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:02,793::__init__::225::IOProcess::(_processLogs) (541306) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:02,794::__init__::225::IOProcess::(_processLogs) (541306) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:02,794::__init__::225::IOProcess::(_processLogs) (541306) Building response >Thread-19::DEBUG::2014-08-11 17:30:02,794::__init__::225::IOProcess::(_processLogs) (541306) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:02,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:02,794::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:30:03,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:03,156::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0145432 s, 70.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:05,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:05,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:05,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:05,161::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:05,162::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:05,162::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:05,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:05,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0146579 s, 69.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:30:07,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:07,364::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511938 s, 20.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:30:08,370::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:30:08,832::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:30:08,832::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7ba3a01-bcea-480f-ad1d-973ca2229a92`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:08,832::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:30:08,847::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:08,847::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7ba3a01-bcea-480f-ad1d-973ca2229a92`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:08,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7ba3a01-bcea-480f-ad1d-973ca2229a92`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:08,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:08,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:08,848::task::993::Storage.TaskManager.Task::(_decref) Task=`c7ba3a01-bcea-480f-ad1d-973ca2229a92`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:30:08,856::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:30:08,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`93539222-2b70-41f4-9378-668f5eddb034`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:30:08,856::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:30:08,857::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`983a3ea1-ba7a-4d22-a1c8-c2ba1a328cf3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:30:08,857::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:30:08,857::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:30:08,857::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`983a3ea1-ba7a-4d22-a1c8-c2ba1a328cf3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:30:08,857::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`93539222-2b70-41f4-9378-668f5eddb034`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:30:08,857::task::993::Storage.TaskManager.Task::(_decref) Task=`93539222-2b70-41f4-9378-668f5eddb034`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:30:08,876::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:08,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`93539222-2b70-41f4-9378-668f5eddb034`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:08,876::task::595::Storage.TaskManager.Task::(_updateState) Task=`93539222-2b70-41f4-9378-668f5eddb034`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:30:08,876::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:30:08,876::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:30:08,876::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:30:08,877::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:30:08,877::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:30:08,877::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:30:08,877::task::993::Storage.TaskManager.Task::(_decref) Task=`93539222-2b70-41f4-9378-668f5eddb034`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) (541307) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) (541307) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:09,056::__init__::225::IOProcess::(_processLogs) (541307) Queuing response >Thread-27::DEBUG::2014-08-11 17:30:09,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:30:09,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:09,116::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:30:09,118::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00153364 s, 239 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:09,120::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:09,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:09,121::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:09,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:09,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:09,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:09,123::__init__::225::IOProcess::(_processLogs) (541308) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:09,123::__init__::225::IOProcess::(_processLogs) (541308) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:09,124::__init__::225::IOProcess::(_processLogs) (541308) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:09,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:09,126::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:30:09,372::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:09,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0799754 s, 12.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:10,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:10,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:10,081::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:10,167::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:10,168::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:10,168::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:11,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:11,591::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132619 s, 77.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:12,794::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:12,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:12,794::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:12,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:12,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:12,795::__init__::225::IOProcess::(_processLogs) (541309) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:12,795::__init__::225::IOProcess::(_processLogs) (541309) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:12,795::__init__::225::IOProcess::(_processLogs) (541309) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:12,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:30:12,796::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:30:12,796::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:30:12,861::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00289021 s, 171 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) (541310) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:12,862::__init__::225::IOProcess::(_processLogs) (541310) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:12,863::__init__::225::IOProcess::(_processLogs) (541310) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:12,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:12,863::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:30:12,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:12,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:12,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) (541311) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) (541311) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) (541311) Building response >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) (541311) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:12,864::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) (541312) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) (541312) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) (541312) Building response >Thread-19::DEBUG::2014-08-11 17:30:12,865::__init__::225::IOProcess::(_processLogs) (541312) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:12,866::__init__::225::IOProcess::(_processLogs) (541313) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:12,867::__init__::225::IOProcess::(_processLogs) (541313) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:12,867::__init__::225::IOProcess::(_processLogs) (541313) Building response >Thread-19::DEBUG::2014-08-11 17:30:12,867::__init__::225::IOProcess::(_processLogs) (541313) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:12,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:12,867::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:30:13,436::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:30:13,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:13,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547306 s, 18.7 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:30:13,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f80ac1-b5c4-4e95-a342-c5d9dcd00bba`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:13,782::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:30:13,782::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00153364', 'lastCheck': '4.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00289021', 'lastCheck': '0.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:13,782::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0f80ac1-b5c4-4e95-a342-c5d9dcd00bba`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00153364', 'lastCheck': '4.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00289021', 'lastCheck': '0.9', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:13,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0f80ac1-b5c4-4e95-a342-c5d9dcd00bba`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:13,783::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:13,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:13,783::task::993::Storage.TaskManager.Task::(_decref) Task=`c0f80ac1-b5c4-4e95-a342-c5d9dcd00bba`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:30:13,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:30:13,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:15,086::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:15,086::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:15,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:15,173::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:15,174::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:15,174::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:15,719::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:15,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285594 s, 35.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:30:17,816::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:17,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245608 s, 41.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:30:18,954::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10205::DEBUG::2014-08-11 17:30:18,987::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:30:18,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`7caf0dd7-5e5e-4ce5-a474-d2ec39866001`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:18,987::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:30:19,015::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:19,016::task::1191::Storage.TaskManager.Task::(prepare) Task=`7caf0dd7-5e5e-4ce5-a474-d2ec39866001`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:19,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`7caf0dd7-5e5e-4ce5-a474-d2ec39866001`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:19,016::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:19,016::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:19,016::task::993::Storage.TaskManager.Task::(_decref) Task=`7caf0dd7-5e5e-4ce5-a474-d2ec39866001`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:30:19,028::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:30:19,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa44370b-c6f5-4aa8-850a-415d52831cd5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:30:19,028::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:30:19,028::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ee5240c7-0b14-4f28-8f1d-ecaa4dc7c14c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:30:19,028::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:30:19,028::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:30:19,028::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ee5240c7-0b14-4f28-8f1d-ecaa4dc7c14c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:30:19,029::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fa44370b-c6f5-4aa8-850a-415d52831cd5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:30:19,029::task::993::Storage.TaskManager.Task::(_decref) Task=`fa44370b-c6f5-4aa8-850a-415d52831cd5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:30:19,046::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:19,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa44370b-c6f5-4aa8-850a-415d52831cd5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56005492736', 'isoprefix': '', 'alerts': [], 'disktotal': '620977192960', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:19,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa44370b-c6f5-4aa8-850a-415d52831cd5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:30:19,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:30:19,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:30:19,046::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:30:19,046::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:30:19,046::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:30:19,046::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:30:19,046::task::993::Storage.TaskManager.Task::(_decref) Task=`fa44370b-c6f5-4aa8-850a-415d52831cd5`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) (541314) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:19,126::__init__::225::IOProcess::(_processLogs) (541314) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:19,127::__init__::225::IOProcess::(_processLogs) (541314) Queuing response >Thread-27::DEBUG::2014-08-11 17:30:19,127::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:30:19,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:19,186::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:30:19,187::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000364183 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:19,189::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:19,190::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:19,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:19,191::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:19,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:19,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:19,192::__init__::225::IOProcess::(_processLogs) (541315) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:19,192::__init__::225::IOProcess::(_processLogs) (541315) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:19,193::__init__::225::IOProcess::(_processLogs) (541315) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:19,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:19,195::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:30:19,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:19,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253007 s, 40.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:20,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:20,091::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:20,091::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:20,179::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:20,180::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:20,180::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:22,000::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:22,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0212715 s, 48.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:22,867::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:22,867::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:22,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:22,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:22,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:22,868::__init__::225::IOProcess::(_processLogs) (541316) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:22,868::__init__::225::IOProcess::(_processLogs) (541316) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:22,870::__init__::225::IOProcess::(_processLogs) (541316) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:22,870::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:30:22,870::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:30:22,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00107361 s, 461 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) (541317) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) (541317) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:22,930::__init__::225::IOProcess::(_processLogs) (541317) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:22,931::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:30:22,931::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) (541318) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) (541318) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) (541318) Building response >Thread-19::DEBUG::2014-08-11 17:30:22,932::__init__::225::IOProcess::(_processLogs) (541318) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:22,933::__init__::225::IOProcess::(_processLogs) (541319) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) (541319) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) (541319) Building response >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) (541319) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:22,934::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) (541320) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) (541320) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) (541320) Building response >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) (541320) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:22,935::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:30:23,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`83186f21-79de-40a0-939d-b20b2dcd913b`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:30:23,372::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:30:23,372::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:30:23,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:23,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:23,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:23,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:23,373::__init__::225::IOProcess::(_processLogs) (541321) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:30:23,373::__init__::225::IOProcess::(_processLogs) (541321) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:30:23,380::__init__::225::IOProcess::(_processLogs) (541321) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:23,380::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:23,380::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:30:23,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:23,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:30:23,381::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:30:23,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:30:23,381::task::1191::Storage.TaskManager.Task::(prepare) Task=`83186f21-79de-40a0-939d-b20b2dcd913b`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:30:23,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:30:23,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`83186f21-79de-40a0-939d-b20b2dcd913b`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:30:23,382::__init__::225::IOProcess::(_processLogs) (541322) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:30:23,382::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:30:23,383::__init__::225::IOProcess::(_processLogs) (541322) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:30:23,383::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:30:23,383::__init__::225::IOProcess::(_processLogs) (541322) Building response >Thread-10017::DEBUG::2014-08-11 17:30:23,383::task::993::Storage.TaskManager.Task::(_decref) Task=`83186f21-79de-40a0-939d-b20b2dcd913b`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:30:23,384::__init__::225::IOProcess::(_processLogs) (541322) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:23,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:23,384::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:30:23,403::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:30:24,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:24,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0536657 s, 19.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:25,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:25,098::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:25,098::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:25,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:25,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:25,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:26,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:26,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012817 s, 79.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:30:28,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:28,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0540859 s, 18.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:30:28,444::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:30:29,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`4831a6f4-e109-48ba-8683-841d37370ebd`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:29,032::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:30:29,032::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364183', 'lastCheck': '9.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107361', 'lastCheck': '6.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:29,032::task::1191::Storage.TaskManager.Task::(prepare) Task=`4831a6f4-e109-48ba-8683-841d37370ebd`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364183', 'lastCheck': '9.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107361', 'lastCheck': '6.1', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:29,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`4831a6f4-e109-48ba-8683-841d37370ebd`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:29,032::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:29,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:29,032::task::993::Storage.TaskManager.Task::(_decref) Task=`4831a6f4-e109-48ba-8683-841d37370ebd`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:30:29,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:30:29,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:30:29,124::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:30:29,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`49df1f44-6344-4215-b30c-40d05634dc1b`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:29,125::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:30:29,157::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:29,157::task::1191::Storage.TaskManager.Task::(prepare) Task=`49df1f44-6344-4215-b30c-40d05634dc1b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:29,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`49df1f44-6344-4215-b30c-40d05634dc1b`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:29,157::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:29,157::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:29,157::task::993::Storage.TaskManager.Task::(_decref) Task=`49df1f44-6344-4215-b30c-40d05634dc1b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:30:29,166::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:30:29,166::task::595::Storage.TaskManager.Task::(_updateState) Task=`741d88c9-b609-462f-9bb4-03ac8cc9a857`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:30:29,166::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:30:29,168::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8c241c43-050f-467b-81f1-fefa1dcf7ca6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:30:29,168::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:30:29,168::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:30:29,168::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8c241c43-050f-467b-81f1-fefa1dcf7ca6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:30:29,168::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`741d88c9-b609-462f-9bb4-03ac8cc9a857`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:30:29,168::task::993::Storage.TaskManager.Task::(_decref) Task=`741d88c9-b609-462f-9bb4-03ac8cc9a857`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:30:29,184::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:29,184::task::1191::Storage.TaskManager.Task::(prepare) Task=`741d88c9-b609-462f-9bb4-03ac8cc9a857`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:29,185::task::595::Storage.TaskManager.Task::(_updateState) Task=`741d88c9-b609-462f-9bb4-03ac8cc9a857`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:30:29,185::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:30:29,185::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:30:29,185::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:30:29,185::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:30:29,185::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:30:29,185::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:30:29,185::task::993::Storage.TaskManager.Task::(_decref) Task=`741d88c9-b609-462f-9bb4-03ac8cc9a857`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:30:29,195::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:29,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:29,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:29,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:29,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:29,195::__init__::225::IOProcess::(_processLogs) (541323) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:29,196::__init__::225::IOProcess::(_processLogs) (541323) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:29,196::__init__::225::IOProcess::(_processLogs) (541323) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:29,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:30:29,196::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:30:29,197::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:30:29,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00356518 s, 103 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) (541324) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:29,264::__init__::225::IOProcess::(_processLogs) (541324) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:29,273::__init__::225::IOProcess::(_processLogs) (541324) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:29,273::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-vm::DEBUG::2014-08-11 17:30:30,100::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:30,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:30,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:30,187::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:30,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:30,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:30,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:30,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131715 s, 77.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:30:30,977::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:30:32,494::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:32,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0681601 s, 15.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:32,935::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:32,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) (541325) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) (541325) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) DEBUG|(541325) Building response >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) (541325) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:32,936::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:32,937::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:30:32,937::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:30:32,997::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00125302 s, 395 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) (541326) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:32,998::__init__::225::IOProcess::(_processLogs) (541326) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:32,999::__init__::225::IOProcess::(_processLogs) DEBUG|(541326) Building response >Thread-19::DEBUG::2014-08-11 17:30:32,999::__init__::225::IOProcess::(_processLogs) (541326) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:32,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:32,999::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:33,000::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) (541327) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) (541327) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) (541327) Building response >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) (541327) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:33,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) (541328) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) (541328) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) (541328) Building response >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) (541328) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:33,002::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:33,003::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:33,004::__init__::225::IOProcess::(_processLogs) (541329) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:33,004::__init__::225::IOProcess::(_processLogs) (541329) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:33,004::__init__::225::IOProcess::(_processLogs) (541329) Building response >Thread-19::DEBUG::2014-08-11 17:30:33,004::__init__::225::IOProcess::(_processLogs) (541329) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:33,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:33,004::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:30:34,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:34,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0457759 s, 22.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:35,105::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:35,106::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:35,106::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:35,194::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:35,194::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:35,195::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:36,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:36,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147481 s, 69.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:30:38,411::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:30:38,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:38,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426009 s, 24.0 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:30:39,254::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:30:39,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e836d63-518f-4032-ad00-fd32bea33882`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:39,254::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-19::DEBUG::2014-08-11 17:30:39,275::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:39,276::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:39,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:39,277::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:39,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:39,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:39,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:39,279::__init__::225::IOProcess::(_processLogs) (541330) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:39,279::__init__::225::IOProcess::(_processLogs) (541330) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:39,340::__init__::225::IOProcess::(_processLogs) DEBUG|(541330) Building response >Thread-10205::INFO::2014-08-11 17:30:39,341::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-19::DEBUG::2014-08-11 17:30:39,341::__init__::225::IOProcess::(_processLogs) (541330) Queuing response >Thread-10205::DEBUG::2014-08-11 17:30:39,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e836d63-518f-4032-ad00-fd32bea33882`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:39,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e836d63-518f-4032-ad00-fd32bea33882`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:30:39,342::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10205::DEBUG::2014-08-11 17:30:39,343::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-27::DEBUG::2014-08-11 17:30:39,343::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:30:39,343::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:30:39,343::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:39,403::task::993::Storage.TaskManager.Task::(_decref) Task=`2e836d63-518f-4032-ad00-fd32bea33882`::ref 0 aborting False >Thread-27::DEBUG::2014-08-11 17:30:39,403::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000407574 s, 898 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) (541331) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) (541331) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:39,405::__init__::225::IOProcess::(_processLogs) (541331) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:39,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:39,406::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10197::DEBUG::2014-08-11 17:30:39,416::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:30:39,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`48f46b41-0112-42f3-9871-8e625f5d1433`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:30:39,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:30:39,416::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`87dd3714-083c-4555-a366-597e7052a445`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:30:39,417::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:30:39,417::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:30:39,417::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`87dd3714-083c-4555-a366-597e7052a445`::Granted request >Thread-10197::DEBUG::2014-08-11 17:30:39,417::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`48f46b41-0112-42f3-9871-8e625f5d1433`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:30:39,417::task::993::Storage.TaskManager.Task::(_decref) Task=`48f46b41-0112-42f3-9871-8e625f5d1433`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:30:39,472::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:39,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`48f46b41-0112-42f3-9871-8e625f5d1433`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '56000249856', 'isoprefix': '', 'alerts': [], 'disktotal': '620971950080', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:39,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`48f46b41-0112-42f3-9871-8e625f5d1433`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:30:39,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:30:39,473::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:30:39,473::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:30:39,473::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:30:39,473::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:30:39,473::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:30:39,473::task::993::Storage.TaskManager.Task::(_decref) Task=`48f46b41-0112-42f3-9871-8e625f5d1433`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:30:40,112::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:40,113::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:40,113::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:40,200::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:40,201::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:40,201::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:40,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:41,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0574994 s, 17.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:43,004::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:43,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) (541332) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) (541332) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) (541332) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,005::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:30:43,006::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:30:43,094::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0140373 s, 35.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:43,094::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:43,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:43,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:43,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:43,095::__init__::225::IOProcess::(_processLogs) (541333) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:43,095::__init__::225::IOProcess::(_processLogs) (541333) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:43,101::__init__::225::IOProcess::(_processLogs) (541333) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:43,101::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) (541334) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) (541334) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) (541334) Building response >Thread-19::DEBUG::2014-08-11 17:30:43,102::__init__::225::IOProcess::(_processLogs) (541334) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:43,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) (541335) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) (541335) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) (541335) Building response >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) (541335) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:43,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:43,105::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:43,105::__init__::225::IOProcess::(_processLogs) (541336) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:43,105::__init__::225::IOProcess::(_processLogs) (541336) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:43,105::__init__::225::IOProcess::(_processLogs) (541336) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:43,106::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:30:43,109::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:43,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0312616 s, 32.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:30:43,446::task::595::Storage.TaskManager.Task::(_updateState) Task=`44583c05-58c6-482e-bd14-8d3120216fb0`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:30:43,446::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:30:43,446::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) (541337) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) (541337) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) (541337) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,447::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:43,448::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:30:43,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:43,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:30:43,448::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:30:43,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:30:43,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`44583c05-58c6-482e-bd14-8d3120216fb0`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:30:43,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:30:43,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`44583c05-58c6-482e-bd14-8d3120216fb0`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:30:43,450::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:30:43,450::__init__::225::IOProcess::(_processLogs) (541338) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:30:43,450::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:30:43,450::__init__::225::IOProcess::(_processLogs) (541338) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:30:43,451::task::993::Storage.TaskManager.Task::(_decref) Task=`44583c05-58c6-482e-bd14-8d3120216fb0`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:30:43,451::__init__::225::IOProcess::(_processLogs) (541338) Building response >Thread-19::DEBUG::2014-08-11 17:30:43,451::__init__::225::IOProcess::(_processLogs) (541338) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:43,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:43,451::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:30:43,472::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:30:44,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`14388af0-0b2a-4ffb-9fbd-a2a0ea91db05`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:44,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:30:44,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407574', 'lastCheck': '4.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0140373', 'lastCheck': '1.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:44,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`14388af0-0b2a-4ffb-9fbd-a2a0ea91db05`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407574', 'lastCheck': '4.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0140373', 'lastCheck': '1.2', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:44,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`14388af0-0b2a-4ffb-9fbd-a2a0ea91db05`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:44,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:44,345::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:44,345::task::993::Storage.TaskManager.Task::(_decref) Task=`14388af0-0b2a-4ffb-9fbd-a2a0ea91db05`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:30:44,365::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:30:44,365::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:45,118::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:45,119::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:45,119::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:45,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:45,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:45,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:45,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:45,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0651299 s, 15.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:30:47,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:47,428::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299912 s, 34.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:30:49,070::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) (541339) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) (541339) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) (541339) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:49,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:30:49,408::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:49,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-27::DEBUG::2014-08-11 17:30:49,583::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00084658 s, 432 kB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:30:49,584::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-19::DEBUG::2014-08-11 17:30:49,585::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-10205::DEBUG::2014-08-11 17:30:49,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`98f0eb51-9a81-4be4-9a19-6665577c76fa`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:30:49,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10205::INFO::2014-08-11 17:30:49,586::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-19::DEBUG::2014-08-11 17:30:49,586::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:49,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:49,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:49,588::__init__::225::IOProcess::(_processLogs) (541340) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:49,588::__init__::225::IOProcess::(_processLogs) (541340) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:49,588::__init__::225::IOProcess::(_processLogs) (541340) Building response >Thread-19::DEBUG::2014-08-11 17:30:49,588::__init__::225::IOProcess::(_processLogs) (541340) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:49,588::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:49,588::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:30:49,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510891 s, 20.0 MB/s\n'; <rc> = 0 >Thread-10205::INFO::2014-08-11 17:30:49,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:49,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`98f0eb51-9a81-4be4-9a19-6665577c76fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:49,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`98f0eb51-9a81-4be4-9a19-6665577c76fa`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:49,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:49,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:49,644::task::993::Storage.TaskManager.Task::(_decref) Task=`98f0eb51-9a81-4be4-9a19-6665577c76fa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:30:49,650::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:30:49,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b4e4b60-db27-4362-b13c-ca168c9a4069`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:30:49,650::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:30:49,651::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`06d9b51d-c3b4-425f-95e9-c08b0999e9c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:30:49,651::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:30:49,651::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:30:49,651::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`06d9b51d-c3b4-425f-95e9-c08b0999e9c6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:30:49,651::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8b4e4b60-db27-4362-b13c-ca168c9a4069`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:30:49,651::task::993::Storage.TaskManager.Task::(_decref) Task=`8b4e4b60-db27-4362-b13c-ca168c9a4069`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:30:49,667::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:49,668::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b4e4b60-db27-4362-b13c-ca168c9a4069`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:49,668::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b4e4b60-db27-4362-b13c-ca168c9a4069`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:30:49,668::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:30:49,668::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:30:49,668::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:30:49,668::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:30:49,668::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:30:49,668::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:30:49,668::task::993::Storage.TaskManager.Task::(_decref) Task=`8b4e4b60-db27-4362-b13c-ca168c9a4069`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:30:50,121::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:50,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:50,122::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:50,213::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:50,213::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:50,214::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:51,642::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:51,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0915953 s, 11.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:53,106::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:53,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:53,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:53,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:53,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:53,106::__init__::225::IOProcess::(_processLogs) (541341) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:53,107::__init__::225::IOProcess::(_processLogs) (541341) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:53,108::__init__::225::IOProcess::(_processLogs) (541341) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:53,108::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:30:53,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:30:53,170::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000950938 s, 521 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:53,170::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:53,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:53,171::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:53,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:53,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:53,171::__init__::225::IOProcess::(_processLogs) (541342) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:53,171::__init__::225::IOProcess::(_processLogs) (541342) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:53,171::__init__::225::IOProcess::(_processLogs) (541342) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:53,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) (541343) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) (541343) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) (541343) Building response >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) (541343) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:53,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) (541344) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) (541344) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) (541344) Building response >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) (541344) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:53,174::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:53,175::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:30:53,175::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:53,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:53,175::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:53,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:53,175::__init__::225::IOProcess::(_processLogs) (541345) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:53,176::__init__::225::IOProcess::(_processLogs) (541345) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:53,176::__init__::225::IOProcess::(_processLogs) (541345) Building response >Thread-19::DEBUG::2014-08-11 17:30:53,176::__init__::225::IOProcess::(_processLogs) (541345) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:53,176::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:53,176::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:30:53,473::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:30:53,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:53,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125699 s, 81.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:30:55,128::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:55,128::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:30:55,128::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:55,217::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:55,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:30:55,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:30:55,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:55,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475661 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:30:57,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:30:58,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600782 s, 17.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:30:58,590::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:30:59,536::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c20e20e-061f-43ca-a58a-02074e349792`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:59,536::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:30:59,537::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084658', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000950938', 'lastCheck': '6.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:59,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c20e20e-061f-43ca-a58a-02074e349792`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00084658', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000950938', 'lastCheck': '6.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:30:59,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c20e20e-061f-43ca-a58a-02074e349792`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:59,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:59,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:59,537::task::993::Storage.TaskManager.Task::(_decref) Task=`1c20e20e-061f-43ca-a58a-02074e349792`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:30:59,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:30:59,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:30:59,588::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:30:59,589::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:30:59,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,590::__init__::225::IOProcess::(_processLogs) (541346) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:30:59,590::__init__::225::IOProcess::(_processLogs) (541346) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) (541346) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,592::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,592::__init__::225::IOProcess::(_processLogs) (541347) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:30:59,592::__init__::225::IOProcess::(_processLogs) (541347) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:30:59,592::__init__::225::IOProcess::(_processLogs) (541347) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:59,593::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:30:59,597::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) (541348) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:30:59,597::__init__::225::IOProcess::(_processLogs) (541348) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:30:59,610::__init__::225::IOProcess::(_processLogs) (541348) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,611::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:30:59,611::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:30:59,611::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:30:59,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,612::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,612::__init__::225::IOProcess::(_processLogs) (541349) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:30:59,612::__init__::225::IOProcess::(_processLogs) (541349) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:30:59,614::__init__::225::IOProcess::(_processLogs) DEBUG|(541349) Building response >Thread-19::DEBUG::2014-08-11 17:30:59,614::__init__::225::IOProcess::(_processLogs) (541349) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:59,614::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:30:59,614::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:30:59,615::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:59,615::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:30:59,615::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) (541350) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) (541350) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) (541350) Building response >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) (541350) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) (541351) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:30:59,617::__init__::225::IOProcess::(_processLogs) (541351) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:30:59,618::__init__::225::IOProcess::(_processLogs) DEBUG|(541351) Building response >Thread-27::DEBUG::2014-08-11 17:30:59,618::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:30:59,618::__init__::225::IOProcess::(_processLogs) (541351) Queuing response >Thread-27::INFO::2014-08-11 17:30:59,618::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:30:59,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::INFO::2014-08-11 17:30:59,619::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:30:59,619::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) (541352) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) (541352) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) DEBUG|(541352) Building response >Thread-19::DEBUG::2014-08-11 17:30:59,620::__init__::225::IOProcess::(_processLogs) (541352) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,621::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:30:59,621::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:30:59,621::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:30:59,681::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000648685 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:30:59,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) (541353) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) (541353) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) (541353) Building response >Thread-19::DEBUG::2014-08-11 17:30:59,682::__init__::225::IOProcess::(_processLogs) (541353) Queuing response >Thread-19::DEBUG::2014-08-11 17:30:59,683::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:30:59,683::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:30:59,731::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:30:59,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`62cf6125-0b64-4b51-9867-8bbaad6e7d93`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:30:59,732::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:30:59,745::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:59,745::task::1191::Storage.TaskManager.Task::(prepare) Task=`62cf6125-0b64-4b51-9867-8bbaad6e7d93`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:30:59,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`62cf6125-0b64-4b51-9867-8bbaad6e7d93`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:30:59,745::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:30:59,745::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:30:59,745::task::993::Storage.TaskManager.Task::(_decref) Task=`62cf6125-0b64-4b51-9867-8bbaad6e7d93`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:30:59,756::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:30:59,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed12b719-b29a-4818-8180-141bb418dfff`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:30:59,756::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:30:59,757::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`88d5a143-70b6-4a9f-9acd-423d85fdb7f1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:30:59,757::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:30:59,757::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:30:59,757::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`88d5a143-70b6-4a9f-9acd-423d85fdb7f1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:30:59,757::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ed12b719-b29a-4818-8180-141bb418dfff`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:30:59,757::task::993::Storage.TaskManager.Task::(_decref) Task=`ed12b719-b29a-4818-8180-141bb418dfff`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:30:59,774::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:59,774::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed12b719-b29a-4818-8180-141bb418dfff`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:30:59,774::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed12b719-b29a-4818-8180-141bb418dfff`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:30:59,774::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:30:59,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:30:59,774::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:30:59,774::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:30:59,774::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:30:59,774::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:30:59,775::task::993::Storage.TaskManager.Task::(_decref) Task=`ed12b719-b29a-4818-8180-141bb418dfff`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:31:00,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:31:00,181::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:00,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:00,182::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:00,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:00,223::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:00,223::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:00,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505396 s, 20.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:31:01,083::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:31:02,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:02,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515712 s, 19.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:03,176::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:03,176::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:03,176::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:03,176::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:03,176::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:03,177::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:03,177::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:03,177::__init__::225::IOProcess::(_processLogs) (541354) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:03,177::__init__::225::IOProcess::(_processLogs) (541354) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:03,178::__init__::225::IOProcess::(_processLogs) DEBUG|(541354) Building response >Thread-19::DEBUG::2014-08-11 17:31:03,178::__init__::225::IOProcess::(_processLogs) (541354) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:03,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:03,178::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:31:03,179::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:31:03,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00222336 s, 223 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:03,240::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) (541355) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:03,241::__init__::225::IOProcess::(_processLogs) (541355) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:03,243::__init__::225::IOProcess::(_processLogs) DEBUG|(541355) Building response >Thread-19::DEBUG::2014-08-11 17:31:03,243::__init__::225::IOProcess::(_processLogs) (541355) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:03,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:03,243::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:03,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:03,243::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) (541356) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:03,244::__init__::225::IOProcess::(_processLogs) (541356) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:03,245::__init__::225::IOProcess::(_processLogs) DEBUG|(541356) Building response >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) (541356) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:03,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:03,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:03,247::__init__::225::IOProcess::(_processLogs) (541357) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:03,247::__init__::225::IOProcess::(_processLogs) (541357) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:03,247::__init__::225::IOProcess::(_processLogs) DEBUG|(541357) Building response >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) (541357) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:03,248::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:03,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:03,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:03,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:03,249::__init__::225::IOProcess::(_processLogs) (541358) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:03,249::__init__::225::IOProcess::(_processLogs) (541358) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:03,250::__init__::225::IOProcess::(_processLogs) (541358) Building response >Thread-19::DEBUG::2014-08-11 17:31:03,250::__init__::225::IOProcess::(_processLogs) (541358) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:03,250::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:03,250::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:31:04,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:04,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133622 s, 76.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:31:05,188::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:05,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:05,189::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:05,226::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:05,227::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:05,227::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:06,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:06,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055048 s, 18.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:31:08,480::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:31:08,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:08,723::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0297817 s, 34.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:09,684::__init__::225::IOProcess::(_processLogs) (541359) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:09,685::__init__::225::IOProcess::(_processLogs) (541359) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:09,690::__init__::225::IOProcess::(_processLogs) DEBUG|(541359) Building response >Thread-19::DEBUG::2014-08-11 17:31:09,690::__init__::225::IOProcess::(_processLogs) (541359) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:09,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:09,690::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:31:09,690::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:31:09,750::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000933322 s, 392 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:09,751::__init__::225::IOProcess::(_processLogs) (541360) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:09,752::__init__::225::IOProcess::(_processLogs) (541360) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:09,752::__init__::225::IOProcess::(_processLogs) DEBUG|(541360) Building response >Thread-19::DEBUG::2014-08-11 17:31:09,752::__init__::225::IOProcess::(_processLogs) (541360) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:09,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:09,753::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:31:09,801::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:31:09,802::task::595::Storage.TaskManager.Task::(_updateState) Task=`b21f403e-c568-4fb6-91f7-fb77d6655542`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:09,802::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:31:09,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:09,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`b21f403e-c568-4fb6-91f7-fb77d6655542`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:09,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`b21f403e-c568-4fb6-91f7-fb77d6655542`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:09,856::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:09,856::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:09,856::task::993::Storage.TaskManager.Task::(_decref) Task=`b21f403e-c568-4fb6-91f7-fb77d6655542`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:31:09,867::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:31:09,867::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d0ad91e-3cd7-405e-ad56-b7aa8a26fef9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:31:09,867::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:31:09,867::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`89788828-9785-451a-99f6-513945316170`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:31:09,868::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:31:09,868::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:31:09,868::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`89788828-9785-451a-99f6-513945316170`::Granted request >Thread-10197::DEBUG::2014-08-11 17:31:09,868::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9d0ad91e-3cd7-405e-ad56-b7aa8a26fef9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:31:09,868::task::993::Storage.TaskManager.Task::(_decref) Task=`9d0ad91e-3cd7-405e-ad56-b7aa8a26fef9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:31:09,914::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:09,915::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d0ad91e-3cd7-405e-ad56-b7aa8a26fef9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:09,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d0ad91e-3cd7-405e-ad56-b7aa8a26fef9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:31:09,915::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:31:09,915::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:31:09,915::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:31:09,915::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:31:09,915::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:31:09,915::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:31:09,915::task::993::Storage.TaskManager.Task::(_decref) Task=`9d0ad91e-3cd7-405e-ad56-b7aa8a26fef9`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:31:10,195::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:10,195::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:10,196::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:10,233::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:10,233::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:10,233::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:10,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:10,811::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0208999 s, 49.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:12,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:12,912::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351109 s, 29.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) (541361) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:13,250::__init__::225::IOProcess::(_processLogs) (541361) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:13,251::__init__::225::IOProcess::(_processLogs) DEBUG|(541361) Building response >Thread-19::DEBUG::2014-08-11 17:31:13,251::__init__::225::IOProcess::(_processLogs) (541361) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:13,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:13,251::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:31:13,252::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:31:13,322::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00690748 s, 71.7 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:13,322::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:13,322::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:13,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:13,323::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:13,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:13,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:13,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:13,323::__init__::225::IOProcess::(_processLogs) (541362) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:13,323::__init__::225::IOProcess::(_processLogs) (541362) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:13,324::__init__::225::IOProcess::(_processLogs) DEBUG|(541362) Building response >Thread-19::DEBUG::2014-08-11 17:31:13,324::__init__::225::IOProcess::(_processLogs) (541362) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:13,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:13,325::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:13,325::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:13,325::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:31:13,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) (541363) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) (541363) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) (541363) Building response >Thread-19::DEBUG::2014-08-11 17:31:13,326::__init__::225::IOProcess::(_processLogs) (541363) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:13,327::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) (541364) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) (541364) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) (541364) Building response >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) (541364) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:31:13,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:13,329::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:13,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:13,329::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:13,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:13,330::__init__::225::IOProcess::(_processLogs) (541365) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:13,330::__init__::225::IOProcess::(_processLogs) (541365) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:13,330::__init__::225::IOProcess::(_processLogs) (541365) Building response >Thread-19::DEBUG::2014-08-11 17:31:13,330::__init__::225::IOProcess::(_processLogs) (541365) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:13,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:13,330::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:31:13,598::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10205::DEBUG::2014-08-11 17:31:14,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`f434ea10-d4cc-47a5-bf15-3e1a70142205`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:14,737::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:31:14,737::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000933322', 'lastCheck': '5.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00690748', 'lastCheck': '1.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:31:14,738::task::1191::Storage.TaskManager.Task::(prepare) Task=`f434ea10-d4cc-47a5-bf15-3e1a70142205`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000933322', 'lastCheck': '5.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00690748', 'lastCheck': '1.4', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:31:14,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`f434ea10-d4cc-47a5-bf15-3e1a70142205`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:14,738::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:14,738::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:14,738::task::993::Storage.TaskManager.Task::(_decref) Task=`f434ea10-d4cc-47a5-bf15-3e1a70142205`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:31:14,758::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:31:14,759::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:14,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:15,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058066 s, 17.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:31:15,198::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:15,198::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:15,198::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:15,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:15,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:15,240::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:17,045::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:17,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0603052 s, 17.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:31:19,105::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:31:19,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:19,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017844 s, 57.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:19,753::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:19,753::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:19,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:19,753::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:19,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:19,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:19,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:19,754::__init__::225::IOProcess::(_processLogs) (541366) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:19,754::__init__::225::IOProcess::(_processLogs) (541366) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:19,754::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541366) Building response >Thread-27::DEBUG::2014-08-11 17:31:19,755::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:31:19,755::__init__::225::IOProcess::(_processLogs) (541366) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:19,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:31:19,816::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00032964 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:19,816::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) (541367) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:19,817::__init__::225::IOProcess::(_processLogs) (541367) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:19,818::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541367) Building response >Thread-19::DEBUG::2014-08-11 17:31:19,818::__init__::225::IOProcess::(_processLogs) (541367) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:19,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:19,818::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:31:19,956::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:31:19,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e4bfee6-b0c2-4be7-b026-e554584b6faa`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:19,956::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:31:19,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:19,970::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e4bfee6-b0c2-4be7-b026-e554584b6faa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:19,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e4bfee6-b0c2-4be7-b026-e554584b6faa`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:19,970::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:19,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:19,970::task::993::Storage.TaskManager.Task::(_decref) Task=`0e4bfee6-b0c2-4be7-b026-e554584b6faa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:31:19,976::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:31:19,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`e08e0f03-1535-456d-9b83-27841a27ba43`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:31:19,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:31:19,977::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b54dd2a1-5c58-40c0-9c10-804aff4f4714`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:31:19,977::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:31:19,977::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:31:19,977::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b54dd2a1-5c58-40c0-9c10-804aff4f4714`::Granted request >Thread-10197::DEBUG::2014-08-11 17:31:19,977::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e08e0f03-1535-456d-9b83-27841a27ba43`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:31:19,977::task::993::Storage.TaskManager.Task::(_decref) Task=`e08e0f03-1535-456d-9b83-27841a27ba43`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:31:19,993::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:19,993::task::1191::Storage.TaskManager.Task::(prepare) Task=`e08e0f03-1535-456d-9b83-27841a27ba43`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:19,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`e08e0f03-1535-456d-9b83-27841a27ba43`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:31:19,994::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:31:19,994::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:31:19,994::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:31:19,994::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:31:19,994::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:31:19,994::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:31:19,994::task::993::Storage.TaskManager.Task::(_decref) Task=`e08e0f03-1535-456d-9b83-27841a27ba43`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:31:20,201::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:20,202::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:20,202::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:20,245::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:20,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:20,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:21,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:21,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245408 s, 41.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:23,330::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:23,330::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:23,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:23,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:23,330::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,331::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,331::__init__::225::IOProcess::(_processLogs) (541368) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:23,331::__init__::225::IOProcess::(_processLogs) (541368) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:23,333::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541368) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,333::__init__::225::IOProcess::(_processLogs) (541368) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,334::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:31:23,334::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:23,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:31:23,512::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00479899 s, 103 kB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:31:23,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`098d0ee7-a06b-4606-a756-2cc3475af2c4`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:31:23,514::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:31:23,514::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:23,515::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:23,516::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:23,516::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:23,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,518::__init__::225::IOProcess::(_processLogs) (541369) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:23,518::__init__::225::IOProcess::(_processLogs) (541369) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:23,519::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:23,520::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:31:23,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:23,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:23,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,522::__init__::225::IOProcess::(_processLogs) (541370) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:31:23,522::__init__::225::IOProcess::(_processLogs) (541370) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:31:23,565::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541369) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,565::__init__::225::IOProcess::(_processLogs) (541369) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,566::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,567::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:23,568::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541370) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,569::__init__::225::IOProcess::(_processLogs) (541370) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,570::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:31:23,571::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:23,571::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:31:23,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:23,572::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:23,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,573::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,574::__init__::225::IOProcess::(_processLogs) (541371) Finding callback 'access'... >Dummy-51::DEBUG::2014-08-11 17:31:23,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632541 s, 16.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:23,575::__init__::225::IOProcess::(_processLogs) (541371) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:23,576::__init__::225::IOProcess::(_processLogs) (541371) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,576::__init__::225::IOProcess::(_processLogs) (541371) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,577::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,578::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:23,578::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:23,579::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:31:23,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:23,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:23,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,581::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,582::__init__::225::IOProcess::(_processLogs) (541372) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:31:23,583::__init__::225::IOProcess::(_processLogs) (541372) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:31:23,583::__init__::225::IOProcess::(_processLogs) (541372) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,584::__init__::225::IOProcess::(_processLogs) (541372) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,584::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,585::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::INFO::2014-08-11 17:31:23,586::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:31:23,587::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-10017::DEBUG::2014-08-11 17:31:23,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`098d0ee7-a06b-4606-a756-2cc3475af2c4`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:31:23,588::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-10017::DEBUG::2014-08-11 17:31:23,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`098d0ee7-a06b-4606-a756-2cc3475af2c4`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:31:23,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:31:23,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10017::DEBUG::2014-08-11 17:31:23,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:31:23,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10017::DEBUG::2014-08-11 17:31:23,590::task::993::Storage.TaskManager.Task::(_decref) Task=`098d0ee7-a06b-4606-a756-2cc3475af2c4`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:31:23,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,592::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,593::__init__::225::IOProcess::(_processLogs) (541373) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:23,594::__init__::225::IOProcess::(_processLogs) (541373) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:23,595::__init__::225::IOProcess::(_processLogs) (541373) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,595::__init__::225::IOProcess::(_processLogs) (541373) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,596::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,597::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:23,598::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:23,599::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:31:23,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:23,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:23,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:23,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:23,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:23,603::__init__::225::IOProcess::(_processLogs) (541374) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:23,604::__init__::225::IOProcess::(_processLogs) (541374) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:23,604::__init__::225::IOProcess::(_processLogs) (541374) Building response >Thread-19::DEBUG::2014-08-11 17:31:23,605::__init__::225::IOProcess::(_processLogs) (541374) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:23,606::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:23,607::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:31:23,612::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:31:25,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:25,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:25,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:25,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:25,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:25,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:25,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:25,734::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410549 s, 24.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:27,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:27,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205546 s, 49.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:31:28,606::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:29,819::__init__::225::IOProcess::(_processLogs) (541375) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:29,820::__init__::225::IOProcess::(_processLogs) (541375) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:29,820::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541375) Building response >Thread-19::DEBUG::2014-08-11 17:31:29,820::__init__::225::IOProcess::(_processLogs) (541375) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:29,820::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:29,821::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:31:29,821::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:31:29,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00111315 s, 329 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:29,882::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:29,882::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:29,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:29,882::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) (541376) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) (541376) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541376) Building response >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) (541376) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:29,883::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:29,884::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:31:29,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10205::DEBUG::2014-08-11 17:31:29,946::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ab0c55e-e8f5-4e1a-933e-23fe58a5c69d`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:29,946::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:31:29,947::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111315', 'lastCheck': '0.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00479899', 'lastCheck': '6.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:31:29,947::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ab0c55e-e8f5-4e1a-933e-23fe58a5c69d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111315', 'lastCheck': '0.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00479899', 'lastCheck': '6.3', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:31:29,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ab0c55e-e8f5-4e1a-933e-23fe58a5c69d`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:29,947::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:29,947::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:29,947::task::993::Storage.TaskManager.Task::(_decref) Task=`9ab0c55e-e8f5-4e1a-933e-23fe58a5c69d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:31:29,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0171171 s, 59.8 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:31:29,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:31:29,968::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:31:30,038::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:31:30,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`edf64b06-0335-4853-bb92-bade13991085`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:30,039::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:31:30,088::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:30,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`edf64b06-0335-4853-bb92-bade13991085`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:30,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`edf64b06-0335-4853-bb92-bade13991085`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:30,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:30,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:30,089::task::993::Storage.TaskManager.Task::(_decref) Task=`edf64b06-0335-4853-bb92-bade13991085`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:31:30,102::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:31:30,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce93757d-0f14-4eab-bf94-d6d0bbfcdbc2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:31:30,103::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:31:30,103::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e1045138-9ce9-4cdc-a8e3-edb9d4c029bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:31:30,103::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:31:30,103::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:31:30,103::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e1045138-9ce9-4cdc-a8e3-edb9d4c029bf`::Granted request >Thread-10197::DEBUG::2014-08-11 17:31:30,104::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce93757d-0f14-4eab-bf94-d6d0bbfcdbc2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:31:30,104::task::993::Storage.TaskManager.Task::(_decref) Task=`ce93757d-0f14-4eab-bf94-d6d0bbfcdbc2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:31:30,120::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:30,120::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce93757d-0f14-4eab-bf94-d6d0bbfcdbc2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:30,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce93757d-0f14-4eab-bf94-d6d0bbfcdbc2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:31:30,120::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:31:30,120::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:31:30,120::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:31:30,120::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:31:30,121::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:31:30,121::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:31:30,121::task::993::Storage.TaskManager.Task::(_decref) Task=`ce93757d-0f14-4eab-bf94-d6d0bbfcdbc2`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:31:30,209::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:30,209::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:30,210::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:30,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:30,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:30,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:31:31,117::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:31:31,985::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:32,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.016994 s, 60.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:33,607::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:33,607::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:33,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:33,608::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:33,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:33,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:33,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:33,608::__init__::225::IOProcess::(_processLogs) (541377) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:33,608::__init__::225::IOProcess::(_processLogs) (541377) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:33,611::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541377) Building response >Thread-19::DEBUG::2014-08-11 17:31:33,611::__init__::225::IOProcess::(_processLogs) (541377) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:33,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:33,611::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:31:33,612::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:31:33,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00104294 s, 475 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) (541378) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:33,672::__init__::225::IOProcess::(_processLogs) (541378) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:33,673::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541378) Building response >Thread-19::DEBUG::2014-08-11 17:31:33,673::__init__::225::IOProcess::(_processLogs) (541378) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:33,673::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:33,673::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:33,673::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) (541379) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:33,674::__init__::225::IOProcess::(_processLogs) (541379) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) (541379) Building response >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) (541379) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:33,675::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) (541380) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) (541380) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) (541380) Building response >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) (541380) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:31:33,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:33,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:33,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:33,677::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:33,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:33,677::__init__::225::IOProcess::(_processLogs) (541381) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:33,678::__init__::225::IOProcess::(_processLogs) (541381) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:33,678::__init__::225::IOProcess::(_processLogs) (541381) Building response >Thread-19::DEBUG::2014-08-11 17:31:33,678::__init__::225::IOProcess::(_processLogs) (541381) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:33,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:33,678::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:31:34,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:34,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501971 s, 20.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:31:35,212::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:35,212::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:35,212::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:35,264::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:35,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:35,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:36,271::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:36,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0384471 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:38,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:38,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0753626 s, 13.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:31:38,676::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) (541382) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) (541382) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:39,885::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541382) Building response >Thread-19::DEBUG::2014-08-11 17:31:39,886::__init__::225::IOProcess::(_processLogs) (541382) Queuing response >Thread-27::DEBUG::2014-08-11 17:31:39,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:31:39,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:39,945::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:31:39,946::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000669082 s, 547 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:39,946::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:39,946::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) (541383) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) (541383) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:39,947::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541383) Building response >Thread-19::DEBUG::2014-08-11 17:31:39,948::__init__::225::IOProcess::(_processLogs) (541383) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:39,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:39,948::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10205::DEBUG::2014-08-11 17:31:40,153::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:31:40,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`21cf721f-d799-4009-b321-a537967c8689`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:40,154::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >GuestMonitor-vm::DEBUG::2014-08-11 17:31:40,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:40,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:40,218::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::INFO::2014-08-11 17:31:40,253::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:40,253::task::1191::Storage.TaskManager.Task::(prepare) Task=`21cf721f-d799-4009-b321-a537967c8689`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:40,254::task::595::Storage.TaskManager.Task::(_updateState) Task=`21cf721f-d799-4009-b321-a537967c8689`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:40,254::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:40,254::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:40,254::task::993::Storage.TaskManager.Task::(_decref) Task=`21cf721f-d799-4009-b321-a537967c8689`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:31:40,265::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:31:40,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad2dbe0e-a13c-4849-b8e9-decb76ce7ed5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:31:40,266::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:31:40,266::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`80bb887a-8502-4124-906f-e1f38f2b29b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:31:40,266::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:31:40,266::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:31:40,266::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`80bb887a-8502-4124-906f-e1f38f2b29b0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:31:40,266::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ad2dbe0e-a13c-4849-b8e9-decb76ce7ed5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:31:40,266::task::993::Storage.TaskManager.Task::(_decref) Task=`ad2dbe0e-a13c-4849-b8e9-decb76ce7ed5`::ref 1 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:40,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:40,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:40,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10197::INFO::2014-08-11 17:31:40,284::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:40,285::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad2dbe0e-a13c-4849-b8e9-decb76ce7ed5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55988715520', 'isoprefix': '', 'alerts': [], 'disktotal': '620960415744', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:40,285::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad2dbe0e-a13c-4849-b8e9-decb76ce7ed5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:31:40,285::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:31:40,285::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:31:40,285::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:31:40,285::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:31:40,285::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:31:40,285::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:31:40,285::task::993::Storage.TaskManager.Task::(_decref) Task=`ad2dbe0e-a13c-4849-b8e9-decb76ce7ed5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:31:40,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:40,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0539394 s, 19.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:42,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:42,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0292418 s, 35.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:31:43,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`110387fa-20bd-41ee-b0db-075ab3255334`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:31:43,608::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:31:43,608::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,608::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) (541384) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) (541384) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:31:43,609::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541384) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,611::__init__::225::IOProcess::(_processLogs) (541384) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:43,611::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,611::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:31:43,611::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,611::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:31:43,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,612::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-10102::INFO::2014-08-11 17:31:43,612::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:31:43,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:31:43,612::task::1191::Storage.TaskManager.Task::(prepare) Task=`110387fa-20bd-41ee-b0db-075ab3255334`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:31:43,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:31:43,613::task::595::Storage.TaskManager.Task::(_updateState) Task=`110387fa-20bd-41ee-b0db-075ab3255334`::moving from state preparing -> state finished >Thread-10102::DEBUG::2014-08-11 17:31:43,613::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:31:43,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:31:43,614::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:31:43,614::__init__::225::IOProcess::(_processLogs) (541385) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:31:43,614::task::993::Storage.TaskManager.Task::(_decref) Task=`110387fa-20bd-41ee-b0db-075ab3255334`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:31:43,615::__init__::225::IOProcess::(_processLogs) (541385) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:31:43,615::__init__::225::IOProcess::(_processLogs) (541385) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,615::__init__::225::IOProcess::(_processLogs) (541385) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:43,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,615::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:31:43,636::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) (541386) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:43,678::__init__::225::IOProcess::(_processLogs) (541386) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:43,679::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541386) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,679::__init__::225::IOProcess::(_processLogs) (541386) Queuing response >Thread-28::DEBUG::2014-08-11 17:31:43,679::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:31:43,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,738::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:31:43,740::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00136787 s, 362 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:43,741::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,741::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:43,741::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,741::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:43,741::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:43,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:43,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:43,742::__init__::225::IOProcess::(_processLogs) (541387) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:43,742::__init__::225::IOProcess::(_processLogs) (541387) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:43,742::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541387) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,742::__init__::225::IOProcess::(_processLogs) (541387) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:43,742::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,743::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:43,743::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,743::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:31:43,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,743::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:43,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) (541388) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) (541388) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) (541388) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) (541388) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,744::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:43,745::__init__::225::IOProcess::(_processLogs) (541389) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) (541389) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) (541389) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) (541389) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:43,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) (541390) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) (541390) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) (541390) Building response >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) (541390) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:43,747::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:43,748::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:31:44,737::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:44,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0737726 s, 13.9 MB/s\n'; <rc> = 0 >Thread-10205::DEBUG::2014-08-11 17:31:45,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`da6f02da-2267-4a8e-9d10-b2ecd9104964`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:45,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:31:45,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669082', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136787', 'lastCheck': '1.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:31:45,198::task::1191::Storage.TaskManager.Task::(prepare) Task=`da6f02da-2267-4a8e-9d10-b2ecd9104964`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669082', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00136787', 'lastCheck': '1.5', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:31:45,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`da6f02da-2267-4a8e-9d10-b2ecd9104964`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:45,198::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:45,198::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:45,198::task::993::Storage.TaskManager.Task::(_decref) Task=`da6f02da-2267-4a8e-9d10-b2ecd9104964`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:31:45,216::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:31:45,216::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:45,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:45,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:45,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:45,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:45,276::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:45,276::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:46,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:46,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0517743 s, 19.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:48,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:49,110::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559341 s, 18.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:31:49,134::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) (541391) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:49,949::__init__::225::IOProcess::(_processLogs) (541391) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:49,950::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541391) Building response >Thread-19::DEBUG::2014-08-11 17:31:49,950::__init__::225::IOProcess::(_processLogs) (541391) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:49,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:49,951::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:31:49,951::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:31:50,012::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00134077 s, 273 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:50,012::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) (541392) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:50,013::__init__::225::IOProcess::(_processLogs) (541392) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:50,015::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541392) Building response >Thread-19::DEBUG::2014-08-11 17:31:50,015::__init__::225::IOProcess::(_processLogs) (541392) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:50,015::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:31:50,015::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:31:50,224::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:50,225::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:50,225::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:50,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:50,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:50,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:31:50,342::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:31:50,342::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffd4ac37-5c6d-4733-b668-fb3607417569`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:31:50,342::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:31:50,399::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:50,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffd4ac37-5c6d-4733-b668-fb3607417569`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:31:50,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffd4ac37-5c6d-4733-b668-fb3607417569`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:31:50,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:31:50,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:31:50,400::task::993::Storage.TaskManager.Task::(_decref) Task=`ffd4ac37-5c6d-4733-b668-fb3607417569`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:31:50,411::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:31:50,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`984e01c3-174b-404f-84fb-07dff6d3766a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:31:50,411::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:31:50,412::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`225fb797-25ac-44ae-bf31-16dffe42f31d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:31:50,412::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:31:50,412::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:31:50,412::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`225fb797-25ac-44ae-bf31-16dffe42f31d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:31:50,412::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`984e01c3-174b-404f-84fb-07dff6d3766a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:31:50,412::task::993::Storage.TaskManager.Task::(_decref) Task=`984e01c3-174b-404f-84fb-07dff6d3766a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:31:50,433::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:50,433::task::1191::Storage.TaskManager.Task::(prepare) Task=`984e01c3-174b-404f-84fb-07dff6d3766a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:31:50,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`984e01c3-174b-404f-84fb-07dff6d3766a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:31:50,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:31:50,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:31:50,434::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:31:50,434::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:31:50,434::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:31:50,434::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:31:50,434::task::993::Storage.TaskManager.Task::(_decref) Task=`984e01c3-174b-404f-84fb-07dff6d3766a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:31:51,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:51,227::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493661 s, 20.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:53,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:53,308::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137047 s, 74.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:31:53,683::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) (541393) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) (541393) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:53,748::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(541393) Building response >Thread-19::DEBUG::2014-08-11 17:31:53,749::__init__::225::IOProcess::(_processLogs) (541393) Queuing response >Thread-28::DEBUG::2014-08-11 17:31:53,749::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:31:53,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:53,808::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:31:53,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000865997 s, 572 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) (541394) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:31:53,811::__init__::225::IOProcess::(_processLogs) (541394) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:31:53,812::__init__::225::IOProcess::(_processLogs) (541394) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:53,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:53,812::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:31:53,812::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:31:53,812::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) (541395) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) (541395) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) (541395) Building response >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) (541395) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:53,813::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) (541396) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:53,814::__init__::225::IOProcess::(_processLogs) (541396) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) (541396) Building response >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) (541396) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:31:53,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:31:53,816::__init__::225::IOProcess::(_processLogs) (541397) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:31:53,816::__init__::225::IOProcess::(_processLogs) (541397) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:31:53,816::__init__::225::IOProcess::(_processLogs) (541397) Building response >Thread-19::DEBUG::2014-08-11 17:31:53,816::__init__::225::IOProcess::(_processLogs) (541397) Queuing response >Thread-19::DEBUG::2014-08-11 17:31:53,816::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:31:53,816::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:31:55,231::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:55,231::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:31:55,232::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:55,281::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:55,282::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:31:55,282::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:31:55,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:55,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.056895 s, 18.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:31:57,439::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:57,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0150653 s, 68.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:31:58,644::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:31:59,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:31:59,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052572 s, 19.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:00,016::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:00,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:00,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:00,017::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:00,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:00,017::__init__::225::IOProcess::(_processLogs) (541398) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:00,017::__init__::225::IOProcess::(_processLogs) (541398) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:00,017::__init__::225::IOProcess::(_processLogs) (541398) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:00,017::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:32:00,018::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:32:00,077::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000478156 s, 765 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:00,077::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:00,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:00,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:00,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:00,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:00,078::__init__::225::IOProcess::(_processLogs) (541399) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:00,078::__init__::225::IOProcess::(_processLogs) (541399) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:00,078::__init__::225::IOProcess::(_processLogs) (541399) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:00,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:00,079::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:00,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:00,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:00,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:00,288::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:00,288::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:00,288::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10205::DEBUG::2014-08-11 17:32:00,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`07fbf045-8bd2-44a8-a8d9-9abe6f543c73`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:32:00,507::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10205::INFO::2014-08-11 17:32:00,507::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478156', 'lastCheck': '0.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000865997', 'lastCheck': '6.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:32:00,507::task::1191::Storage.TaskManager.Task::(prepare) Task=`07fbf045-8bd2-44a8-a8d9-9abe6f543c73`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000478156', 'lastCheck': '0.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000865997', 'lastCheck': '6.7', 'valid': True}} >Thread-10205::DEBUG::2014-08-11 17:32:00,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`07fbf045-8bd2-44a8-a8d9-9abe6f543c73`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:32:00,507::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:32:00,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:32:00,508::task::993::Storage.TaskManager.Task::(_decref) Task=`07fbf045-8bd2-44a8-a8d9-9abe6f543c73`::ref 0 aborting False >Thread-10205::DEBUG::2014-08-11 17:32:00,522::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10205::DEBUG::2014-08-11 17:32:00,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f7f64ab-7a53-41d7-accd-89dd118889c7`::moving from state init -> state preparing >Thread-10205::INFO::2014-08-11 17:32:00,523::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10205::INFO::2014-08-11 17:32:00,539::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:32:00,539::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f7f64ab-7a53-41d7-accd-89dd118889c7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10205::DEBUG::2014-08-11 17:32:00,539::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f7f64ab-7a53-41d7-accd-89dd118889c7`::moving from state preparing -> state finished >Thread-10205::DEBUG::2014-08-11 17:32:00,539::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10205::DEBUG::2014-08-11 17:32:00,539::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10205::DEBUG::2014-08-11 17:32:00,539::task::993::Storage.TaskManager.Task::(_decref) Task=`9f7f64ab-7a53-41d7-accd-89dd118889c7`::ref 0 aborting False >Detector thread::DEBUG::2014-08-11 17:32:00,546::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.1.234:57361 >Detector thread::DEBUG::2014-08-11 17:32:00,547::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.1.234:57361 >Detector thread::DEBUG::2014-08-11 17:32:00,547::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.1.234:57361 >Detector thread::DEBUG::2014-08-11 17:32:00,547::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.1.234', 57361) >Thread-10197::DEBUG::2014-08-11 17:32:00,549::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:32:00,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`70454da2-4e34-47db-b413-3c72b02c72e0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:32:00,551::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:32:00,552::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a0c8fe6a-2a03-477e-86d5-a28ce9815ae2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10234::DEBUG::2014-08-11 17:32:00,552::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:32:00,553::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:32:00,553::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:32:00,554::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a0c8fe6a-2a03-477e-86d5-a28ce9815ae2`::Granted request >Thread-10234::DEBUG::2014-08-11 17:32:00,555::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:32:00,555::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`70454da2-4e34-47db-b413-3c72b02c72e0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:32:00,556::task::993::Storage.TaskManager.Task::(_decref) Task=`70454da2-4e34-47db-b413-3c72b02c72e0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:32:00,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:00,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`70454da2-4e34-47db-b413-3c72b02c72e0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:00,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`70454da2-4e34-47db-b413-3c72b02c72e0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:32:00,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:32:00,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:32:00,583::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:32:00,583::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:32:00,583::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:32:00,583::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:32:00,583::task::993::Storage.TaskManager.Task::(_decref) Task=`70454da2-4e34-47db-b413-3c72b02c72e0`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:32:01,186::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:32:01,639::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:01,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0295305 s, 34.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:32:03,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:32:03,866::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:03,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:03,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:03,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:03,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:03,867::__init__::225::IOProcess::(_processLogs) (541400) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:03,867::__init__::225::IOProcess::(_processLogs) (541400) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:03,869::__init__::225::IOProcess::(_processLogs) (541400) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:03,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:32:03,869::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:32:03,943::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000796078 s, 622 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:03,944::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:03,944::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:03,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:03,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:03,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:03,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Dummy-51::DEBUG::2014-08-11 17:32:03,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0772262 s, 13.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:03,948::__init__::225::IOProcess::(_processLogs) (541401) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:03,948::__init__::225::IOProcess::(_processLogs) (541401) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:03,949::__init__::225::IOProcess::(_processLogs) (541401) Building response >Thread-19::DEBUG::2014-08-11 17:32:03,949::__init__::225::IOProcess::(_processLogs) (541401) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:03,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:03,950::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:03,951::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:32:03,952::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:03,952::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:03,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:03,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:03,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:03,954::__init__::225::IOProcess::(_processLogs) (541402) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:03,954::__init__::225::IOProcess::(_processLogs) (541402) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:03,955::__init__::225::IOProcess::(_processLogs) (541402) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:03,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:03,956::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:03,957::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:32:03,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:03,958::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:03,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:03,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:03,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:03,960::__init__::225::IOProcess::(_processLogs) (541403) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:03,961::__init__::225::IOProcess::(_processLogs) (541403) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:03,961::__init__::225::IOProcess::(_processLogs) (541403) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:03,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:03,962::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:03,963::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:32:03,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:03,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:03,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:03,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:03,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:03,965::__init__::225::IOProcess::(_processLogs) (541404) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:03,965::__init__::225::IOProcess::(_processLogs) (541404) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:03,966::__init__::225::IOProcess::(_processLogs) (541404) Building response >Thread-19::DEBUG::2014-08-11 17:32:03,966::__init__::225::IOProcess::(_processLogs) (541404) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:03,967::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:03,967::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:05,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:05,244::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:05,245::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:05,293::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:05,294::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:05,294::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:05,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:06,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541265 s, 18.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:32:08,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:08,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244526 s, 41.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:32:08,705::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:32:10,079::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:10,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:10,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:10,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:10,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:10,080::__init__::225::IOProcess::(_processLogs) (541405) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:10,080::__init__::225::IOProcess::(_processLogs) (541405) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:10,080::__init__::225::IOProcess::(_processLogs) (541405) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:10,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:32:10,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:32:10,081::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:32:10,140::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000400372 s, 914 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:10,141::__init__::225::IOProcess::(_processLogs) (541406) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:10,142::__init__::225::IOProcess::(_processLogs) (541406) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:10,142::__init__::225::IOProcess::(_processLogs) DEBUG|(541406) Building response >Thread-19::DEBUG::2014-08-11 17:32:10,142::__init__::225::IOProcess::(_processLogs) (541406) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:10,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:10,143::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:32:10,187::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:32:10,250::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:10,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:10,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:10,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125386 s, 81.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:10,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:10,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:10,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:32:10,618::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10234::DEBUG::2014-08-11 17:32:10,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`7046e62c-d8c0-4a6c-b14c-b4e7b2fd07a8`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:10,619::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10234::INFO::2014-08-11 17:32:10,756::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:10,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`7046e62c-d8c0-4a6c-b14c-b4e7b2fd07a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:10,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`7046e62c-d8c0-4a6c-b14c-b4e7b2fd07a8`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:10,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:10,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:10,756::task::993::Storage.TaskManager.Task::(_decref) Task=`7046e62c-d8c0-4a6c-b14c-b4e7b2fd07a8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:32:10,768::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:32:10,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcaebb33-80fe-4151-bd88-79e51693f49d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:32:10,768::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:32:10,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0e9a278a-f9e3-403b-82ae-ee68fb16183c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:32:10,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:32:10,769::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:32:10,769::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0e9a278a-f9e3-403b-82ae-ee68fb16183c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:32:10,769::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bcaebb33-80fe-4151-bd88-79e51693f49d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:32:10,769::task::993::Storage.TaskManager.Task::(_decref) Task=`bcaebb33-80fe-4151-bd88-79e51693f49d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:32:10,787::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:10,787::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcaebb33-80fe-4151-bd88-79e51693f49d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:10,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcaebb33-80fe-4151-bd88-79e51693f49d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:32:10,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:32:10,787::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:32:10,787::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:32:10,787::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:32:10,787::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:32:10,787::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:32:10,788::task::993::Storage.TaskManager.Task::(_decref) Task=`bcaebb33-80fe-4151-bd88-79e51693f49d`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:32:12,266::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:12,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443126 s, 23.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:32:13,706::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:13,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:13,970::__init__::225::IOProcess::(_processLogs) (541407) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:13,970::__init__::225::IOProcess::(_processLogs) (541407) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:13,970::__init__::225::IOProcess::(_processLogs) DEBUG|(541407) Building response >Thread-28::DEBUG::2014-08-11 17:32:13,971::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:32:13,971::__init__::225::IOProcess::(_processLogs) (541407) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:14,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:32:14,059::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00116494 s, 425 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:14,059::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:14,061::__init__::225::IOProcess::(_processLogs) (541408) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:14,062::__init__::225::IOProcess::(_processLogs) DEBUG|(541408) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:14,062::__init__::225::IOProcess::(_processLogs) (541408) Building response >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) (541408) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:14,063::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) (541409) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) (541409) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) (541409) Building response >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) (541409) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:14,064::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) (541410) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) (541410) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:14,065::__init__::225::IOProcess::(_processLogs) (541410) Building response >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) (541410) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:14,066::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) (541411) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) (541411) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) (541411) Building response >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) (541411) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:14,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:14,068::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:32:14,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:14,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142046 s, 72.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:15,257::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:15,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:15,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:15,300::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:15,300::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:15,300::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:32:16,055::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba39943-e1c0-48bb-8d5b-1dfd1efb63a2`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:16,055::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10234::INFO::2014-08-11 17:32:16,056::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400372', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116494', 'lastCheck': '2.0', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:32:16,056::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ba39943-e1c0-48bb-8d5b-1dfd1efb63a2`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000400372', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00116494', 'lastCheck': '2.0', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:32:16,056::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ba39943-e1c0-48bb-8d5b-1dfd1efb63a2`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:16,056::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:16,056::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:16,056::task::993::Storage.TaskManager.Task::(_decref) Task=`6ba39943-e1c0-48bb-8d5b-1dfd1efb63a2`::ref 0 aborting False >Thread-10234::DEBUG::2014-08-11 17:32:16,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:32:16,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:16,457::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:16,528::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128501 s, 79.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:32:18,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:18,647::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0519638 s, 19.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:32:19,255::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-19::DEBUG::2014-08-11 17:32:20,143::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:20,143::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:20,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:20,143::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:20,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:20,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) (541412) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) (541412) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) DEBUG|(541412) Building response >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) (541412) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:20,144::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:32:20,145::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:32:20,206::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00111568 s, 328 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:20,206::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:20,206::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:20,206::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:20,206::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:20,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:20,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:20,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:20,207::__init__::225::IOProcess::(_processLogs) (541413) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:20,207::__init__::225::IOProcess::(_processLogs) (541413) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:20,208::__init__::225::IOProcess::(_processLogs) DEBUG|(541413) Building response >Thread-19::DEBUG::2014-08-11 17:32:20,208::__init__::225::IOProcess::(_processLogs) (541413) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:20,208::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:32:20,209::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:20,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:20,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:20,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:20,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:20,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:20,302::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:20,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:20,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0532444 s, 19.2 MB/s\n'; <rc> = 0 >Thread-10234::DEBUG::2014-08-11 17:32:20,848::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10234::DEBUG::2014-08-11 17:32:20,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`760b051f-fed8-4fc5-a8d2-fd42335f0e3a`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:20,849::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10234::INFO::2014-08-11 17:32:20,896::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:20,896::task::1191::Storage.TaskManager.Task::(prepare) Task=`760b051f-fed8-4fc5-a8d2-fd42335f0e3a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:20,896::task::595::Storage.TaskManager.Task::(_updateState) Task=`760b051f-fed8-4fc5-a8d2-fd42335f0e3a`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:20,896::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:20,896::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:20,896::task::993::Storage.TaskManager.Task::(_decref) Task=`760b051f-fed8-4fc5-a8d2-fd42335f0e3a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:32:20,907::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:32:20,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`94e8aba5-b9e7-4a4e-8893-b6e7c46dc9b6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:32:20,908::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:32:20,908::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`afb812f4-368c-4032-8a2b-93ca7bfdb515`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:32:20,908::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:32:20,908::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:32:20,908::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`afb812f4-368c-4032-8a2b-93ca7bfdb515`::Granted request >Thread-10197::DEBUG::2014-08-11 17:32:20,909::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`94e8aba5-b9e7-4a4e-8893-b6e7c46dc9b6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:32:20,909::task::993::Storage.TaskManager.Task::(_decref) Task=`94e8aba5-b9e7-4a4e-8893-b6e7c46dc9b6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:32:20,925::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:20,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`94e8aba5-b9e7-4a4e-8893-b6e7c46dc9b6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:20,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`94e8aba5-b9e7-4a4e-8893-b6e7c46dc9b6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:32:20,925::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:32:20,925::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:32:20,925::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:32:20,925::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:32:20,926::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:32:20,926::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:32:20,926::task::993::Storage.TaskManager.Task::(_decref) Task=`94e8aba5-b9e7-4a4e-8893-b6e7c46dc9b6`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:32:22,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:22,860::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0264934 s, 38.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:32:23,707::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3c838f6-885e-40a8-b949-a833bdd672c6`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:32:23,707::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:23,708::__init__::225::IOProcess::(_processLogs) (541414) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:32:23,709::__init__::225::IOProcess::(_processLogs) (541414) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:32:23,709::__init__::225::IOProcess::(_processLogs) DEBUG|(541414) Building response >Thread-19::DEBUG::2014-08-11 17:32:23,709::__init__::225::IOProcess::(_processLogs) (541414) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:23,710::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:23,711::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:32:23,711::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:32:23,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:32:23,712::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3c838f6-885e-40a8-b949-a833bdd672c6`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:32:23,713::__init__::225::IOProcess::(_processLogs) (541415) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:32:23,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3c838f6-885e-40a8-b949-a833bdd672c6`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:32:23,714::__init__::225::IOProcess::(_processLogs) (541415) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:32:23,714::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:32:23,715::__init__::225::IOProcess::(_processLogs) (541415) Building response >Thread-10017::DEBUG::2014-08-11 17:32:23,715::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:32:23,715::__init__::225::IOProcess::(_processLogs) (541415) Queuing response >Thread-10017::DEBUG::2014-08-11 17:32:23,715::task::993::Storage.TaskManager.Task::(_decref) Task=`a3c838f6-885e-40a8-b949-a833bdd672c6`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:32:23,716::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:23,716::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:32:23,735::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:32:24,067::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:24,067::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:24,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:24,067::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) (541416) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) (541416) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) DEBUG|(541416) Building response >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) (541416) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:24,068::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:32:24,069::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:32:24,129::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000878159 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) (541417) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:24,130::__init__::225::IOProcess::(_processLogs) (541417) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:24,131::__init__::225::IOProcess::(_processLogs) DEBUG|(541417) Building response >Thread-19::DEBUG::2014-08-11 17:32:24,131::__init__::225::IOProcess::(_processLogs) (541417) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:24,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:24,132::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:24,132::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:24,132::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:32:24,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:24,132::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:24,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) (541418) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) (541418) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) (541418) Building response >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) (541418) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:24,133::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) (541419) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) (541419) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) (541419) Building response >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) (541419) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:24,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:24,135::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:24,135::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:24,135::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:32:24,135::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:24,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) (541420) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) (541420) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) (541420) Building response >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) (541420) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:24,136::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:32:24,868::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:24,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0512726 s, 20.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:25,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:25,266::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:25,266::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:25,303::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:25,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:25,304::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:26,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:27,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126849 s, 80.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:32:28,714::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:32:29,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:29,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545658 s, 18.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:30,210::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:30,210::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:30,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:30,210::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-27::DEBUG::2014-08-11 17:32:30,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:32:30,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) (541421) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) (541421) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) (541421) Building response >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) (541421) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:30,270::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:30,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:30,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:30,273::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:32:30,283::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000376583 s, 972 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:30,283::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) (541422) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) (541422) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:30,284::__init__::225::IOProcess::(_processLogs) DEBUG|(541422) Building response >Thread-19::DEBUG::2014-08-11 17:32:30,285::__init__::225::IOProcess::(_processLogs) (541422) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:30,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:30,285::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:30,310::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:30,310::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:30,310::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:32:31,003::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10234::DEBUG::2014-08-11 17:32:31,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`869cf815-a935-400f-8e3c-4bf15bd4ef2f`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:31,004::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10234::INFO::2014-08-11 17:32:31,034::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:31,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`869cf815-a935-400f-8e3c-4bf15bd4ef2f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:31,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`869cf815-a935-400f-8e3c-4bf15bd4ef2f`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:31,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:31,035::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:31,035::task::993::Storage.TaskManager.Task::(_decref) Task=`869cf815-a935-400f-8e3c-4bf15bd4ef2f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:32:31,047::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:32:31,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`059cc5f9-3168-4e0f-b49b-649b13f6c9a2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:32:31,047::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:32:31,048::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e850ec36-b03c-4089-b6b6-eaedf1dbd35e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:32:31,048::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:32:31,048::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:32:31,048::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e850ec36-b03c-4089-b6b6-eaedf1dbd35e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:32:31,048::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`059cc5f9-3168-4e0f-b49b-649b13f6c9a2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:32:31,048::task::993::Storage.TaskManager.Task::(_decref) Task=`059cc5f9-3168-4e0f-b49b-649b13f6c9a2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:32:31,064::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:31,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`059cc5f9-3168-4e0f-b49b-649b13f6c9a2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:31,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`059cc5f9-3168-4e0f-b49b-649b13f6c9a2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:32:31,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:32:31,064::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:32:31,065::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:32:31,065::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:32:31,065::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:32:31,065::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:32:31,065::task::993::Storage.TaskManager.Task::(_decref) Task=`059cc5f9-3168-4e0f-b49b-649b13f6c9a2`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:32:31,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10234::DEBUG::2014-08-11 17:32:31,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b7f89a5-6a87-4521-a35c-3d6a50406f56`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:31,269::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10234::INFO::2014-08-11 17:32:31,270::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376583', 'lastCheck': '1.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000878159', 'lastCheck': '7.1', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:32:31,270::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b7f89a5-6a87-4521-a35c-3d6a50406f56`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000376583', 'lastCheck': '1.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000878159', 'lastCheck': '7.1', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:32:31,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b7f89a5-6a87-4521-a35c-3d6a50406f56`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:31,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >VM Channels Listener::DEBUG::2014-08-11 17:32:31,270::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10234::DEBUG::2014-08-11 17:32:31,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:31,271::task::993::Storage.TaskManager.Task::(_decref) Task=`5b7f89a5-6a87-4521-a35c-3d6a50406f56`::ref 0 aborting False >Thread-10234::DEBUG::2014-08-11 17:32:31,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:32:31,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:31,311::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424719 s, 24.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:32:33,319::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:33,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0619937 s, 16.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:34,136::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:34,136::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:34,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:34,136::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:34,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:34,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) (541423) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) (541423) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) DEBUG|(541423) Building response >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) (541423) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:34,137::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:32:34,138::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:32:34,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000848807 s, 583 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:34,198::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:34,198::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:34,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) (541424) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) (541424) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:34,199::__init__::225::IOProcess::(_processLogs) DEBUG|(541424) Building response >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) (541424) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:34,200::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) (541425) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) (541425) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) (541425) Building response >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) (541425) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:34,201::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:34,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) (541426) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) (541426) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) (541426) Building response >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) (541426) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:34,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) (541427) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) (541427) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) (541427) Building response >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) (541427) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:34,204::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:35,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:35,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:35,276::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:35,316::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:35,316::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:35,317::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:35,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:35,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123868 s, 82.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:32:37,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:37,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463849 s, 22.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:32:38,742::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:32:39,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:39,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0603547 s, 17.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:40,281::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:40,282::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:40,282::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) (541428) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:40,286::__init__::225::IOProcess::(_processLogs) (541428) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:40,287::__init__::225::IOProcess::(_processLogs) DEBUG|(541428) Building response >Thread-27::DEBUG::2014-08-11 17:32:40,287::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:32:40,288::__init__::225::IOProcess::(_processLogs) (541428) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:40,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:40,347::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:40,347::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:32:40,348::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00146419 s, 250 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:40,350::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:40,351::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:40,351::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:32:40,351::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:40,351::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:40,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:40,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:40,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:40,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:32:40,353::__init__::225::IOProcess::(_processLogs) (541429) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:40,354::__init__::225::IOProcess::(_processLogs) (541429) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:40,355::__init__::225::IOProcess::(_processLogs) DEBUG|(541429) Building response >Thread-19::DEBUG::2014-08-11 17:32:40,355::__init__::225::IOProcess::(_processLogs) (541429) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:40,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:40,356::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10234::DEBUG::2014-08-11 17:32:41,150::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [6c840493] >Thread-10234::DEBUG::2014-08-11 17:32:41,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`aacc8d87-1e6d-4e4d-863c-163175284cd7`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:41,150::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10234::INFO::2014-08-11 17:32:41,200::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:41,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`aacc8d87-1e6d-4e4d-863c-163175284cd7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:41,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`aacc8d87-1e6d-4e4d-863c-163175284cd7`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:41,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:41,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:41,200::task::993::Storage.TaskManager.Task::(_decref) Task=`aacc8d87-1e6d-4e4d-863c-163175284cd7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:32:41,212::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [6c840493] >Thread-10197::DEBUG::2014-08-11 17:32:41,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`44e8aef5-a65d-405c-b6cc-076ae7001001`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:32:41,212::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:32:41,212::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4df1097e-48bc-4e7d-996d-c38d2abb26f2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:32:41,212::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:32:41,213::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:32:41,214::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4df1097e-48bc-4e7d-996d-c38d2abb26f2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:32:41,214::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`44e8aef5-a65d-405c-b6cc-076ae7001001`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:32:41,214::task::993::Storage.TaskManager.Task::(_decref) Task=`44e8aef5-a65d-405c-b6cc-076ae7001001`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:32:41,230::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:41,230::task::1191::Storage.TaskManager.Task::(prepare) Task=`44e8aef5-a65d-405c-b6cc-076ae7001001`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:41,230::task::595::Storage.TaskManager.Task::(_updateState) Task=`44e8aef5-a65d-405c-b6cc-076ae7001001`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:32:41,231::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:32:41,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:32:41,231::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:32:41,231::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:32:41,231::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:32:41,231::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:32:41,231::task::993::Storage.TaskManager.Task::(_decref) Task=`44e8aef5-a65d-405c-b6cc-076ae7001001`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:32:41,797::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:41,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0175645 s, 58.3 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:32:43,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`23602207-d42e-418f-98a2-d6d88cf182b2`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:32:43,732::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:32:43,732::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:43,732::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:32:43,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:43,732::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:43,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:43,732::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:43,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:43,733::__init__::225::IOProcess::(_processLogs) (541430) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:32:43,733::__init__::225::IOProcess::(_processLogs) (541430) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:32:43,734::__init__::225::IOProcess::(_processLogs) DEBUG|(541430) Building response >Thread-19::DEBUG::2014-08-11 17:32:43,734::__init__::225::IOProcess::(_processLogs) (541430) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:43,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:43,734::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:32:43,734::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:43,734::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:32:43,735::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-10102::INFO::2014-08-11 17:32:43,735::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:32:43,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:32:43,735::task::1191::Storage.TaskManager.Task::(prepare) Task=`23602207-d42e-418f-98a2-d6d88cf182b2`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:32:43,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:32:43,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`23602207-d42e-418f-98a2-d6d88cf182b2`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:32:43,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:32:43,736::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:32:43,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:32:43,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:32:43,737::__init__::225::IOProcess::(_processLogs) (541431) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:32:43,737::task::993::Storage.TaskManager.Task::(_decref) Task=`23602207-d42e-418f-98a2-d6d88cf182b2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:32:43,738::__init__::225::IOProcess::(_processLogs) (541431) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:32:43,738::__init__::225::IOProcess::(_processLogs) (541431) Building response >Thread-19::DEBUG::2014-08-11 17:32:43,739::__init__::225::IOProcess::(_processLogs) (541431) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:43,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:43,741::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:32:43,760::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:32:43,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:44,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0616451 s, 16.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:44,204::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) (541432) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:44,205::__init__::225::IOProcess::(_processLogs) (541432) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:44,221::__init__::225::IOProcess::(_processLogs) DEBUG|(541432) Building response >Thread-19::DEBUG::2014-08-11 17:32:44,221::__init__::225::IOProcess::(_processLogs) (541432) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:44,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:44,221::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:32:44,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:32:44,287::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00592495 s, 83.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:44,287::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) (541433) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:44,288::__init__::225::IOProcess::(_processLogs) (541433) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:44,289::__init__::225::IOProcess::(_processLogs) (541433) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:44,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:44,290::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:44,290::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:32:44,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) (541434) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) (541434) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) (541434) Building response >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) (541434) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:44,291::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) (541435) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) (541435) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) (541435) Building response >Thread-19::DEBUG::2014-08-11 17:32:44,292::__init__::225::IOProcess::(_processLogs) (541435) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) (541436) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:44,293::__init__::225::IOProcess::(_processLogs) (541436) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:44,298::__init__::225::IOProcess::(_processLogs) (541436) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:44,298::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:45,288::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:45,288::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:45,289::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:45,355::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:45,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:45,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:46,020::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:46,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012109 s, 84.6 MB/s\n'; <rc> = 0 >Thread-10234::DEBUG::2014-08-11 17:32:46,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bbeb1f8-6d4e-44ae-895d-135a3218273a`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:46,502::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10234::INFO::2014-08-11 17:32:46,502::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146419', 'lastCheck': '6.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00592495', 'lastCheck': '2.2', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:32:46,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`8bbeb1f8-6d4e-44ae-895d-135a3218273a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146419', 'lastCheck': '6.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00592495', 'lastCheck': '2.2', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:32:46,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`8bbeb1f8-6d4e-44ae-895d-135a3218273a`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:46,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:46,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:46,502::task::993::Storage.TaskManager.Task::(_decref) Task=`8bbeb1f8-6d4e-44ae-895d-135a3218273a`::ref 0 aborting False >Thread-10234::DEBUG::2014-08-11 17:32:46,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:32:46,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:48,099::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:48,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0181861 s, 56.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:32:49,289::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:32:50,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:32:50,290::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:50,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:50,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:50,296::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348347 s, 29.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:50,356::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:50,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:50,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:50,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) (541437) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) (541437) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541437) Building response >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) (541437) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:50,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:50,358::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:32:50,358::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:50,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:50,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:32:50,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000903577 s, 405 kB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:50,418::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:32:50,420::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) (541438) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:50,421::__init__::225::IOProcess::(_processLogs) (541438) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:50,422::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541438) Building response >Thread-19::DEBUG::2014-08-11 17:32:50,422::__init__::225::IOProcess::(_processLogs) (541438) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:50,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:50,423::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10234::DEBUG::2014-08-11 17:32:51,279::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10234::DEBUG::2014-08-11 17:32:51,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`339ddbbf-577e-43ce-a1af-46e6e3b0a7fe`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:32:51,279::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10234::INFO::2014-08-11 17:32:51,340::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:51,340::task::1191::Storage.TaskManager.Task::(prepare) Task=`339ddbbf-577e-43ce-a1af-46e6e3b0a7fe`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:32:51,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`339ddbbf-577e-43ce-a1af-46e6e3b0a7fe`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:32:51,340::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:32:51,340::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:32:51,340::task::993::Storage.TaskManager.Task::(_decref) Task=`339ddbbf-577e-43ce-a1af-46e6e3b0a7fe`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:32:51,348::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:32:51,348::task::595::Storage.TaskManager.Task::(_updateState) Task=`d036ae5c-fe0e-4971-8d9e-344204f4b8d3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:32:51,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:32:51,348::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4cfa59ac-c5b3-45fc-9404-9f2674338559`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:32:51,348::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:32:51,348::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:32:51,349::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4cfa59ac-c5b3-45fc-9404-9f2674338559`::Granted request >Thread-10197::DEBUG::2014-08-11 17:32:51,349::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d036ae5c-fe0e-4971-8d9e-344204f4b8d3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:32:51,349::task::993::Storage.TaskManager.Task::(_decref) Task=`d036ae5c-fe0e-4971-8d9e-344204f4b8d3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:32:51,365::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:51,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`d036ae5c-fe0e-4971-8d9e-344204f4b8d3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:32:51,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`d036ae5c-fe0e-4971-8d9e-344204f4b8d3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:32:51,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:32:51,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:32:51,366::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:32:51,366::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:32:51,366::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:32:51,366::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:32:51,366::task::993::Storage.TaskManager.Task::(_decref) Task=`d036ae5c-fe0e-4971-8d9e-344204f4b8d3`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:32:52,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:52,376::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012355 s, 82.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:32:53,749::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) (541439) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:54,299::__init__::225::IOProcess::(_processLogs) (541439) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:54,301::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541439) Building response >Thread-19::DEBUG::2014-08-11 17:32:54,301::__init__::225::IOProcess::(_processLogs) (541439) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:54,301::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:54,301::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:32:54,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:32:54,364::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000739668 s, 669 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:54,365::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:32:54,366::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:54,367::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:54,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:54,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:54,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:54,371::__init__::225::IOProcess::(_processLogs) (541440) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:32:54,372::__init__::225::IOProcess::(_processLogs) (541440) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:32:54,373::__init__::225::IOProcess::(_processLogs) (541440) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:54,374::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:54,375::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:32:54,377::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:32:54,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:54,378::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:54,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:54,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:54,381::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:54,382::__init__::225::IOProcess::(_processLogs) (541441) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:54,383::__init__::225::IOProcess::(_processLogs) (541441) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:54,384::__init__::225::IOProcess::(_processLogs) (541441) Building response >Dummy-51::DEBUG::2014-08-11 17:32:54,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:32:54,385::__init__::225::IOProcess::(_processLogs) (541441) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:54,446::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:54,447::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:32:54,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:54,449::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:54,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:32:54,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:54,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:54,453::__init__::225::IOProcess::(_processLogs) (541442) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:54,454::__init__::225::IOProcess::(_processLogs) (541442) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:54,456::__init__::225::IOProcess::(_processLogs) (541442) Building response >Thread-19::DEBUG::2014-08-11 17:32:54,457::__init__::225::IOProcess::(_processLogs) (541442) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:54,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:54,460::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:32:54,461::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:32:54,463::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:32:54,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:32:54,465::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:32:54,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Dummy-51::DEBUG::2014-08-11 17:32:54,467::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0209779 s, 48.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:32:54,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:32:54,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:32:54,470::__init__::225::IOProcess::(_processLogs) (541443) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:32:54,471::__init__::225::IOProcess::(_processLogs) (541443) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:32:54,473::__init__::225::IOProcess::(_processLogs) (541443) Building response >Thread-19::DEBUG::2014-08-11 17:32:54,474::__init__::225::IOProcess::(_processLogs) (541443) Queuing response >Thread-19::DEBUG::2014-08-11 17:32:54,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:32:54,476::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:32:55,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:55,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:32:55,296::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:55,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:55,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:32:55,423::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:32:56,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:56,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.047936 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:32:58,663::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:32:58,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0402572 s, 25.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:32:58,768::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:33:00,300::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:00,300::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:00,301::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:00,423::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:00,423::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:00,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:00,423::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:00,424::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-27::DEBUG::2014-08-11 17:33:00,424::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:33:00,425::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:00,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-27::DEBUG::2014-08-11 17:33:00,485::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000362151 s, 1.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:00,485::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:00,485::__init__::225::IOProcess::(_processLogs) (541444) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:00,487::__init__::225::IOProcess::(_processLogs) (541444) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:00,487::__init__::225::IOProcess::(_processLogs) (541444) Building response >Thread-19::DEBUG::2014-08-11 17:33:00,488::__init__::225::IOProcess::(_processLogs) (541444) Queuing response >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:00,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:00,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:00,489::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:00,490::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:00,491::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:00,491::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) (541445) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:00,492::__init__::225::IOProcess::(_processLogs) (541445) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:00,493::__init__::225::IOProcess::(_processLogs) DEBUG|(541445) Building response >Thread-19::DEBUG::2014-08-11 17:33:00,493::__init__::225::IOProcess::(_processLogs) (541445) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:00,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:00,494::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:33:00,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:00,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196493 s, 52.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:33:01,300::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10234::DEBUG::2014-08-11 17:33:01,454::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10234::DEBUG::2014-08-11 17:33:01,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3beb4fa-20f7-4778-93d7-6017bc1f7745`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:33:01,454::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10234::INFO::2014-08-11 17:33:01,518::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:33:01,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3beb4fa-20f7-4778-93d7-6017bc1f7745`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:33:01,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3beb4fa-20f7-4778-93d7-6017bc1f7745`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:33:01,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:33:01,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:33:01,518::task::993::Storage.TaskManager.Task::(_decref) Task=`a3beb4fa-20f7-4778-93d7-6017bc1f7745`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:33:01,525::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:33:01,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bf0fa7f-801c-493a-a4e7-46144699afb9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:33:01,525::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:33:01,525::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e90735c2-2d28-430d-b81b-1777fc61bfbe`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:33:01,525::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:33:01,526::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:33:01,526::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e90735c2-2d28-430d-b81b-1777fc61bfbe`::Granted request >Thread-10197::DEBUG::2014-08-11 17:33:01,526::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9bf0fa7f-801c-493a-a4e7-46144699afb9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:33:01,526::task::993::Storage.TaskManager.Task::(_decref) Task=`9bf0fa7f-801c-493a-a4e7-46144699afb9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:33:01,546::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:01,546::task::1191::Storage.TaskManager.Task::(prepare) Task=`9bf0fa7f-801c-493a-a4e7-46144699afb9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:01,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bf0fa7f-801c-493a-a4e7-46144699afb9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:33:01,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:33:01,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:33:01,546::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:33:01,546::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:33:01,546::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:33:01,546::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:33:01,546::task::993::Storage.TaskManager.Task::(_decref) Task=`9bf0fa7f-801c-493a-a4e7-46144699afb9`::ref 0 aborting False >Thread-10234::DEBUG::2014-08-11 17:33:02,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cea5d97-5f68-452f-bb9f-8c8d063c241b`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:33:02,448::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10234::INFO::2014-08-11 17:33:02,448::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362151', 'lastCheck': '2.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739668', 'lastCheck': '8.0', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:33:02,449::task::1191::Storage.TaskManager.Task::(prepare) Task=`1cea5d97-5f68-452f-bb9f-8c8d063c241b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362151', 'lastCheck': '2.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000739668', 'lastCheck': '8.0', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:33:02,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`1cea5d97-5f68-452f-bb9f-8c8d063c241b`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:33:02,450::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:33:02,450::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:33:02,451::task::993::Storage.TaskManager.Task::(_decref) Task=`1cea5d97-5f68-452f-bb9f-8c8d063c241b`::ref 0 aborting False >Thread-10234::DEBUG::2014-08-11 17:33:02,478::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10234::DEBUG::2014-08-11 17:33:02,480::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:02,857::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:02,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0514732 s, 19.9 MB/s\n'; <rc> = 0 >Thread-10234::DEBUG::2014-08-11 17:33:03,383::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmSetTicket with ('5b1ee280-4251-489a-899c-8e9dac73c327', 'UVCr/jABXSCW', '120', 'disconnect', {'userName': 'admin', 'userId': 'fdfc627c-d875-11e0-90f0-83df133b58cc'}) {} flowID [f91a44b] >Thread-10234::DEBUG::2014-08-11 17:33:03,391::BindingXMLRPC::1134::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-28::DEBUG::2014-08-11 17:33:04,479::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:33:04,480::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,480::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:33:04,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,480::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,481::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,481::__init__::225::IOProcess::(_processLogs) (541446) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:33:04,481::__init__::225::IOProcess::(_processLogs) (541446) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:33:04,481::__init__::225::IOProcess::(_processLogs) DEBUG|(541446) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,482::__init__::225::IOProcess::(_processLogs) (541446) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,483::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:33:04,484::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,485::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:33:04,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,489::__init__::225::IOProcess::(_processLogs) DEBUG|(541447) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:33:04,490::__init__::225::IOProcess::(_processLogs) (541447) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:33:04,491::__init__::225::IOProcess::(_processLogs) (541447) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,492::__init__::225::IOProcess::(_processLogs) (541447) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,492::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,493::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:33:04,495::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:33:04,495::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,495::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:33:04,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,495::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,496::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,496::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,496::__init__::225::IOProcess::(_processLogs) (541448) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:33:04,496::__init__::225::IOProcess::(_processLogs) (541448) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:33:04,504::__init__::225::IOProcess::(_processLogs) DEBUG|(541448) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,504::__init__::225::IOProcess::(_processLogs) (541448) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,504::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:33:04,505::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:33:04,505::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:04,505::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) (541449) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:33:04,506::__init__::225::IOProcess::(_processLogs) (541449) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:33:04,508::__init__::225::IOProcess::(_processLogs) DEBUG|(541449) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,508::__init__::225::IOProcess::(_processLogs) (541449) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,508::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:33:04,509::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:33:04,509::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:33:04,510::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,510::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:33:04,510::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,510::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) (541450) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) (541450) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) (541450) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) (541450) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,511::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) (541451) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) (541451) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) DEBUG|(541451) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,512::__init__::225::IOProcess::(_processLogs) (541451) Queuing response >Thread-28::DEBUG::2014-08-11 17:33:04,513::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:33:04,513::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::INFO::2014-08-11 17:33:04,513::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:33:04,513::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-28::INFO::2014-08-11 17:33:04,514::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:33:04,514::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,514::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:04,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,514::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,515::__init__::225::IOProcess::(_processLogs) (541452) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:04,515::__init__::225::IOProcess::(_processLogs) (541452) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:04,515::__init__::225::IOProcess::(_processLogs) DEBUG|(541452) Building response >Thread-28::DEBUG::2014-08-11 17:33:04,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:33:04,516::__init__::225::IOProcess::(_processLogs) (541452) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,574::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,576::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:33:04,577::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00113483 s, 436 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:04,578::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:04,579::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:04,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,580::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,581::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,582::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,583::__init__::225::IOProcess::(_processLogs) (541453) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:04,583::__init__::225::IOProcess::(_processLogs) (541453) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:04,584::__init__::225::IOProcess::(_processLogs) (541453) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,584::__init__::225::IOProcess::(_processLogs) (541453) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,585::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,585::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:04,586::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:33:04,587::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,588::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,588::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,590::__init__::225::IOProcess::(_processLogs) (541454) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:04,590::__init__::225::IOProcess::(_processLogs) (541454) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:04,591::__init__::225::IOProcess::(_processLogs) (541454) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,591::__init__::225::IOProcess::(_processLogs) (541454) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,592::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,592::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:04,593::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:33:04,594::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,594::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,596::__init__::225::IOProcess::(_processLogs) (541455) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:04,597::__init__::225::IOProcess::(_processLogs) (541455) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:04,597::__init__::225::IOProcess::(_processLogs) (541455) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,598::__init__::225::IOProcess::(_processLogs) (541455) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,599::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:04,600::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:33:04,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:04,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:04,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:04,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:04,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:04,603::__init__::225::IOProcess::(_processLogs) (541456) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:04,604::__init__::225::IOProcess::(_processLogs) (541456) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:04,604::__init__::225::IOProcess::(_processLogs) (541456) Building response >Thread-19::DEBUG::2014-08-11 17:33:04,605::__init__::225::IOProcess::(_processLogs) (541456) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:04,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:04,606::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:33:04,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:05,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0498204 s, 20.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:05,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:05,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:05,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:05,497::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:05,498::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:05,499::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:07,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:07,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521299 s, 19.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:33:08,757::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:33:09,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:09,299::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0232121 s, 44.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:10,313::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:10,314::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:10,314::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:10,494::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:10,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:10,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:10,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:10,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:10,495::__init__::225::IOProcess::(_processLogs) (541457) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:10,495::__init__::225::IOProcess::(_processLogs) (541457) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:10,495::__init__::225::IOProcess::(_processLogs) (541457) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:10,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:33:10,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:10,639::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:33:10,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00131511 s, 278 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:10,642::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:10,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:10,646::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:10,646::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:10,646::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:10,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:10,648::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:10,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:10,648::__init__::225::IOProcess::(_processLogs) (541458) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:10,649::__init__::225::IOProcess::(_processLogs) (541458) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:10,650::__init__::225::IOProcess::(_processLogs) (541458) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:10,651::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:10,651::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:33:11,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:11,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601015 s, 17.0 MB/s\n'; <rc> = 0 >Thread-10234::DEBUG::2014-08-11 17:33:11,600::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10234::DEBUG::2014-08-11 17:33:11,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6039dcd-1ea0-41af-bc20-24743508e8a6`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:33:11,601::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Detector thread::DEBUG::2014-08-11 17:33:11,621::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.1.234:57654 >Detector thread::DEBUG::2014-08-11 17:33:11,621::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.1.234:57654 >Detector thread::DEBUG::2014-08-11 17:33:11,621::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.1.234:57654 >Detector thread::DEBUG::2014-08-11 17:33:11,621::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.1.234', 57654) >Thread-10234::INFO::2014-08-11 17:33:11,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:33:11,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6039dcd-1ea0-41af-bc20-24743508e8a6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10234::DEBUG::2014-08-11 17:33:11,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6039dcd-1ea0-41af-bc20-24743508e8a6`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:33:11,664::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:33:11,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:33:11,664::task::993::Storage.TaskManager.Task::(_decref) Task=`b6039dcd-1ea0-41af-bc20-24743508e8a6`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:33:11,676::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:33:11,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`bccec294-9ba4-4f66-8b70-a1943af8f35c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:33:11,677::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:33:11,677::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9661ac7-544e-48fb-9d4c-d6ed1b615e8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:33:11,677::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:33:11,677::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:33:11,677::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d9661ac7-544e-48fb-9d4c-d6ed1b615e8e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:33:11,678::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bccec294-9ba4-4f66-8b70-a1943af8f35c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:33:11,678::task::993::Storage.TaskManager.Task::(_decref) Task=`bccec294-9ba4-4f66-8b70-a1943af8f35c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:33:11,697::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:11,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`bccec294-9ba4-4f66-8b70-a1943af8f35c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:11,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`bccec294-9ba4-4f66-8b70-a1943af8f35c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:33:11,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:33:11,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:33:11,697::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:33:11,697::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:33:11,697::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:33:11,697::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:33:11,697::task::993::Storage.TaskManager.Task::(_decref) Task=`bccec294-9ba4-4f66-8b70-a1943af8f35c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:33:13,433::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:13,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521308 s, 19.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:33:13,776::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:33:14,607::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) (541459) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) (541459) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:14,608::__init__::225::IOProcess::(_processLogs) (541459) Queuing response >Thread-28::DEBUG::2014-08-11 17:33:14,609::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:33:14,609::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:14,668::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:33:14,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00129583 s, 382 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:14,674::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:14,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:14,676::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:14,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:14,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:14,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:14,679::__init__::225::IOProcess::(_processLogs) (541460) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:14,679::__init__::225::IOProcess::(_processLogs) (541460) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:14,680::__init__::225::IOProcess::(_processLogs) (541460) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:14,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:14,682::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:14,683::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:33:14,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:14,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:14,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:14,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:14,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:14,686::__init__::225::IOProcess::(_processLogs) (541461) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:14,687::__init__::225::IOProcess::(_processLogs) (541461) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:14,687::__init__::225::IOProcess::(_processLogs) (541461) Building response >Thread-19::DEBUG::2014-08-11 17:33:14,688::__init__::225::IOProcess::(_processLogs) (541461) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:14,689::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:14,690::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:33:14,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:14,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:14,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:14,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:14,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:14,693::__init__::225::IOProcess::(_processLogs) (541462) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:14,694::__init__::225::IOProcess::(_processLogs) (541462) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:14,694::__init__::225::IOProcess::(_processLogs) (541462) Building response >Thread-19::DEBUG::2014-08-11 17:33:14,695::__init__::225::IOProcess::(_processLogs) (541462) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:14,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:14,696::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:14,697::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:33:14,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:14,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:14,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:14,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:14,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:14,700::__init__::225::IOProcess::(_processLogs) (541463) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:14,701::__init__::225::IOProcess::(_processLogs) (541463) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:14,701::__init__::225::IOProcess::(_processLogs) (541463) Building response >Thread-19::DEBUG::2014-08-11 17:33:14,702::__init__::225::IOProcess::(_processLogs) (541463) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:14,702::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-vm::DEBUG::2014-08-11 17:33:15,320::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:15,320::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:15,320::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:15,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:15,656::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:15,656::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:15,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:15,668::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.05651 s, 18.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:33:17,676::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:33:17,738::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmSetTicket with ('de580b19-e975-426f-80de-6c7daf1f24ab', 'U5TeM7wKpv4h', '120', 'disconnect', {'userName': 'admin', 'userId': 'fdfc627c-d875-11e0-90f0-83df133b58cc'}) {} flowID [d9573e1] >Thread-10234::DEBUG::2014-08-11 17:33:17,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`d992eb1f-4c19-47a7-94b9-0b0ce9eca0a3`::moving from state init -> state preparing >Thread-10234::INFO::2014-08-11 17:33:17,739::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10234::INFO::2014-08-11 17:33:17,740::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131511', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129583', 'lastCheck': '3.0', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:33:17,742::task::1191::Storage.TaskManager.Task::(prepare) Task=`d992eb1f-4c19-47a7-94b9-0b0ce9eca0a3`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00131511', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00129583', 'lastCheck': '3.0', 'valid': True}} >Thread-10234::DEBUG::2014-08-11 17:33:17,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`d992eb1f-4c19-47a7-94b9-0b0ce9eca0a3`::moving from state preparing -> state finished >Thread-10234::DEBUG::2014-08-11 17:33:17,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10234::DEBUG::2014-08-11 17:33:17,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10234::DEBUG::2014-08-11 17:33:17,743::task::993::Storage.TaskManager.Task::(_decref) Task=`d992eb1f-4c19-47a7-94b9-0b0ce9eca0a3`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:33:17,759::BindingXMLRPC::1134::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-10237::DEBUG::2014-08-11 17:33:17,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:17,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368685 s, 27.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:33:17,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:33:19,371::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:33:19,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:19,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012454 s, 82.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:20,326::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:20,327::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:20,327::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:20,651::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:20,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:20,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:20,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:20,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:20,652::__init__::225::IOProcess::(_processLogs) (541464) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:20,652::__init__::225::IOProcess::(_processLogs) (541464) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:20,653::__init__::225::IOProcess::(_processLogs) (541464) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:20,653::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:33:20,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:20,711::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:20,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:20,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:33:20,713::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000612376 s, 598 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) (541465) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:20,714::__init__::225::IOProcess::(_processLogs) (541465) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:20,716::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(541465) Building response >Thread-19::DEBUG::2014-08-11 17:33:20,716::__init__::225::IOProcess::(_processLogs) (541465) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:20,717::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:33:20,717::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:33:21,741::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:33:21,741::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e6f49a4-5f92-4e12-a019-bbcdbaa3c5f5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:33:21,741::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:33:21,755::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:21,755::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e6f49a4-5f92-4e12-a019-bbcdbaa3c5f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:21,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e6f49a4-5f92-4e12-a019-bbcdbaa3c5f5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:33:21,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:33:21,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:33:21,755::task::993::Storage.TaskManager.Task::(_decref) Task=`2e6f49a4-5f92-4e12-a019-bbcdbaa3c5f5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:33:21,762::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:33:21,762::task::595::Storage.TaskManager.Task::(_updateState) Task=`71c8830a-25b5-4ed4-b535-e174a8219fc7`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:33:21,762::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:33:21,763::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b0e87603-05e4-4965-980c-2fe72a7ba8e1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:33:21,763::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:33:21,763::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:33:21,763::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b0e87603-05e4-4965-980c-2fe72a7ba8e1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:33:21,763::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`71c8830a-25b5-4ed4-b535-e174a8219fc7`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:33:21,763::task::993::Storage.TaskManager.Task::(_decref) Task=`71c8830a-25b5-4ed4-b535-e174a8219fc7`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:33:21,781::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:21,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`71c8830a-25b5-4ed4-b535-e174a8219fc7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:21,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`71c8830a-25b5-4ed4-b535-e174a8219fc7`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:33:21,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:33:21,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:33:21,781::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:33:21,781::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:33:21,781::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:33:21,781::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:33:21,782::task::993::Storage.TaskManager.Task::(_decref) Task=`71c8830a-25b5-4ed4-b535-e174a8219fc7`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:33:21,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:21,997::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513506 s, 19.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:33:23,778::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e0f8d26-6a54-42b8-a542-d314ebe91eeb`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:33:23,779::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:33:23,779::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:23,779::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:33:23,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:23,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:23,779::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:23,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:23,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:23,780::__init__::225::IOProcess::(_processLogs) (541466) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:33:23,780::__init__::225::IOProcess::(_processLogs) (541466) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:33:23,784::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(541466) Building response >Thread-19::DEBUG::2014-08-11 17:33:23,784::__init__::225::IOProcess::(_processLogs) (541466) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:23,784::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:23,785::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:33:23,785::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:23,785::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:33:23,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:23,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:23,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:23,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:33:23,786::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:33:23,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:33:23,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e0f8d26-6a54-42b8-a542-d314ebe91eeb`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:33:23,787::__init__::225::IOProcess::(_processLogs) (541467) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:33:23,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e0f8d26-6a54-42b8-a542-d314ebe91eeb`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:33:23,787::__init__::225::IOProcess::(_processLogs) (541467) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:33:23,787::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:33:23,788::__init__::225::IOProcess::(_processLogs) (541467) Building response >Thread-10017::DEBUG::2014-08-11 17:33:23,788::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:33:23,788::__init__::225::IOProcess::(_processLogs) (541467) Queuing response >Thread-10017::DEBUG::2014-08-11 17:33:23,789::task::993::Storage.TaskManager.Task::(_decref) Task=`3e0f8d26-6a54-42b8-a542-d314ebe91eeb`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:33:23,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:23,789::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:33:23,809::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:33:24,005::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:24,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121801 s, 84.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:24,704::__init__::225::IOProcess::(_processLogs) (541468) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:24,705::__init__::225::IOProcess::(_processLogs) (541468) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:24,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541468) Building response >Thread-19::DEBUG::2014-08-11 17:33:24,706::__init__::225::IOProcess::(_processLogs) (541468) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:24,706::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:24,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:33:24,707::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:33:24,773::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00154574 s, 320 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:24,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:24,775::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:24,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:24,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:24,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:24,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:24,778::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:24,778::__init__::225::IOProcess::(_processLogs) (541469) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:24,779::__init__::225::IOProcess::(_processLogs) (541469) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:24,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541469) Building response >Thread-19::DEBUG::2014-08-11 17:33:24,781::__init__::225::IOProcess::(_processLogs) (541469) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:24,781::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:24,782::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:24,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:24,783::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:33:24,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:24,784::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:24,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:24,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:24,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:24,786::__init__::225::IOProcess::(_processLogs) (541470) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:24,787::__init__::225::IOProcess::(_processLogs) (541470) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:24,787::__init__::225::IOProcess::(_processLogs) (541470) Building response >Thread-19::DEBUG::2014-08-11 17:33:24,788::__init__::225::IOProcess::(_processLogs) (541470) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:24,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:24,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:24,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:24,791::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:33:24,791::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:24,792::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:24,792::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:24,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:24,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:24,794::__init__::225::IOProcess::(_processLogs) (541471) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:24,795::__init__::225::IOProcess::(_processLogs) (541471) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:24,796::__init__::225::IOProcess::(_processLogs) (541471) Building response >Thread-19::DEBUG::2014-08-11 17:33:24,796::__init__::225::IOProcess::(_processLogs) (541471) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:24,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:24,797::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:24,798::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:33:24,798::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:24,799::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:24,799::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:24,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:24,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:24,801::__init__::225::IOProcess::(_processLogs) (541472) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:24,802::__init__::225::IOProcess::(_processLogs) (541472) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:24,803::__init__::225::IOProcess::(_processLogs) (541472) Building response >Thread-19::DEBUG::2014-08-11 17:33:24,803::__init__::225::IOProcess::(_processLogs) (541472) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:24,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:24,804::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:25,333::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:25,333::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:25,334::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:25,715::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:25,716::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:25,716::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:26,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:26,191::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0478397 s, 21.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:33:28,199::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:28,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765599 s, 13.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:33:28,785::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:33:30,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:30,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:30,340::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:30,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:30,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0244754 s, 41.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:30,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:30,719::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:30,719::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:30,720::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:30,720::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:30,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:30,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:30,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:30,723::__init__::225::IOProcess::(_processLogs) (541473) Got request for method 'statvfs' >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:30,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:33:30,724::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:33:30,724::__init__::225::IOProcess::(_processLogs) (541473) Building response >Thread-19::DEBUG::2014-08-11 17:33:30,784::__init__::225::IOProcess::(_processLogs) (541473) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:30,785::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:30,785::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:33:30,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000945294 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:30,786::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:30,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:30,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:30,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:30,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:30,787::__init__::225::IOProcess::(_processLogs) (541474) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:30,787::__init__::225::IOProcess::(_processLogs) (541474) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:30,787::__init__::225::IOProcess::(_processLogs) (541474) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:30,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:30,788::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:33:31,402::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10237::DEBUG::2014-08-11 17:33:31,837::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:33:31,838::task::595::Storage.TaskManager.Task::(_updateState) Task=`3840ea83-babc-4753-b267-c28d62bdff9a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:33:31,839::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:33:31,893::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:31,893::task::1191::Storage.TaskManager.Task::(prepare) Task=`3840ea83-babc-4753-b267-c28d62bdff9a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:31,894::task::595::Storage.TaskManager.Task::(_updateState) Task=`3840ea83-babc-4753-b267-c28d62bdff9a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:33:31,894::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:33:31,894::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:33:31,895::task::993::Storage.TaskManager.Task::(_decref) Task=`3840ea83-babc-4753-b267-c28d62bdff9a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:33:31,906::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:33:31,907::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7215c5c-157a-4055-8a11-63b3137017f5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:33:31,907::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:33:31,908::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a3d899a7-17d8-472b-9d9a-edd17c7e67bd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:33:31,909::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:33:31,909::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:33:31,910::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a3d899a7-17d8-472b-9d9a-edd17c7e67bd`::Granted request >Thread-10197::DEBUG::2014-08-11 17:33:31,911::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f7215c5c-157a-4055-8a11-63b3137017f5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:33:31,911::task::993::Storage.TaskManager.Task::(_decref) Task=`f7215c5c-157a-4055-8a11-63b3137017f5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:33:31,942::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:31,942::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7215c5c-157a-4055-8a11-63b3137017f5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:31,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7215c5c-157a-4055-8a11-63b3137017f5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:33:31,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:33:31,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:33:31,944::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:33:31,945::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:33:31,945::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:33:31,945::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:33:31,946::task::993::Storage.TaskManager.Task::(_decref) Task=`f7215c5c-157a-4055-8a11-63b3137017f5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:33:32,434::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:32,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0185127 s, 55.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:33:33,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a9f3122-0cd7-4c44-ad4d-dc9d5dede52a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:33:33,099::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:33:33,100::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945294', 'lastCheck': '2.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154574', 'lastCheck': '8.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:33:33,100::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a9f3122-0cd7-4c44-ad4d-dc9d5dede52a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945294', 'lastCheck': '2.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154574', 'lastCheck': '8.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:33:33,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a9f3122-0cd7-4c44-ad4d-dc9d5dede52a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:33:33,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:33:33,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:33:33,100::task::993::Storage.TaskManager.Task::(_decref) Task=`7a9f3122-0cd7-4c44-ad4d-dc9d5dede52a`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:33:33,313::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:33:33,314::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:34,580::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:34,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0575042 s, 17.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) (541475) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:34,804::__init__::225::IOProcess::(_processLogs) (541475) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:34,805::__init__::225::IOProcess::(_processLogs) DEBUG|(541475) Building response >Thread-19::DEBUG::2014-08-11 17:33:34,805::__init__::225::IOProcess::(_processLogs) (541475) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:34,805::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:34,806::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:33:34,806::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:33:34,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00144669 s, 342 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:34,869::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:34,869::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:34,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:34,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:34,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:34,872::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:34,873::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:34,874::__init__::225::IOProcess::(_processLogs) (541476) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:34,874::__init__::225::IOProcess::(_processLogs) (541476) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:34,875::__init__::225::IOProcess::(_processLogs) (541476) Building response >Thread-19::DEBUG::2014-08-11 17:33:34,875::__init__::225::IOProcess::(_processLogs) (541476) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:34,876::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:34,876::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:34,877::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:34,877::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:33:34,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:34,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:34,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:34,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:34,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:34,881::__init__::225::IOProcess::(_processLogs) (541477) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:34,881::__init__::225::IOProcess::(_processLogs) (541477) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:34,882::__init__::225::IOProcess::(_processLogs) (541477) Building response >Thread-19::DEBUG::2014-08-11 17:33:34,882::__init__::225::IOProcess::(_processLogs) (541477) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:34,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:34,883::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:34,885::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:34,885::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:33:34,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:34,886::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:34,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:34,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:34,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:34,888::__init__::225::IOProcess::(_processLogs) (541478) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:34,889::__init__::225::IOProcess::(_processLogs) (541478) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:34,889::__init__::225::IOProcess::(_processLogs) (541478) Building response >Thread-19::DEBUG::2014-08-11 17:33:34,890::__init__::225::IOProcess::(_processLogs) (541478) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:34,890::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:34,891::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:34,892::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:34,893::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:33:34,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:34,894::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:34,894::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:34,895::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:34,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:34,896::__init__::225::IOProcess::(_processLogs) (541479) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:34,896::__init__::225::IOProcess::(_processLogs) (541479) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:34,897::__init__::225::IOProcess::(_processLogs) (541479) Building response >Thread-19::DEBUG::2014-08-11 17:33:34,897::__init__::225::IOProcess::(_processLogs) (541479) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:34,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:34,898::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:35,341::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:35,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:35,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:35,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:35,790::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:35,791::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:36,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:36,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0731332 s, 14.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:33:38,817::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:33:38,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:38,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0149271 s, 68.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:40,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:40,346::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:40,346::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:40,788::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:40,788::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) (541480) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) (541480) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) DEBUG|(541480) Building response >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) (541480) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:40,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:40,790::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:33:40,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:40,849::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:33:40,850::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000592831 s, 617 kB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:40,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:40,852::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:40,852::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:40,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:40,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:40,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:40,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:40,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:40,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:40,855::__init__::225::IOProcess::(_processLogs) (541481) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:40,855::__init__::225::IOProcess::(_processLogs) (541481) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:40,855::__init__::225::IOProcess::(_processLogs) DEBUG|(541481) Building response >Thread-19::DEBUG::2014-08-11 17:33:40,856::__init__::225::IOProcess::(_processLogs) (541481) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:40,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:40,856::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:33:40,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:41,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127333 s, 80.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:33:42,000::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:33:42,000::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf7c5c76-ebc1-4396-bd11-0df2677b43e5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:33:42,000::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:33:42,019::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:42,019::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf7c5c76-ebc1-4396-bd11-0df2677b43e5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:42,019::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf7c5c76-ebc1-4396-bd11-0df2677b43e5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:33:42,019::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:33:42,019::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:33:42,019::task::993::Storage.TaskManager.Task::(_decref) Task=`bf7c5c76-ebc1-4396-bd11-0df2677b43e5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:33:42,029::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:33:42,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac9b7c63-8c63-400c-9c86-bfca5ffab496`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:33:42,029::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:33:42,029::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1b30dc9b-e33e-412b-8c72-36bd7128ec80`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:33:42,029::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:33:42,030::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:33:42,030::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1b30dc9b-e33e-412b-8c72-36bd7128ec80`::Granted request >Thread-10197::DEBUG::2014-08-11 17:33:42,030::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac9b7c63-8c63-400c-9c86-bfca5ffab496`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:33:42,030::task::993::Storage.TaskManager.Task::(_decref) Task=`ac9b7c63-8c63-400c-9c86-bfca5ffab496`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:33:42,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:42,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac9b7c63-8c63-400c-9c86-bfca5ffab496`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:42,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac9b7c63-8c63-400c-9c86-bfca5ffab496`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:33:42,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:33:42,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:33:42,048::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:33:42,048::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:33:42,048::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:33:42,048::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:33:42,048::task::993::Storage.TaskManager.Task::(_decref) Task=`ac9b7c63-8c63-400c-9c86-bfca5ffab496`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:33:43,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:43,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.063307 s, 16.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:33:43,787::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4539a24-7cfd-478a-b351-3ed168bb218f`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:33:43,787::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) (541482) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:33:43,788::__init__::225::IOProcess::(_processLogs) (541482) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:33:43,789::__init__::225::IOProcess::(_processLogs) DEBUG|(541482) Building response >Thread-19::DEBUG::2014-08-11 17:33:43,789::__init__::225::IOProcess::(_processLogs) (541482) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:43,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:43,789::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:33:43,789::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:43,789::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:33:43,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:43,790::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10102::INFO::2014-08-11 17:33:43,790::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:33:43,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:33:43,791::task::1191::Storage.TaskManager.Task::(prepare) Task=`d4539a24-7cfd-478a-b351-3ed168bb218f`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:33:43,791::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:33:43,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`d4539a24-7cfd-478a-b351-3ed168bb218f`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:33:43,791::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:33:43,792::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:33:43,792::__init__::225::IOProcess::(_processLogs) (541483) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:33:43,792::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:33:43,792::__init__::225::IOProcess::(_processLogs) (541483) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:33:43,793::task::993::Storage.TaskManager.Task::(_decref) Task=`d4539a24-7cfd-478a-b351-3ed168bb218f`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:33:43,793::__init__::225::IOProcess::(_processLogs) (541483) Building response >Thread-19::DEBUG::2014-08-11 17:33:43,793::__init__::225::IOProcess::(_processLogs) (541483) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:43,793::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:43,793::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:33:43,814::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) (541484) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:44,900::__init__::225::IOProcess::(_processLogs) (541484) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:44,901::__init__::225::IOProcess::(_processLogs) DEBUG|(541484) Building response >Thread-19::DEBUG::2014-08-11 17:33:44,901::__init__::225::IOProcess::(_processLogs) (541484) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:44,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:44,901::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:33:44,902::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:33:44,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00118832 s, 417 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:44,964::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:44,964::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:44,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:44,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:44,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:44,967::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:44,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:44,968::__init__::225::IOProcess::(_processLogs) (541485) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:44,969::__init__::225::IOProcess::(_processLogs) (541485) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:44,969::__init__::225::IOProcess::(_processLogs) (541485) Building response >Thread-19::DEBUG::2014-08-11 17:33:44,970::__init__::225::IOProcess::(_processLogs) (541485) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:44,970::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:44,971::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:44,972::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:44,972::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:33:44,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:44,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:44,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:44,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:44,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:44,975::__init__::225::IOProcess::(_processLogs) (541486) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:44,976::__init__::225::IOProcess::(_processLogs) (541486) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:44,977::__init__::225::IOProcess::(_processLogs) (541486) Building response >Thread-19::DEBUG::2014-08-11 17:33:44,977::__init__::225::IOProcess::(_processLogs) (541486) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:44,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:44,978::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:44,979::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:44,980::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:33:44,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:44,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:44,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:44,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:44,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:44,983::__init__::225::IOProcess::(_processLogs) (541487) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:44,984::__init__::225::IOProcess::(_processLogs) (541487) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:44,984::__init__::225::IOProcess::(_processLogs) (541487) Building response >Thread-19::DEBUG::2014-08-11 17:33:44,985::__init__::225::IOProcess::(_processLogs) (541487) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:44,986::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:33:44,986::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:44,987::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:44,988::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:33:44,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:44,989::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:44,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:44,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:44,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:44,991::__init__::225::IOProcess::(_processLogs) DEBUG|(541488) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:44,992::__init__::225::IOProcess::(_processLogs) (541488) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:44,993::__init__::225::IOProcess::(_processLogs) (541488) Building response >Thread-19::DEBUG::2014-08-11 17:33:44,993::__init__::225::IOProcess::(_processLogs) (541488) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:44,994::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:44,994::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:33:45,145::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:45,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505628 s, 20.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:45,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:45,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:45,353::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:45,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:45,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:45,860::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:47,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:47,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423715 s, 24.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:33:48,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0a945ae-ad75-4710-ac92-118546307967`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:33:48,485::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:33:48,485::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592831', 'lastCheck': '7.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118832', 'lastCheck': '3.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:33:48,485::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0a945ae-ad75-4710-ac92-118546307967`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000592831', 'lastCheck': '7.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00118832', 'lastCheck': '3.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:33:48,486::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0a945ae-ad75-4710-ac92-118546307967`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:33:48,486::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:33:48,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:33:48,486::task::993::Storage.TaskManager.Task::(_decref) Task=`f0a945ae-ad75-4710-ac92-118546307967`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:33:48,506::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:33:48,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:49,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >VM Channels Listener::DEBUG::2014-08-11 17:33:49,447::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:33:49,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483064 s, 21.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:50,355::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:50,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:50,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:33:50,856::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:50,856::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) (541489) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:50,857::__init__::225::IOProcess::(_processLogs) (541489) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:50,858::__init__::225::IOProcess::(_processLogs) DEBUG|(541489) Building response >Thread-19::DEBUG::2014-08-11 17:33:50,858::__init__::225::IOProcess::(_processLogs) (541489) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:50,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:50,858::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:33:50,859::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:50,918::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:50,918::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:50,919::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:33:50,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0015963 s, 229 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:50,920::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) (541490) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) (541490) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:50,921::__init__::225::IOProcess::(_processLogs) DEBUG|(541490) Building response >Thread-19::DEBUG::2014-08-11 17:33:50,922::__init__::225::IOProcess::(_processLogs) (541490) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:50,922::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:33:50,922::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:33:51,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:51,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142812 s, 71.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:33:52,080::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:33:52,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`96727593-2e08-473c-a7df-a0ecde66d74e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:33:52,080::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:33:52,094::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:52,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`96727593-2e08-473c-a7df-a0ecde66d74e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:33:52,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`96727593-2e08-473c-a7df-a0ecde66d74e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:33:52,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:33:52,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:33:52,094::task::993::Storage.TaskManager.Task::(_decref) Task=`96727593-2e08-473c-a7df-a0ecde66d74e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:33:52,105::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:33:52,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4005822-44a3-42d9-b94a-174f60a140df`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:33:52,105::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:33:52,106::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6f6bdb7f-7890-449f-9e02-9195bc4a870e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:33:52,106::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:33:52,106::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:33:52,106::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6f6bdb7f-7890-449f-9e02-9195bc4a870e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:33:52,106::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e4005822-44a3-42d9-b94a-174f60a140df`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:33:52,106::task::993::Storage.TaskManager.Task::(_decref) Task=`e4005822-44a3-42d9-b94a-174f60a140df`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:33:52,123::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:52,123::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4005822-44a3-42d9-b94a-174f60a140df`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:33:52,123::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4005822-44a3-42d9-b94a-174f60a140df`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:33:52,123::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:33:52,123::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:33:52,123::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:33:52,123::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:33:52,123::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:33:52,123::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:33:52,123::task::993::Storage.TaskManager.Task::(_decref) Task=`e4005822-44a3-42d9-b94a-174f60a140df`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:33:53,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:53,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522823 s, 19.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:33:53,838::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:33:54,992::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) (541491) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:54,993::__init__::225::IOProcess::(_processLogs) (541491) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:54,995::__init__::225::IOProcess::(_processLogs) DEBUG|(541491) Building response >Thread-19::DEBUG::2014-08-11 17:33:54,995::__init__::225::IOProcess::(_processLogs) (541491) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:54,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:54,995::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:33:54,996::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:33:55,057::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00117383 s, 422 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:33:55,058::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:55,059::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:33:55,060::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:55,060::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:55,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:55,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:55,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:55,063::__init__::225::IOProcess::(_processLogs) (541492) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:33:55,063::__init__::225::IOProcess::(_processLogs) (541492) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:33:55,064::__init__::225::IOProcess::(_processLogs) DEBUG|(541492) Building response >Thread-19::DEBUG::2014-08-11 17:33:55,065::__init__::225::IOProcess::(_processLogs) (541492) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:55,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:55,067::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:33:55,067::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:55,068::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:33:55,068::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:55,069::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:55,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:55,070::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:55,071::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:55,072::__init__::225::IOProcess::(_processLogs) (541493) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:55,072::__init__::225::IOProcess::(_processLogs) (541493) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:55,073::__init__::225::IOProcess::(_processLogs) (541493) Building response >Thread-19::DEBUG::2014-08-11 17:33:55,074::__init__::225::IOProcess::(_processLogs) (541493) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:55,074::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:55,075::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:55,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:33:55,076::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:33:55,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:55,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:55,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:55,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:55,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:55,080::__init__::225::IOProcess::(_processLogs) (541494) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:55,080::__init__::225::IOProcess::(_processLogs) (541494) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:55,081::__init__::225::IOProcess::(_processLogs) (541494) Building response >Thread-19::DEBUG::2014-08-11 17:33:55,081::__init__::225::IOProcess::(_processLogs) (541494) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:55,082::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:33:55,082::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:33:55,083::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:33:55,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:33:55,084::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:33:55,085::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:33:55,085::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:33:55,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:33:55,086::__init__::225::IOProcess::(_processLogs) (541495) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:33:55,087::__init__::225::IOProcess::(_processLogs) (541495) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:33:55,087::__init__::225::IOProcess::(_processLogs) (541495) Building response >Thread-19::DEBUG::2014-08-11 17:33:55,088::__init__::225::IOProcess::(_processLogs) (541495) Queuing response >Thread-19::DEBUG::2014-08-11 17:33:55,089::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:33:55,362::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:55,362::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:33:55,363::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:55,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:55,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473531 s, 21.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:55,923::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:55,925::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:33:55,927::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:33:57,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:33:57,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041567 s, 24.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:33:58,866::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:33:59,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:00,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0503858 s, 20.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:00,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:00,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:00,368::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:00,923::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:00,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:00,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:00,923::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:00,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:00,924::__init__::225::IOProcess::(_processLogs) (541496) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:00,924::__init__::225::IOProcess::(_processLogs) (541496) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:00,924::__init__::225::IOProcess::(_processLogs) (541496) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:00,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:34:00,924::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:00,925::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:00,985::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:34:00,985::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000891626 s, 410 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:00,987::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:00,988::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:00,988::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:00,989::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:00,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:00,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:00,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:00,991::__init__::225::IOProcess::(_processLogs) (541497) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:00,992::__init__::225::IOProcess::(_processLogs) (541497) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:00,993::__init__::225::IOProcess::(_processLogs) (541497) Building response >Thread-19::DEBUG::2014-08-11 17:34:00,993::__init__::225::IOProcess::(_processLogs) (541497) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:00,993::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:00,993::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:34:01,460::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:34:02,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:02,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379504 s, 27.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:34:02,193::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:34:02,195::task::595::Storage.TaskManager.Task::(_updateState) Task=`52527cda-0ed7-412e-85d4-9d6e5cc541fc`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:02,195::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:34:02,209::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:02,209::task::1191::Storage.TaskManager.Task::(prepare) Task=`52527cda-0ed7-412e-85d4-9d6e5cc541fc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:02,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`52527cda-0ed7-412e-85d4-9d6e5cc541fc`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:02,210::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:02,211::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:02,211::task::993::Storage.TaskManager.Task::(_decref) Task=`52527cda-0ed7-412e-85d4-9d6e5cc541fc`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:34:02,221::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:34:02,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4d6e01-2d63-4cea-ba26-cfffd4a488fb`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:34:02,222::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:34:02,224::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8b368c42-4131-462a-aea3-38d55e0ca206`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:34:02,224::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:34:02,225::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:34:02,225::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8b368c42-4131-462a-aea3-38d55e0ca206`::Granted request >Thread-10197::DEBUG::2014-08-11 17:34:02,227::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`de4d6e01-2d63-4cea-ba26-cfffd4a488fb`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:34:02,227::task::993::Storage.TaskManager.Task::(_decref) Task=`de4d6e01-2d63-4cea-ba26-cfffd4a488fb`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:34:02,258::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:02,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`de4d6e01-2d63-4cea-ba26-cfffd4a488fb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:02,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`de4d6e01-2d63-4cea-ba26-cfffd4a488fb`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:34:02,260::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:34:02,260::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:34:02,261::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:34:02,261::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:34:02,262::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:34:02,262::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:34:02,263::task::993::Storage.TaskManager.Task::(_decref) Task=`de4d6e01-2d63-4cea-ba26-cfffd4a488fb`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:34:03,645::task::595::Storage.TaskManager.Task::(_updateState) Task=`33618563-8ade-41c8-9453-b1fa772436f7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:03,645::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:34:03,645::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000891626', 'lastCheck': '2.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117383', 'lastCheck': '8.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:03,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`33618563-8ade-41c8-9453-b1fa772436f7`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000891626', 'lastCheck': '2.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00117383', 'lastCheck': '8.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:03,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`33618563-8ade-41c8-9453-b1fa772436f7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:03,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:03,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:03,646::task::993::Storage.TaskManager.Task::(_decref) Task=`33618563-8ade-41c8-9453-b1fa772436f7`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:34:03,860::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:34:03,861::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:04,211::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:04,281::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127254 s, 80.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) (541498) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:05,090::__init__::225::IOProcess::(_processLogs) (541498) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:05,091::__init__::225::IOProcess::(_processLogs) (541498) Queuing response >Thread-28::DEBUG::2014-08-11 17:34:05,091::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:05,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:05,151::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:34:05,163::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00769688 s, 64.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:05,164::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:05,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:05,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:05,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:05,167::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:05,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:05,169::__init__::225::IOProcess::(_processLogs) (541499) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:05,169::__init__::225::IOProcess::(_processLogs) (541499) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:05,170::__init__::225::IOProcess::(_processLogs) (541499) Building response >Thread-19::DEBUG::2014-08-11 17:34:05,171::__init__::225::IOProcess::(_processLogs) (541499) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:05,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:05,172::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:34:05,173::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:34:05,173::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:05,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:05,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:05,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:05,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:05,176::__init__::225::IOProcess::(_processLogs) (541500) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:05,176::__init__::225::IOProcess::(_processLogs) (541500) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:05,177::__init__::225::IOProcess::(_processLogs) (541500) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:05,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:05,179::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:05,180::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:34:05,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:05,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:05,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:05,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:05,183::__init__::225::IOProcess::(_processLogs) (541501) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:05,184::__init__::225::IOProcess::(_processLogs) (541501) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:05,184::__init__::225::IOProcess::(_processLogs) (541501) Building response >Thread-19::DEBUG::2014-08-11 17:34:05,185::__init__::225::IOProcess::(_processLogs) (541501) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:05,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:05,186::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:05,187::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:34:05,187::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:05,188::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:05,188::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:05,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:05,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:05,190::__init__::225::IOProcess::(_processLogs) (541502) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:05,191::__init__::225::IOProcess::(_processLogs) (541502) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:05,192::__init__::225::IOProcess::(_processLogs) (541502) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:05,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:05,193::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:05,374::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:05,375::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:05,375::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:05,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:05,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:05,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:06,289::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:06,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0554205 s, 18.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:34:08,412::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:08,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122297 s, 83.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:34:08,867::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:34:10,379::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:10,380::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:10,380::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:10,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:10,586::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0378999 s, 27.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:10,993::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:10,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:10,993::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:10,993::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:10,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:10,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:10,994::__init__::225::IOProcess::(_processLogs) (541503) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:10,994::__init__::225::IOProcess::(_processLogs) (541503) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:10,994::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541503) Building response >Thread-19::DEBUG::2014-08-11 17:34:10,994::__init__::225::IOProcess::(_processLogs) (541503) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:10,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:10,995::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:34:10,996::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:11,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:11,055::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:34:11,056::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000811435 s, 451 kB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:11,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:11,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:11,058::__init__::225::IOProcess::(_processLogs) (541504) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:11,059::__init__::225::IOProcess::(_processLogs) (541504) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:11,059::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541504) Building response >Thread-19::DEBUG::2014-08-11 17:34:11,060::__init__::225::IOProcess::(_processLogs) (541504) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:11,060::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:11,060::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:34:11,495::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmSetTicket with ('de580b19-e975-426f-80de-6c7daf1f24ab', 'KmTZcZ4KGlGO', '120', 'disconnect', {'userName': 'admin', 'userId': 'fdfc627c-d875-11e0-90f0-83df133b58cc'}) {} flowID [274f78c4] >Thread-10237::DEBUG::2014-08-11 17:34:11,502::BindingXMLRPC::1134::vds::(wrapper) return vmSetTicket with {'status': {'message': 'Done', 'code': 0}} >Thread-10237::DEBUG::2014-08-11 17:34:12,327::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:34:12,327::task::595::Storage.TaskManager.Task::(_updateState) Task=`a543adab-3059-4b60-90d2-4b5f6c2ad087`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:12,327::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:34:12,390::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:12,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`a543adab-3059-4b60-90d2-4b5f6c2ad087`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:12,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`a543adab-3059-4b60-90d2-4b5f6c2ad087`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:12,390::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:12,390::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:12,391::task::993::Storage.TaskManager.Task::(_decref) Task=`a543adab-3059-4b60-90d2-4b5f6c2ad087`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:34:12,399::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:34:12,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`4688f50f-52b3-4dbd-a95b-ef7b1fd1aef6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:34:12,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:34:12,400::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d85ed601-d537-4e41-be4e-d1320bfc147e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:34:12,400::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:34:12,400::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:34:12,400::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d85ed601-d537-4e41-be4e-d1320bfc147e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:34:12,400::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4688f50f-52b3-4dbd-a95b-ef7b1fd1aef6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:34:12,400::task::993::Storage.TaskManager.Task::(_decref) Task=`4688f50f-52b3-4dbd-a95b-ef7b1fd1aef6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:34:12,432::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:12,432::task::1191::Storage.TaskManager.Task::(prepare) Task=`4688f50f-52b3-4dbd-a95b-ef7b1fd1aef6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:12,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`4688f50f-52b3-4dbd-a95b-ef7b1fd1aef6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:34:12,432::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:34:12,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:34:12,432::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:34:12,433::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:34:12,433::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:34:12,433::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:34:12,433::task::993::Storage.TaskManager.Task::(_decref) Task=`4688f50f-52b3-4dbd-a95b-ef7b1fd1aef6`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:34:12,594::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:12,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370854 s, 27.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:34:13,874::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:14,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:14,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0136836 s, 74.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:15,193::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:15,193::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:15,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:15,193::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:15,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:15,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:15,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:15,194::__init__::225::IOProcess::(_processLogs) (541505) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:15,194::__init__::225::IOProcess::(_processLogs) (541505) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:15,194::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541505) Building response >Thread-19::DEBUG::2014-08-11 17:34:15,194::__init__::225::IOProcess::(_processLogs) (541505) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:15,195::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:34:15,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:15,195::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:34:15,272::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00957232 s, 51.7 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:15,274::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:15,274::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:15,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:15,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:15,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:15,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:15,277::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:15,277::__init__::225::IOProcess::(_processLogs) (541506) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:15,278::__init__::225::IOProcess::(_processLogs) (541506) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:15,285::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541506) Building response >Thread-19::DEBUG::2014-08-11 17:34:15,285::__init__::225::IOProcess::(_processLogs) (541506) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:15,286::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:34:15,286::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:34:15,286::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:15,287::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:34:15,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:15,287::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:15,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:15,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:15,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) (541507) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) (541507) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) (541507) Building response >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) (541507) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:15,288::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) (541508) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) (541508) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) (541508) Building response >Thread-19::DEBUG::2014-08-11 17:34:15,289::__init__::225::IOProcess::(_processLogs) (541508) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:15,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:15,290::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:15,290::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:15,290::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:34:15,290::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) (541509) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) (541509) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) (541509) Building response >Thread-19::DEBUG::2014-08-11 17:34:15,291::__init__::225::IOProcess::(_processLogs) (541509) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:15,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:15,292::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:15,386::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:15,386::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:15,386::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:16,063::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:16,064::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:16,064::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:16,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:16,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521823 s, 19.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:34:18,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:19,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0494468 s, 20.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:34:19,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`14278b14-6741-46e5-b711-017cab01868d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:19,027::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:34:19,027::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811435', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00957232', 'lastCheck': '3.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:19,027::task::1191::Storage.TaskManager.Task::(prepare) Task=`14278b14-6741-46e5-b711-017cab01868d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000811435', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00957232', 'lastCheck': '3.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:19,027::task::595::Storage.TaskManager.Task::(_updateState) Task=`14278b14-6741-46e5-b711-017cab01868d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:19,028::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:19,028::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:19,028::task::993::Storage.TaskManager.Task::(_decref) Task=`14278b14-6741-46e5-b711-017cab01868d`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:34:19,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:34:19,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:34:19,482::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:34:20,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:20,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:20,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:21,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:21,075::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:21,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:21,076::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:21,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:21,077::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:21,078::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:21,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:21,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:21,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:21,080::__init__::225::IOProcess::(_processLogs) (541510) Finding callback 'statvfs'... >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:21,080::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:21,081::__init__::225::IOProcess::(_processLogs) (541510) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:21,082::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541510) Building response >Thread-19::DEBUG::2014-08-11 17:34:21,082::__init__::225::IOProcess::(_processLogs) (541510) Queuing response >Thread-27::DEBUG::2014-08-11 17:34:21,082::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:21,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:21,142::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:34:21,143::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000353345 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:21,144::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:21,145::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:21,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:21,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:21,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:21,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:21,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:21,148::__init__::225::IOProcess::(_processLogs) (541511) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:21,149::__init__::225::IOProcess::(_processLogs) (541511) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:21,150::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541511) Building response >Thread-19::DEBUG::2014-08-11 17:34:21,151::__init__::225::IOProcess::(_processLogs) (541511) Queuing response >Dummy-51::DEBUG::2014-08-11 17:34:21,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0763003 s, 13.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:21,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:21,152::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:34:22,464::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:34:22,465::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea7a8620-5ff5-43e9-bd69-0fd35fc6452d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:22,465::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:34:22,521::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:22,521::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea7a8620-5ff5-43e9-bd69-0fd35fc6452d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:22,521::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea7a8620-5ff5-43e9-bd69-0fd35fc6452d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:22,521::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:22,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:22,521::task::993::Storage.TaskManager.Task::(_decref) Task=`ea7a8620-5ff5-43e9-bd69-0fd35fc6452d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:34:22,527::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:34:22,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`90e94f46-5e3b-464f-a022-4f549d1978d0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:34:22,528::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:34:22,528::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`141f7d10-3b82-4d7c-9bd4-eddd028de827`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:34:22,528::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:34:22,528::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:34:22,528::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`141f7d10-3b82-4d7c-9bd4-eddd028de827`::Granted request >Thread-10197::DEBUG::2014-08-11 17:34:22,528::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`90e94f46-5e3b-464f-a022-4f549d1978d0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:34:22,528::task::993::Storage.TaskManager.Task::(_decref) Task=`90e94f46-5e3b-464f-a022-4f549d1978d0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:34:22,545::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:22,545::task::1191::Storage.TaskManager.Task::(prepare) Task=`90e94f46-5e3b-464f-a022-4f549d1978d0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:22,545::task::595::Storage.TaskManager.Task::(_updateState) Task=`90e94f46-5e3b-464f-a022-4f549d1978d0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:34:22,546::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:34:22,546::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:34:22,546::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:34:22,546::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:34:22,546::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:34:22,546::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:34:22,546::task::993::Storage.TaskManager.Task::(_decref) Task=`90e94f46-5e3b-464f-a022-4f549d1978d0`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:34:23,161::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:23,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139386 s, 73.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:34:23,870::task::595::Storage.TaskManager.Task::(_updateState) Task=`0677d193-ab65-4c72-a47d-5e4daf7c0ee3`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:34:23,870::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:34:23,870::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:23,870::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:34:23,870::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:23,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:23,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:23,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:23,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:23,871::__init__::225::IOProcess::(_processLogs) (541512) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:34:23,871::__init__::225::IOProcess::(_processLogs) (541512) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:34:23,874::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541512) Building response >Thread-19::DEBUG::2014-08-11 17:34:23,874::__init__::225::IOProcess::(_processLogs) (541512) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:23,874::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:23,874::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:34:23,875::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:23,875::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:34:23,875::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:23,875::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:23,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:23,876::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:34:23,876::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:34:23,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:34:23,877::task::1191::Storage.TaskManager.Task::(prepare) Task=`0677d193-ab65-4c72-a47d-5e4daf7c0ee3`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:34:23,877::__init__::225::IOProcess::(_processLogs) (541513) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:34:23,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`0677d193-ab65-4c72-a47d-5e4daf7c0ee3`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:34:23,877::__init__::225::IOProcess::(_processLogs) (541513) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:34:23,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:34:23,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:34:23,878::__init__::225::IOProcess::(_processLogs) (541513) Building response >Thread-10017::DEBUG::2014-08-11 17:34:23,879::task::993::Storage.TaskManager.Task::(_decref) Task=`0677d193-ab65-4c72-a47d-5e4daf7c0ee3`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:34:23,879::__init__::225::IOProcess::(_processLogs) (541513) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:23,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:23,879::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:34:23,900::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:25,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:25,301::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:25,302::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:25,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:25,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:25,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:25,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:25,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:25,305::__init__::225::IOProcess::(_processLogs) (541514) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:25,305::__init__::225::IOProcess::(_processLogs) (541514) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:25,306::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541514) Building response >Thread-19::DEBUG::2014-08-11 17:34:25,307::__init__::225::IOProcess::(_processLogs) (541514) Queuing response >Thread-28::DEBUG::2014-08-11 17:34:25,308::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:25,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:25,369::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:34:25,371::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000998199 s, 496 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:25,373::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:25,374::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:25,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:25,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:25,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:25,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:25,378::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:25,379::__init__::225::IOProcess::(_processLogs) (541515) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:25,380::__init__::225::IOProcess::(_processLogs) (541515) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:34:25,381::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0791974 s, 12.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:25,382::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541515) Building response >Thread-19::DEBUG::2014-08-11 17:34:25,383::__init__::225::IOProcess::(_processLogs) (541515) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:25,384::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:25,384::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:34:25,386::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:25,386::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:34:25,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:25,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:25,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:25,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:25,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:25,391::__init__::225::IOProcess::(_processLogs) (541516) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:25,392::__init__::225::IOProcess::(_processLogs) (541516) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:25,392::__init__::225::IOProcess::(_processLogs) (541516) Building response >Thread-19::DEBUG::2014-08-11 17:34:25,393::__init__::225::IOProcess::(_processLogs) (541516) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:25,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:25,395::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:25,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >GuestMonitor-vm::DEBUG::2014-08-11 17:34:25,399::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:25,399::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:34:25,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:25,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:25,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:34:25,404::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:25,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:25,406::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:25,407::__init__::225::IOProcess::(_processLogs) (541517) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:25,408::__init__::225::IOProcess::(_processLogs) (541517) Got request for method 'access' >GuestMonitor-vm::DEBUG::2014-08-11 17:34:25,409::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:25,410::__init__::225::IOProcess::(_processLogs) (541517) Building response >Thread-19::DEBUG::2014-08-11 17:34:25,411::__init__::225::IOProcess::(_processLogs) (541517) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:25,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:25,413::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:25,414::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:25,415::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:34:25,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:25,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:25,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:25,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:25,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:25,419::__init__::225::IOProcess::(_processLogs) (541518) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:25,420::__init__::225::IOProcess::(_processLogs) (541518) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:25,421::__init__::225::IOProcess::(_processLogs) (541518) Building response >Thread-19::DEBUG::2014-08-11 17:34:25,421::__init__::225::IOProcess::(_processLogs) (541518) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:25,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:25,423::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:26,087::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:26,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:26,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:27,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:27,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379792 s, 27.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:34:28,881::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:29,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:29,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567741 s, 18.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:30,417::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:30,418::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:30,418::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:31,094::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:31,094::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:31,094::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:31,151::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:31,151::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:31,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) (541519) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) (541519) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541519) Building response >Thread-19::DEBUG::2014-08-11 17:34:31,152::__init__::225::IOProcess::(_processLogs) (541519) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:31,153::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:34:31,153::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:31,154::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:34:31,215::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000845272 s, 433 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:31,215::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:31,215::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:31,215::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:31,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:31,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:31,216::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:31,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:31,216::__init__::225::IOProcess::(_processLogs) (541520) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:31,216::__init__::225::IOProcess::(_processLogs) (541520) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:31,217::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541520) Building response >Thread-19::DEBUG::2014-08-11 17:34:31,217::__init__::225::IOProcess::(_processLogs) (541520) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:31,217::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:34:31,217::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:34:31,493::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:34:31,764::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:31,877::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0531095 s, 19.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:34:32,593::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:34:32,594::task::595::Storage.TaskManager.Task::(_updateState) Task=`9efdecad-a91a-46a0-8c6d-2b3934e6e9d9`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:32,595::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:34:32,664::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:32,665::task::1191::Storage.TaskManager.Task::(prepare) Task=`9efdecad-a91a-46a0-8c6d-2b3934e6e9d9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:32,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`9efdecad-a91a-46a0-8c6d-2b3934e6e9d9`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:32,666::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:32,666::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:32,667::task::993::Storage.TaskManager.Task::(_decref) Task=`9efdecad-a91a-46a0-8c6d-2b3934e6e9d9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:34:32,676::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:34:32,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7faffde-e69e-4bf3-9651-71f7a66e51ed`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:34:32,678::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:34:32,678::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1c691806-6e7f-4204-9a24-c98578165465`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:34:32,678::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:34:32,678::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:34:32,678::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1c691806-6e7f-4204-9a24-c98578165465`::Granted request >Thread-10197::DEBUG::2014-08-11 17:34:32,678::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c7faffde-e69e-4bf3-9651-71f7a66e51ed`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:34:32,679::task::993::Storage.TaskManager.Task::(_decref) Task=`c7faffde-e69e-4bf3-9651-71f7a66e51ed`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:34:32,695::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:32,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`c7faffde-e69e-4bf3-9651-71f7a66e51ed`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:32,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`c7faffde-e69e-4bf3-9651-71f7a66e51ed`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:34:32,695::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:34:32,695::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:34:32,695::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:34:32,696::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:34:32,696::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:34:32,696::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:34:32,696::task::993::Storage.TaskManager.Task::(_decref) Task=`c7faffde-e69e-4bf3-9651-71f7a66e51ed`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:34:33,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:34,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052833 s, 19.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:34:34,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8e72608-6b09-4e9b-b38e-49c436321c18`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:34,225::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:34:34,225::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845272', 'lastCheck': '3.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000998199', 'lastCheck': '8.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:34,225::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8e72608-6b09-4e9b-b38e-49c436321c18`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845272', 'lastCheck': '3.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000998199', 'lastCheck': '8.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:34,225::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8e72608-6b09-4e9b-b38e-49c436321c18`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:34,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:34,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:34,225::task::993::Storage.TaskManager.Task::(_decref) Task=`e8e72608-6b09-4e9b-b38e-49c436321c18`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:34:34,236::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:34:34,237::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:35,419::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:35,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:35,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:35,425::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:35,425::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:35,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:35,425::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:35,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:35,425::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:35,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-28::DEBUG::2014-08-11 17:34:35,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:35,426::__init__::225::IOProcess::(_processLogs) (541521) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:35,484::__init__::225::IOProcess::(_processLogs) (541521) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:35,485::__init__::225::IOProcess::(_processLogs) (541521) Building response >Thread-19::DEBUG::2014-08-11 17:34:35,485::__init__::225::IOProcess::(_processLogs) (541521) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:35,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:35,485::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:34:35,486::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00165321 s, 299 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:35,487::__init__::225::IOProcess::(_processLogs) (541522) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:35,488::__init__::225::IOProcess::(_processLogs) (541522) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:35,488::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541522) Building response >Thread-19::DEBUG::2014-08-11 17:34:35,488::__init__::225::IOProcess::(_processLogs) (541522) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:35,488::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:35,488::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:34:35,489::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:35,489::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:34:35,489::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:35,490::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:35,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) (541523) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) (541523) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) (541523) Building response >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) (541523) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:35,491::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) (541524) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) (541524) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) (541524) Building response >Thread-19::DEBUG::2014-08-11 17:34:35,492::__init__::225::IOProcess::(_processLogs) (541524) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:35,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:35,493::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:35,493::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:35,493::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:34:35,493::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:35,493::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) (541525) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) (541525) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) (541525) Building response >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) (541525) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:35,494::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:34:36,061::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:36,119::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:36,119::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:36,120::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:36,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.044631 s, 22.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:34:38,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:38,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470495 s, 21.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:34:38,907::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:40,287::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:40,398::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511936 s, 20.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:40,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:40,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:40,427::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:41,125::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:41,126::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:41,126::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:41,218::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) (541526) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:41,219::__init__::225::IOProcess::(_processLogs) (541526) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:41,220::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541526) Building response >Thread-19::DEBUG::2014-08-11 17:34:41,220::__init__::225::IOProcess::(_processLogs) (541526) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:41,220::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:34:41,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:34:41,221::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:34:41,280::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00031797 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:41,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:41,282::__init__::225::IOProcess::(_processLogs) (541527) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:41,282::__init__::225::IOProcess::(_processLogs) (541527) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:41,282::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541527) Building response >Thread-19::DEBUG::2014-08-11 17:34:41,283::__init__::225::IOProcess::(_processLogs) (541527) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:41,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:41,283::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:34:42,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:42,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0318145 s, 32.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:34:42,738::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:34:42,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ca44d2b-87af-4b59-b5be-a8507ce6addc`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:42,738::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:34:42,794::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:42,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ca44d2b-87af-4b59-b5be-a8507ce6addc`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:42,795::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ca44d2b-87af-4b59-b5be-a8507ce6addc`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:42,795::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:42,795::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:42,795::task::993::Storage.TaskManager.Task::(_decref) Task=`9ca44d2b-87af-4b59-b5be-a8507ce6addc`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:34:42,806::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:34:42,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dcb7372-9f63-4197-a33d-2113f4a16339`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:34:42,807::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:34:42,807::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`38b9085f-c2bf-4271-8462-eb0f3bb10c9e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:34:42,807::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:34:42,807::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:34:42,807::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`38b9085f-c2bf-4271-8462-eb0f3bb10c9e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:34:42,807::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7dcb7372-9f63-4197-a33d-2113f4a16339`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:34:42,807::task::993::Storage.TaskManager.Task::(_decref) Task=`7dcb7372-9f63-4197-a33d-2113f4a16339`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:34:42,837::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:42,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dcb7372-9f63-4197-a33d-2113f4a16339`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:42,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dcb7372-9f63-4197-a33d-2113f4a16339`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:34:42,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:34:42,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:34:42,837::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:34:42,837::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:34:42,838::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:34:42,838::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:34:42,838::task::993::Storage.TaskManager.Task::(_decref) Task=`7dcb7372-9f63-4197-a33d-2113f4a16339`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:34:43,884::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e99a2fa-992e-4453-aab0-47bccc556448`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:34:43,884::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:34:43,884::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:43,884::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:34:43,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:43,884::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:43,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:43,885::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:43,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:43,885::__init__::225::IOProcess::(_processLogs) (541528) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:34:43,885::__init__::225::IOProcess::(_processLogs) (541528) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:34:43,886::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541528) Building response >Thread-19::DEBUG::2014-08-11 17:34:43,886::__init__::225::IOProcess::(_processLogs) (541528) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:43,886::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:43,887::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:34:43,887::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:34:43,888::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:34:43,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e99a2fa-992e-4453-aab0-47bccc556448`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:34:43,888::__init__::225::IOProcess::(_processLogs) (541529) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:34:43,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e99a2fa-992e-4453-aab0-47bccc556448`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:34:43,889::__init__::225::IOProcess::(_processLogs) (541529) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:34:43,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:34:43,889::__init__::225::IOProcess::(_processLogs) (541529) Building response >Thread-10102::DEBUG::2014-08-11 17:34:43,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:34:43,890::__init__::225::IOProcess::(_processLogs) (541529) Queuing response >Thread-10102::DEBUG::2014-08-11 17:34:43,890::task::993::Storage.TaskManager.Task::(_decref) Task=`1e99a2fa-992e-4453-aab0-47bccc556448`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:34:43,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:43,891::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:34:43,911::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:44,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:44,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123131 s, 83.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:45,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:45,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:45,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:45,494::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:45,494::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:45,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:45,494::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:45,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:45,495::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:45,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:45,495::__init__::225::IOProcess::(_processLogs) (541530) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:45,495::__init__::225::IOProcess::(_processLogs) (541530) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:45,496::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541530) Building response >Thread-19::DEBUG::2014-08-11 17:34:45,496::__init__::225::IOProcess::(_processLogs) (541530) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:45,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:45,496::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:34:45,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:34:45,560::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00240471 s, 206 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:45,560::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) (541531) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:45,561::__init__::225::IOProcess::(_processLogs) (541531) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:45,565::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541531) Building response >Thread-19::DEBUG::2014-08-11 17:34:45,565::__init__::225::IOProcess::(_processLogs) (541531) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:45,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:45,565::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:34:45,566::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:45,566::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:34:45,566::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:45,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:45,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:45,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) (541532) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) (541532) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) (541532) Building response >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) (541532) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:34:45,567::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) (541533) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) (541533) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) (541533) Building response >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) (541533) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:45,568::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) (541534) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:45,569::__init__::225::IOProcess::(_processLogs) (541534) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:45,582::__init__::225::IOProcess::(_processLogs) (541534) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:45,583::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:45,583::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:46,132::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:46,132::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:46,133::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:46,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:46,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548552 s, 18.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:34:48,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:48,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174676 s, 58.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:34:49,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad3c476b-232e-4414-b448-ed8efd5a4cea`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:49,414::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:34:49,414::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031797', 'lastCheck': '8.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00240471', 'lastCheck': '3.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:49,414::task::1191::Storage.TaskManager.Task::(prepare) Task=`ad3c476b-232e-4414-b448-ed8efd5a4cea`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00031797', 'lastCheck': '8.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00240471', 'lastCheck': '3.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:34:49,414::task::595::Storage.TaskManager.Task::(_updateState) Task=`ad3c476b-232e-4414-b448-ed8efd5a4cea`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:49,414::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:49,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:49,415::task::993::Storage.TaskManager.Task::(_decref) Task=`ad3c476b-232e-4414-b448-ed8efd5a4cea`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:34:49,425::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:34:49,426::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:34:49,568::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:34:50,437::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:50,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:50,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:50,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:50,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013027 s, 78.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:51,139::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:51,139::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:51,139::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:51,283::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:51,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:51,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:51,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:51,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:51,284::__init__::225::IOProcess::(_processLogs) (541535) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:51,284::__init__::225::IOProcess::(_processLogs) (541535) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:51,295::__init__::225::IOProcess::(_processLogs) (541535) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:51,295::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:34:51,296::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:34:51,361::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00241115 s, 152 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:51,362::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:51,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:51,362::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:51,362::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:51,362::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:51,363::__init__::225::IOProcess::(_processLogs) (541536) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:51,363::__init__::225::IOProcess::(_processLogs) (541536) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:51,363::__init__::225::IOProcess::(_processLogs) (541536) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:51,363::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:34:52,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:34:52,931::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:34:52,932::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bafd889-872f-4732-a305-f7d1fb8e5be5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:34:52,932::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:34:52,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01219 s, 84.0 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:34:52,953::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:52,953::task::1191::Storage.TaskManager.Task::(prepare) Task=`5bafd889-872f-4732-a305-f7d1fb8e5be5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:34:52,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`5bafd889-872f-4732-a305-f7d1fb8e5be5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:34:52,953::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:34:52,953::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:34:52,953::task::993::Storage.TaskManager.Task::(_decref) Task=`5bafd889-872f-4732-a305-f7d1fb8e5be5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:34:52,965::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:34:52,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`0678ca52-620d-411f-9660-f9323611c4cb`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:34:52,965::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:34:52,965::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ca547c9d-eb8a-4eee-8b3d-14b60827cfdb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:34:52,965::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:34:52,966::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:34:52,966::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ca547c9d-eb8a-4eee-8b3d-14b60827cfdb`::Granted request >Thread-10197::DEBUG::2014-08-11 17:34:52,966::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0678ca52-620d-411f-9660-f9323611c4cb`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:34:52,966::task::993::Storage.TaskManager.Task::(_decref) Task=`0678ca52-620d-411f-9660-f9323611c4cb`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:34:53,023::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:53,023::task::1191::Storage.TaskManager.Task::(prepare) Task=`0678ca52-620d-411f-9660-f9323611c4cb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:34:53,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`0678ca52-620d-411f-9660-f9323611c4cb`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:34:53,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:34:53,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:34:53,023::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:34:53,023::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:34:53,023::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:34:53,023::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:34:53,023::task::993::Storage.TaskManager.Task::(_decref) Task=`0678ca52-620d-411f-9660-f9323611c4cb`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:34:53,915::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:54,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:55,023::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138301 s, 74.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:34:55,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:55,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:34:55,443::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) (541537) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:55,585::__init__::225::IOProcess::(_processLogs) (541537) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:55,587::__init__::225::IOProcess::(_processLogs) (541537) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:55,587::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:34:55,587::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:34:55,647::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00096226 s, 514 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:34:55,649::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:34:55,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:55,650::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:55,650::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:55,651::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:55,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:55,652::__init__::225::IOProcess::(_processLogs) (541538) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:34:55,653::__init__::225::IOProcess::(_processLogs) (541538) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:34:55,654::__init__::225::IOProcess::(_processLogs) (541538) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:55,655::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:55,655::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:34:55,656::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:34:55,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:55,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:55,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:55,658::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:55,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:55,660::__init__::225::IOProcess::(_processLogs) (541539) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:55,660::__init__::225::IOProcess::(_processLogs) (541539) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:55,661::__init__::225::IOProcess::(_processLogs) (541539) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:55,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:55,662::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:55,663::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:34:55,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:55,664::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:55,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:55,665::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:55,666::__init__::225::IOProcess::(_processLogs) (541540) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:55,666::__init__::225::IOProcess::(_processLogs) (541540) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:55,668::__init__::225::IOProcess::(_processLogs) (541540) Building response >Thread-19::DEBUG::2014-08-11 17:34:55,668::__init__::225::IOProcess::(_processLogs) (541540) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:55,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:55,669::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:34:55,670::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:34:55,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:34:55,671::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:34:55,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:34:55,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:34:55,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:34:55,673::__init__::225::IOProcess::(_processLogs) (541541) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:34:55,674::__init__::225::IOProcess::(_processLogs) (541541) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:34:55,674::__init__::225::IOProcess::(_processLogs) (541541) Building response >Thread-19::DEBUG::2014-08-11 17:34:55,675::__init__::225::IOProcess::(_processLogs) (541541) Queuing response >Thread-19::DEBUG::2014-08-11 17:34:55,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:34:55,676::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:56,145::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:56,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:34:56,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:34:57,031::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:57,112::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0219252 s, 46.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:34:58,919::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:34:59,120::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:34:59,230::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505681 s, 20.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:35:00,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:00,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:00,450::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:01,152::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:01,152::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:01,152::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:01,237::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:01,332::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0349628 s, 29.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:01,364::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) (541542) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) (541542) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:01,365::__init__::225::IOProcess::(_processLogs) (541542) Queuing response >Thread-27::DEBUG::2014-08-11 17:35:01,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:35:01,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:01,425::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:35:01,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000752782 s, 486 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) (541543) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:01,427::__init__::225::IOProcess::(_processLogs) (541543) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:01,428::__init__::225::IOProcess::(_processLogs) (541543) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:01,428::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:01,428::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:35:01,596::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10237::DEBUG::2014-08-11 17:35:03,097::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:35:03,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`c269d304-dbcb-419d-a380-a179c239cc81`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:03,097::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:35:03,134::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:03,134::task::1191::Storage.TaskManager.Task::(prepare) Task=`c269d304-dbcb-419d-a380-a179c239cc81`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:03,134::task::595::Storage.TaskManager.Task::(_updateState) Task=`c269d304-dbcb-419d-a380-a179c239cc81`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:03,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:03,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:03,134::task::993::Storage.TaskManager.Task::(_decref) Task=`c269d304-dbcb-419d-a380-a179c239cc81`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:35:03,146::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:35:03,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdfecdbe-db03-4595-9366-aed3613e0bb6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:35:03,147::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:35:03,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e14aa38e-3583-43f2-8d44-12a14ae806b0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:35:03,147::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:35:03,147::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:35:03,147::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e14aa38e-3583-43f2-8d44-12a14ae806b0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:35:03,148::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cdfecdbe-db03-4595-9366-aed3613e0bb6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:35:03,148::task::993::Storage.TaskManager.Task::(_decref) Task=`cdfecdbe-db03-4595-9366-aed3613e0bb6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:35:03,163::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:03,164::task::1191::Storage.TaskManager.Task::(prepare) Task=`cdfecdbe-db03-4595-9366-aed3613e0bb6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:03,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`cdfecdbe-db03-4595-9366-aed3613e0bb6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:35:03,164::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:35:03,164::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:35:03,164::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:35:03,164::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:35:03,164::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:35:03,164::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:35:03,164::task::993::Storage.TaskManager.Task::(_decref) Task=`cdfecdbe-db03-4595-9366-aed3613e0bb6`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:35:03,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:03,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0664682 s, 15.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:35:04,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`caa1f98d-5276-4314-b0a0-9ec0f3d54559`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:04,625::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:35:04,625::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752782', 'lastCheck': '3.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00096226', 'lastCheck': '8.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:04,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`caa1f98d-5276-4314-b0a0-9ec0f3d54559`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000752782', 'lastCheck': '3.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00096226', 'lastCheck': '8.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:04,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`caa1f98d-5276-4314-b0a0-9ec0f3d54559`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:04,625::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:04,625::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:04,625::task::993::Storage.TaskManager.Task::(_decref) Task=`caa1f98d-5276-4314-b0a0-9ec0f3d54559`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:35:04,646::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:35:04,646::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:05,455::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:05,456::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:05,456::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:05,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:05,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131042 s, 78.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) (541544) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:05,678::__init__::225::IOProcess::(_processLogs) (541544) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:05,679::__init__::225::IOProcess::(_processLogs) (541544) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:05,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:35:05,679::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:35:05,743::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0044434 s, 111 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:05,745::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:05,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:05,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:05,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:05,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:05,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:05,748::__init__::225::IOProcess::(_processLogs) (541545) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:05,749::__init__::225::IOProcess::(_processLogs) (541545) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:05,749::__init__::225::IOProcess::(_processLogs) (541545) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:05,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:05,752::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:35:05,752::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:35:05,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:05,754::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:05,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:05,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:05,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:05,756::__init__::225::IOProcess::(_processLogs) (541546) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:05,756::__init__::225::IOProcess::(_processLogs) (541546) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:05,757::__init__::225::IOProcess::(_processLogs) (541546) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:05,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:05,758::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:05,760::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:35:05,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:05,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:05,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:05,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:05,764::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:05,764::__init__::225::IOProcess::(_processLogs) (541547) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:05,765::__init__::225::IOProcess::(_processLogs) (541547) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:05,766::__init__::225::IOProcess::(_processLogs) (541547) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:05,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:05,767::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:05,768::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:35:05,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:05,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:05,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:05,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:05,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:05,771::__init__::225::IOProcess::(_processLogs) (541548) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:05,772::__init__::225::IOProcess::(_processLogs) (541548) Building response >Thread-19::DEBUG::2014-08-11 17:35:05,773::__init__::225::IOProcess::(_processLogs) (541548) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:05,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:05,774::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:06,158::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:06,159::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:06,159::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:07,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:07,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549054 s, 18.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:35:08,923::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:35:09,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:09,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205765 s, 49.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:35:10,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:10,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:10,463::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:11,164::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:11,165::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:11,165::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) (541549) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:11,429::__init__::225::IOProcess::(_processLogs) (541549) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:11,430::__init__::225::IOProcess::(_processLogs) (541549) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:11,430::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:35:11,430::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:35:11,490::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00157207 s, 233 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) (541550) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) (541550) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) (541550) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:11,491::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:35:11,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:11,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045303 s, 22.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:35:13,240::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:35:13,240::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c138b47-2fcd-4220-a754-f1d819c77a49`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:13,240::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:35:13,288::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:13,288::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c138b47-2fcd-4220-a754-f1d819c77a49`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:13,288::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c138b47-2fcd-4220-a754-f1d819c77a49`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:13,288::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:13,288::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:13,288::task::993::Storage.TaskManager.Task::(_decref) Task=`6c138b47-2fcd-4220-a754-f1d819c77a49`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:35:13,295::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:35:13,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`42afc35a-5798-49c8-8e72-61b85345a0eb`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:35:13,295::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:35:13,295::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dce05628-4ec4-424f-9664-4b3d1769e704`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:35:13,295::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:35:13,295::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:35:13,296::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dce05628-4ec4-424f-9664-4b3d1769e704`::Granted request >Thread-10197::DEBUG::2014-08-11 17:35:13,296::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`42afc35a-5798-49c8-8e72-61b85345a0eb`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:35:13,296::task::993::Storage.TaskManager.Task::(_decref) Task=`42afc35a-5798-49c8-8e72-61b85345a0eb`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:35:13,313::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:13,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`42afc35a-5798-49c8-8e72-61b85345a0eb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:13,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`42afc35a-5798-49c8-8e72-61b85345a0eb`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:35:13,313::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:35:13,313::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:35:13,314::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:35:13,314::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:35:13,314::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:35:13,314::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:35:13,314::task::993::Storage.TaskManager.Task::(_decref) Task=`42afc35a-5798-49c8-8e72-61b85345a0eb`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:35:13,939::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:14,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296223 s, 34.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:35:14,032::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:35:15,465::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:15,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:15,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:15,772::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) (541551) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) (541551) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) (541551) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:15,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:35:15,774::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:35:15,835::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00155384 s, 319 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:15,836::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:15,836::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:15,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:15,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:15,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:15,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:15,840::__init__::225::IOProcess::(_processLogs) (541552) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:15,840::__init__::225::IOProcess::(_processLogs) (541552) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:15,841::__init__::225::IOProcess::(_processLogs) (541552) Building response >Thread-19::DEBUG::2014-08-11 17:35:15,841::__init__::225::IOProcess::(_processLogs) (541552) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:15,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:15,842::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:35:15,843::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:15,844::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:35:15,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:15,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:15,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:15,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:15,846::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:15,847::__init__::225::IOProcess::(_processLogs) (541553) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:15,848::__init__::225::IOProcess::(_processLogs) (541553) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:15,848::__init__::225::IOProcess::(_processLogs) (541553) Building response >Thread-19::DEBUG::2014-08-11 17:35:15,849::__init__::225::IOProcess::(_processLogs) (541553) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:15,849::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:15,850::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:15,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:15,851::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:35:15,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:15,852::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:15,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:15,853::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:15,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:15,854::__init__::225::IOProcess::(_processLogs) (541554) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:15,854::__init__::225::IOProcess::(_processLogs) (541554) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:15,855::__init__::225::IOProcess::(_processLogs) (541554) Building response >Thread-19::DEBUG::2014-08-11 17:35:15,855::__init__::225::IOProcess::(_processLogs) (541554) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:15,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:15,856::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:15,858::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:15,858::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:35:15,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:15,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:15,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:15,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:15,861::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:15,862::__init__::225::IOProcess::(_processLogs) (541555) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:15,862::__init__::225::IOProcess::(_processLogs) (541555) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:15,863::__init__::225::IOProcess::(_processLogs) (541555) Building response >Thread-19::DEBUG::2014-08-11 17:35:15,863::__init__::225::IOProcess::(_processLogs) (541555) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:15,864::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:15,864::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:35:16,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:16,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251268 s, 40.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:16,170::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:16,170::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:16,170::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:18,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:18,205::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170607 s, 60.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:35:19,623::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10237::DEBUG::2014-08-11 17:35:19,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`789b94ee-9bae-47c0-9c1b-f68ac304440a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:19,810::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:35:19,810::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157207', 'lastCheck': '8.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00155384', 'lastCheck': '3.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:19,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`789b94ee-9bae-47c0-9c1b-f68ac304440a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157207', 'lastCheck': '8.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00155384', 'lastCheck': '3.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:19,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`789b94ee-9bae-47c0-9c1b-f68ac304440a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:19,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:19,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:19,810::task::993::Storage.TaskManager.Task::(_decref) Task=`789b94ee-9bae-47c0-9c1b-f68ac304440a`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:35:19,831::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:35:19,831::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:20,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:20,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127526 s, 80.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:35:20,472::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:20,472::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:20,473::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:21,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:21,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:21,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) (541556) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:21,493::__init__::225::IOProcess::(_processLogs) (541556) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:21,496::__init__::225::IOProcess::(_processLogs) DEBUG|(541556) Building response >Thread-19::DEBUG::2014-08-11 17:35:21,496::__init__::225::IOProcess::(_processLogs) (541556) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:21,497::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:21,497::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:35:21,497::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:35:21,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000748178 s, 489 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:21,558::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) (541557) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) (541557) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:21,559::__init__::225::IOProcess::(_processLogs) DEBUG|(541557) Building response >Thread-19::DEBUG::2014-08-11 17:35:21,560::__init__::225::IOProcess::(_processLogs) (541557) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:21,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:21,560::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:35:22,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:22,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256069 s, 40.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:35:23,340::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:35:23,340::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca1df77f-68d0-48b6-bf34-208d52361e6d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:23,340::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:35:23,370::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:23,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca1df77f-68d0-48b6-bf34-208d52361e6d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:23,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca1df77f-68d0-48b6-bf34-208d52361e6d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:23,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:23,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:23,370::task::993::Storage.TaskManager.Task::(_decref) Task=`ca1df77f-68d0-48b6-bf34-208d52361e6d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:35:23,383::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:35:23,383::task::595::Storage.TaskManager.Task::(_updateState) Task=`79195cd6-5811-41e1-a629-7af5cdb1b787`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:35:23,383::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:35:23,384::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bc7e8348-78b1-471f-ab90-75ec02ba6d09`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:35:23,384::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:35:23,384::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:35:23,385::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bc7e8348-78b1-471f-ab90-75ec02ba6d09`::Granted request >Thread-10197::DEBUG::2014-08-11 17:35:23,385::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`79195cd6-5811-41e1-a629-7af5cdb1b787`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:35:23,385::task::993::Storage.TaskManager.Task::(_decref) Task=`79195cd6-5811-41e1-a629-7af5cdb1b787`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:35:23,401::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:23,401::task::1191::Storage.TaskManager.Task::(prepare) Task=`79195cd6-5811-41e1-a629-7af5cdb1b787`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:23,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`79195cd6-5811-41e1-a629-7af5cdb1b787`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:35:23,402::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:35:23,402::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:35:23,402::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:35:23,402::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:35:23,402::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:35:23,402::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:35:23,402::task::993::Storage.TaskManager.Task::(_decref) Task=`79195cd6-5811-41e1-a629-7af5cdb1b787`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:35:23,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`75267b5a-ca6b-4ac0-badb-bea371118289`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:35:23,940::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:23,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:23,942::__init__::225::IOProcess::(_processLogs) (541558) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:35:23,942::__init__::225::IOProcess::(_processLogs) (541558) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:35:23,942::__init__::225::IOProcess::(_processLogs) DEBUG|(541558) Building response >Thread-19::DEBUG::2014-08-11 17:35:23,942::__init__::225::IOProcess::(_processLogs) (541558) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:23,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:23,943::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:35:23,943::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:23,943::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:35:23,943::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:23,944::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:23,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:35:23,944::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:35:23,944::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:35:23,944::task::1191::Storage.TaskManager.Task::(prepare) Task=`75267b5a-ca6b-4ac0-badb-bea371118289`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:35:23,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:35:23,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`75267b5a-ca6b-4ac0-badb-bea371118289`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:35:23,945::__init__::225::IOProcess::(_processLogs) (541559) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:35:23,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:35:23,946::__init__::225::IOProcess::(_processLogs) (541559) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:35:23,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:35:23,946::__init__::225::IOProcess::(_processLogs) (541559) Building response >Thread-10017::DEBUG::2014-08-11 17:35:23,946::task::993::Storage.TaskManager.Task::(_decref) Task=`75267b5a-ca6b-4ac0-badb-bea371118289`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:35:23,947::__init__::225::IOProcess::(_processLogs) (541559) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:23,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:23,947::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:35:23,968::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:35:24,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:24,462::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177756 s, 57.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:35:25,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:25,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:25,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:25,862::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:25,862::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:25,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:25,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:25,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:25,863::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:25,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:25,863::__init__::225::IOProcess::(_processLogs) (541560) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:25,863::__init__::225::IOProcess::(_processLogs) (541560) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:25,863::__init__::225::IOProcess::(_processLogs) DEBUG|(541560) Building response >Thread-28::DEBUG::2014-08-11 17:35:25,864::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:35:25,864::__init__::225::IOProcess::(_processLogs) (541560) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:25,923::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:25,924::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:35:25,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000893801 s, 554 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:25,927::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:25,927::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:25,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:25,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:25,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:25,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:25,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:25,930::__init__::225::IOProcess::(_processLogs) (541561) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:25,931::__init__::225::IOProcess::(_processLogs) (541561) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:25,932::__init__::225::IOProcess::(_processLogs) DEBUG|(541561) Building response >Thread-19::DEBUG::2014-08-11 17:35:25,933::__init__::225::IOProcess::(_processLogs) (541561) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:25,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:25,934::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:35:25,935::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:25,935::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:35:25,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:25,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:25,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:25,937::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:25,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:25,938::__init__::225::IOProcess::(_processLogs) (541562) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:25,939::__init__::225::IOProcess::(_processLogs) (541562) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:25,939::__init__::225::IOProcess::(_processLogs) (541562) Building response >Thread-19::DEBUG::2014-08-11 17:35:25,941::__init__::225::IOProcess::(_processLogs) (541562) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:25,942::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:25,943::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:25,943::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:25,944::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:35:25,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:25,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:25,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:25,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:25,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:25,947::__init__::225::IOProcess::(_processLogs) (541563) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:25,948::__init__::225::IOProcess::(_processLogs) (541563) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:25,948::__init__::225::IOProcess::(_processLogs) (541563) Building response >Thread-19::DEBUG::2014-08-11 17:35:25,949::__init__::225::IOProcess::(_processLogs) (541563) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:25,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:25,950::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:25,951::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:25,951::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:35:25,952::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:25,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:25,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:25,954::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:25,954::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:25,955::__init__::225::IOProcess::(_processLogs) (541564) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:25,955::__init__::225::IOProcess::(_processLogs) (541564) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:25,956::__init__::225::IOProcess::(_processLogs) (541564) Building response >Thread-19::DEBUG::2014-08-11 17:35:25,956::__init__::225::IOProcess::(_processLogs) (541564) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:25,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:25,958::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:26,178::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:26,178::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:26,179::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:26,470::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:26,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0347575 s, 29.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:35:28,572::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:28,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0275017 s, 37.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:35:29,040::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:35:30,481::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:30,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:30,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:30,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:30,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013851 s, 73.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:31,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:31,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:31,185::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:31,561::__init__::225::IOProcess::(_processLogs) Sending response sized 58DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:31,561::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:31,561::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:31,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:31,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-27::DEBUG::2014-08-11 17:35:31,562::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:35:31,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:31,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:31,621::__init__::225::IOProcess::(_processLogs) (541565) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:31,621::__init__::225::IOProcess::(_processLogs) (541565) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:31,621::__init__::225::IOProcess::(_processLogs) (541565) Building response >Thread-19::DEBUG::2014-08-11 17:35:31,621::__init__::225::IOProcess::(_processLogs) (541565) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:31,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:31,622::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:35:31,622::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000380189 s, 963 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) (541566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:31,623::__init__::225::IOProcess::(_processLogs) (541566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:31,624::__init__::225::IOProcess::(_processLogs) (541566) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:31,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:31,624::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:35:31,635::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:35:32,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:32,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357891 s, 28.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:35:33,520::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:35:33,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ff82c0b-ab3c-406d-81a6-23cabef66552`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:33,521::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:35:33,535::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:33,535::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ff82c0b-ab3c-406d-81a6-23cabef66552`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:33,535::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ff82c0b-ab3c-406d-81a6-23cabef66552`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:33,535::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:33,535::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:33,535::task::993::Storage.TaskManager.Task::(_decref) Task=`8ff82c0b-ab3c-406d-81a6-23cabef66552`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:35:33,546::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:35:33,546::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1c4cadb-6d10-4279-8fd7-f03ada1c42cf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:35:33,547::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:35:33,547::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`54d9436c-c79d-4295-8fb0-7afb318fee97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:35:33,547::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:35:33,547::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:35:33,547::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`54d9436c-c79d-4295-8fb0-7afb318fee97`::Granted request >Thread-10197::DEBUG::2014-08-11 17:35:33,547::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d1c4cadb-6d10-4279-8fd7-f03ada1c42cf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:35:33,547::task::993::Storage.TaskManager.Task::(_decref) Task=`d1c4cadb-6d10-4279-8fd7-f03ada1c42cf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:35:33,586::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:33,586::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1c4cadb-6d10-4279-8fd7-f03ada1c42cf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:33,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1c4cadb-6d10-4279-8fd7-f03ada1c42cf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:35:33,586::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:35:33,586::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:35:33,587::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:35:33,587::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:35:33,587::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:35:33,587::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:35:33,587::task::993::Storage.TaskManager.Task::(_decref) Task=`d1c4cadb-6d10-4279-8fd7-f03ada1c42cf`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:35:34,850::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:34,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0245938 s, 41.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:35:35,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`9010f575-1946-47af-8416-fd90af318c00`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:35,045::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:35:35,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380189', 'lastCheck': '3.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893801', 'lastCheck': '9.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:35,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`9010f575-1946-47af-8416-fd90af318c00`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000380189', 'lastCheck': '3.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000893801', 'lastCheck': '9.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:35,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`9010f575-1946-47af-8416-fd90af318c00`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:35,045::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:35,045::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:35,045::task::993::Storage.TaskManager.Task::(_decref) Task=`9010f575-1946-47af-8416-fd90af318c00`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:35:35,065::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:35:35,066::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:35,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:35,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:35,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) (541567) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) (541567) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:35,959::__init__::225::IOProcess::(_processLogs) (541567) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:35,960::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:35:35,960::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:35:36,021::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000805859 s, 614 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:36,022::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:36,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:36,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:36,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:36,024::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:36,025::__init__::225::IOProcess::(_processLogs) (541568) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:36,027::__init__::225::IOProcess::(_processLogs) (541568) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:36,028::__init__::225::IOProcess::(_processLogs) (541568) Building response >Thread-19::DEBUG::2014-08-11 17:35:36,028::__init__::225::IOProcess::(_processLogs) (541568) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:36,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:36,029::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:35:36,030::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:35:36,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:36,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:36,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:36,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:36,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:36,033::__init__::225::IOProcess::(_processLogs) (541569) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:36,034::__init__::225::IOProcess::(_processLogs) (541569) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:36,034::__init__::225::IOProcess::(_processLogs) (541569) Building response >Thread-19::DEBUG::2014-08-11 17:35:36,035::__init__::225::IOProcess::(_processLogs) (541569) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:36,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:36,036::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:36,037::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:35:36,038::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:36,038::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:36,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:36,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:36,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:36,040::__init__::225::IOProcess::(_processLogs) (541570) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:36,041::__init__::225::IOProcess::(_processLogs) (541570) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:36,042::__init__::225::IOProcess::(_processLogs) (541570) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:36,043::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:36,044::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:36,044::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:35:36,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:36,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:36,046::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:36,046::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:36,047::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:36,048::__init__::225::IOProcess::(_processLogs) (541571) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:36,048::__init__::225::IOProcess::(_processLogs) (541571) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:36,049::__init__::225::IOProcess::(_processLogs) (541571) Building response >Thread-19::DEBUG::2014-08-11 17:35:36,049::__init__::225::IOProcess::(_processLogs) (541571) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:36,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:36,051::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:36,191::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:36,192::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:36,192::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:36,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:37,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014932 s, 68.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:35:39,022::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:35:39,083::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:35:39,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484836 s, 21.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:35:40,494::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:40,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:40,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:41,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:41,196::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:41,197::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:41,197::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:41,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158188 s, 64.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Generating json...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:41,625::__init__::225::IOProcess::(_processLogs) (541572) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:41,626::__init__::225::IOProcess::(_processLogs) (541572) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:41,626::__init__::225::IOProcess::(_processLogs) (541572) Building response >Thread-19::DEBUG::2014-08-11 17:35:41,626::__init__::225::IOProcess::(_processLogs) (541572) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:41,626::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:35:41,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:35:41,696::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00175397 s, 209 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:41,696::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) (541573) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) (541573) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) (541573) Building response >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) (541573) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:41,697::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:35:43,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:43,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630821 s, 16.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:35:43,633::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:35:43,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc9f8a4f-d93a-426c-abea-c30c80f0ea9e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:43,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:35:43,677::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:43,677::task::1191::Storage.TaskManager.Task::(prepare) Task=`cc9f8a4f-d93a-426c-abea-c30c80f0ea9e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:43,677::task::595::Storage.TaskManager.Task::(_updateState) Task=`cc9f8a4f-d93a-426c-abea-c30c80f0ea9e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:43,677::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:43,677::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:43,677::task::993::Storage.TaskManager.Task::(_decref) Task=`cc9f8a4f-d93a-426c-abea-c30c80f0ea9e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:35:43,688::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:35:43,689::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac66a82a-8921-4b6a-94d1-6242eb58295f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:35:43,689::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:35:43,689::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1cad5c54-e5e0-4099-b2c4-60fe90b9316a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:35:43,689::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:35:43,689::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:35:43,689::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1cad5c54-e5e0-4099-b2c4-60fe90b9316a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:35:43,690::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac66a82a-8921-4b6a-94d1-6242eb58295f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:35:43,690::task::993::Storage.TaskManager.Task::(_decref) Task=`ac66a82a-8921-4b6a-94d1-6242eb58295f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:35:43,709::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:43,709::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac66a82a-8921-4b6a-94d1-6242eb58295f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:43,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac66a82a-8921-4b6a-94d1-6242eb58295f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:35:43,709::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:35:43,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:35:43,709::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:35:43,709::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:35:43,709::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:35:43,709::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:35:43,710::task::993::Storage.TaskManager.Task::(_decref) Task=`ac66a82a-8921-4b6a-94d1-6242eb58295f`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:35:44,042::task::595::Storage.TaskManager.Task::(_updateState) Task=`a67aeac5-1cae-4a5d-9c4f-38d76701c2c1`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:35:44,043::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:35:44,043::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:35:44,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:44,043::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:44,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:44,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:44,044::__init__::225::IOProcess::(_processLogs) (541574) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:35:44,044::__init__::225::IOProcess::(_processLogs) (541574) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) (541574) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:44,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::INFO::2014-08-11 17:35:44,046::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:35:44,046::__init__::225::IOProcess::(_processLogs) (541575) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:35:44,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`a67aeac5-1cae-4a5d-9c4f-38d76701c2c1`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:35:44,046::__init__::225::IOProcess::(_processLogs) (541575) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:35:44,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`a67aeac5-1cae-4a5d-9c4f-38d76701c2c1`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:35:44,047::__init__::225::IOProcess::(_processLogs) (541575) Building response >Thread-10102::DEBUG::2014-08-11 17:35:44,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:35:44,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:35:44,048::__init__::225::IOProcess::(_processLogs) (541575) Queuing response >Thread-10102::DEBUG::2014-08-11 17:35:44,048::task::993::Storage.TaskManager.Task::(_decref) Task=`a67aeac5-1cae-4a5d-9c4f-38d76701c2c1`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:35:44,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:44,049::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:35:44,071::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:35:45,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:45,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0158678 s, 64.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:35:45,501::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:45,502::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:45,502::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:46,051::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:46,051::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:46,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:46,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:46,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:46,052::__init__::225::IOProcess::(_processLogs) (541576) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:46,052::__init__::225::IOProcess::(_processLogs) (541576) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:46,052::__init__::225::IOProcess::(_processLogs) (541576) Queuing response >Thread-28::DEBUG::2014-08-11 17:35:46,053::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:35:46,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:46,113::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:35:46,116::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00210718 s, 235 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:46,117::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:46,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:46,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:46,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:46,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:46,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:46,121::__init__::225::IOProcess::(_processLogs) (541577) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:46,122::__init__::225::IOProcess::(_processLogs) (541577) Building response >Thread-19::DEBUG::2014-08-11 17:35:46,122::__init__::225::IOProcess::(_processLogs) (541577) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:46,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:46,123::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:35:46,124::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:35:46,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:46,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:46,126::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:46,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:46,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:46,128::__init__::225::IOProcess::(_processLogs) (541578) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:46,128::__init__::225::IOProcess::(_processLogs) (541578) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:46,129::__init__::225::IOProcess::(_processLogs) (541578) Building response >Thread-19::DEBUG::2014-08-11 17:35:46,129::__init__::225::IOProcess::(_processLogs) (541578) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:46,130::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:46,132::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:35:46,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:46,133::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:46,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:46,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:46,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:46,135::__init__::225::IOProcess::(_processLogs) (541579) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:46,136::__init__::225::IOProcess::(_processLogs) (541579) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:46,136::__init__::225::IOProcess::(_processLogs) (541579) Building response >Thread-19::DEBUG::2014-08-11 17:35:46,137::__init__::225::IOProcess::(_processLogs) (541579) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:46,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:46,139::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:35:46,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:46,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:46,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:46,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:46,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:46,142::__init__::225::IOProcess::(_processLogs) (541580) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:46,143::__init__::225::IOProcess::(_processLogs) (541580) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:46,144::__init__::225::IOProcess::(_processLogs) (541580) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:46,144::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:46,145::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:46,203::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:46,203::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:46,204::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:47,438::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:47,549::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511913 s, 20.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:35:49,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:49,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180536 s, 56.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:35:49,694::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10237::DEBUG::2014-08-11 17:35:50,264::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbea1004-cbd0-4437-9905-a6f279d3d0e8`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:50,265::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:35:50,265::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175397', 'lastCheck': '8.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00210718', 'lastCheck': '4.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:50,265::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbea1004-cbd0-4437-9905-a6f279d3d0e8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00175397', 'lastCheck': '8.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00210718', 'lastCheck': '4.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:35:50,265::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbea1004-cbd0-4437-9905-a6f279d3d0e8`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:50,265::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:50,265::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:50,265::task::993::Storage.TaskManager.Task::(_decref) Task=`bbea1004-cbd0-4437-9905-a6f279d3d0e8`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:35:50,486::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:35:50,486::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:50,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:50,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:50,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:51,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:51,207::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:51,208::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:51,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) (541581) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:51,699::__init__::225::IOProcess::(_processLogs) (541581) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:51,700::__init__::225::IOProcess::(_processLogs) (541581) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:51,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:35:51,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:35:51,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000818764 s, 447 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:51,773::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:51,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:51,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:51,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:51,776::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Dummy-51::DEBUG::2014-08-11 17:35:51,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0747152 s, 13.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:51,777::__init__::225::IOProcess::(_processLogs) (541582) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:51,778::__init__::225::IOProcess::(_processLogs) (541582) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:51,778::__init__::225::IOProcess::(_processLogs) (541582) Building response >Thread-19::DEBUG::2014-08-11 17:35:51,779::__init__::225::IOProcess::(_processLogs) (541582) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:51,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:51,780::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:35:53,764::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:35:53,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`3da78484-a4f5-481d-bb70-5b2ce87f36eb`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:35:53,764::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:35:53,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::INFO::2014-08-11 17:35:53,850::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:53,852::task::1191::Storage.TaskManager.Task::(prepare) Task=`3da78484-a4f5-481d-bb70-5b2ce87f36eb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:35:53,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`3da78484-a4f5-481d-bb70-5b2ce87f36eb`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:35:53,852::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:35:53,852::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:35:53,852::task::993::Storage.TaskManager.Task::(_decref) Task=`3da78484-a4f5-481d-bb70-5b2ce87f36eb`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:35:53,864::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:35:53,864::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6c3b998-7306-4f68-861f-02682fbfa873`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:35:53,864::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:35:53,864::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`09e0fcf4-fc8a-41f8-a483-5992de4c1a49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:35:53,864::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:35:53,865::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:35:53,865::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`09e0fcf4-fc8a-41f8-a483-5992de4c1a49`::Granted request >Thread-10197::DEBUG::2014-08-11 17:35:53,865::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e6c3b998-7306-4f68-861f-02682fbfa873`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:35:53,865::task::993::Storage.TaskManager.Task::(_decref) Task=`e6c3b998-7306-4f68-861f-02682fbfa873`::ref 1 aborting False >Dummy-51::DEBUG::2014-08-11 17:35:53,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0751064 s, 13.6 MB/s\n'; <rc> = 0 >Thread-10197::INFO::2014-08-11 17:35:53,940::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:53,940::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6c3b998-7306-4f68-861f-02682fbfa873`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:35:53,940::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6c3b998-7306-4f68-861f-02682fbfa873`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:35:53,940::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:35:53,940::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:35:53,940::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:35:53,940::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:35:53,940::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:35:53,940::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:35:53,941::task::993::Storage.TaskManager.Task::(_decref) Task=`e6c3b998-7306-4f68-861f-02682fbfa873`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:35:54,121::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:35:55,514::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:55,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:35:55,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:35:55,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:56,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125115 s, 81.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) (541583) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:56,145::__init__::225::IOProcess::(_processLogs) (541583) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:56,146::__init__::225::IOProcess::(_processLogs) (541583) Queuing response >Thread-28::DEBUG::2014-08-11 17:35:56,146::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:35:56,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:56,205::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:35:56,207::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000929357 s, 533 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:35:56,209::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:35:56,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:56,210::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:56,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:56,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:56,212::__init__::225::IOProcess::(_processLogs) (541584) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:35:56,213::__init__::225::IOProcess::(_processLogs) (541584) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:35:56,214::__init__::225::IOProcess::(_processLogs) (541584) Building response >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:56,215::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:56,215::__init__::225::IOProcess::(_processLogs) (541584) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:56,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:56,217::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:35:56,219::__init__::225::IOProcess::(_processLogs) Message size is 199 >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:56,219::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:56,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:56,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:56,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:56,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:35:56,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:35:56,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:56,224::__init__::225::IOProcess::(_processLogs) (541585) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:56,225::__init__::225::IOProcess::(_processLogs) (541585) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:56,226::__init__::225::IOProcess::(_processLogs) (541585) Building response >Thread-19::DEBUG::2014-08-11 17:35:56,226::__init__::225::IOProcess::(_processLogs) (541585) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:56,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:56,228::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:35:56,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:56,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:56,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:56,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:56,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:35:56,231::__init__::225::IOProcess::(_processLogs) (541586) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:56,232::__init__::225::IOProcess::(_processLogs) (541586) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:56,232::__init__::225::IOProcess::(_processLogs) (541586) Building response >Thread-19::DEBUG::2014-08-11 17:35:56,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:56,234::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:35:56,235::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:35:56,235::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:35:56,236::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:35:56,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:35:56,237::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:35:56,238::__init__::225::IOProcess::(_processLogs) (541587) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:35:56,239::__init__::225::IOProcess::(_processLogs) (541587) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:35:56,239::__init__::225::IOProcess::(_processLogs) (541587) Building response >Thread-19::DEBUG::2014-08-11 17:35:56,240::__init__::225::IOProcess::(_processLogs) (541587) Queuing response >Thread-19::DEBUG::2014-08-11 17:35:56,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:35:56,241::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:35:58,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:35:58,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0565087 s, 18.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:35:59,122::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:36:00,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:00,250::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0524816 s, 19.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:36:00,518::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:00,518::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:00,519::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:01,225::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:01,226::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:01,226::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:36:01,709::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-27::DEBUG::2014-08-11 17:36:01,778::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:36:01,781::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:36:01,781::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,782::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,782::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,784::__init__::225::IOProcess::(_processLogs) (541588) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:36:01,784::__init__::225::IOProcess::(_processLogs) (541588) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:36:01,785::__init__::225::IOProcess::(_processLogs) (541588) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:01,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:01,786::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:36:01,787::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:36:01,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,790::__init__::225::IOProcess::(_processLogs) (541589) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:36:01,790::__init__::225::IOProcess::(_processLogs) (541589) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:36:01,791::__init__::225::IOProcess::(_processLogs) (541589) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:01,792::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:01,793::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:36:01,810::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:36:01,811::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:36:01,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,812::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,813::__init__::225::IOProcess::(_processLogs) (541590) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:36:01,814::__init__::225::IOProcess::(_processLogs) (541590) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:36:01,821::__init__::225::IOProcess::(_processLogs) (541590) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:01,822::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:36:01,822::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:36:01,823::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:36:01,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,824::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,826::__init__::225::IOProcess::(_processLogs) (541591) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:36:01,826::__init__::225::IOProcess::(_processLogs) (541591) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:36:01,827::__init__::225::IOProcess::(_processLogs) (541591) Building response >Thread-19::DEBUG::2014-08-11 17:36:01,827::__init__::225::IOProcess::(_processLogs) (541591) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:01,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:01,828::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:36:01,829::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:36:01,830::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:36:01,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,833::__init__::225::IOProcess::(_processLogs) (541592) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:01,833::__init__::225::IOProcess::(_processLogs) (541592) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:01,834::__init__::225::IOProcess::(_processLogs) (541592) Building response >Thread-19::DEBUG::2014-08-11 17:36:01,834::__init__::225::IOProcess::(_processLogs) (541592) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:01,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:01,835::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:01,836::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:36:01,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,839::__init__::225::IOProcess::(_processLogs) (541593) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:36:01,839::__init__::225::IOProcess::(_processLogs) (541593) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:36:01,840::__init__::225::IOProcess::(_processLogs) (541593) Queuing response >Thread-27::DEBUG::2014-08-11 17:36:01,840::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:36:01,841::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::INFO::2014-08-11 17:36:01,841::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:36:01,842::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-27::INFO::2014-08-11 17:36:01,842::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:36:01,843::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:01,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,846::__init__::225::IOProcess::(_processLogs) (541594) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:01,846::__init__::225::IOProcess::(_processLogs) (541594) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:01,847::__init__::225::IOProcess::(_processLogs) (541594) Queuing response >Thread-27::DEBUG::2014-08-11 17:36:01,847::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:36:01,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:01,906::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:36:01,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000683662 s, 535 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:01,909::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:01,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:01,910::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:01,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:01,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:01,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:01,912::__init__::225::IOProcess::(_processLogs) (541595) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:01,912::__init__::225::IOProcess::(_processLogs) (541595) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:01,913::__init__::225::IOProcess::(_processLogs) (541595) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:01,914::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:01,915::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:36:02,258::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:02,353::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335427 s, 30.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:36:03,985::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:36:03,985::task::595::Storage.TaskManager.Task::(_updateState) Task=`b204b36b-2eb8-4744-acc2-04b081b51d9c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:03,985::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:36:03,999::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:03,999::task::1191::Storage.TaskManager.Task::(prepare) Task=`b204b36b-2eb8-4744-acc2-04b081b51d9c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:03,999::task::595::Storage.TaskManager.Task::(_updateState) Task=`b204b36b-2eb8-4744-acc2-04b081b51d9c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:03,999::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:03,999::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:03,999::task::993::Storage.TaskManager.Task::(_decref) Task=`b204b36b-2eb8-4744-acc2-04b081b51d9c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:36:04,008::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:36:04,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5a4a1be-8ac8-49e3-8e93-91fed85272e7`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:36:04,009::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:36:04,009::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`10bbeb14-d636-4ccb-a5cb-9c7cd56fa8fa`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:36:04,009::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:36:04,009::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:36:04,009::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`10bbeb14-d636-4ccb-a5cb-9c7cd56fa8fa`::Granted request >Thread-10197::DEBUG::2014-08-11 17:36:04,009::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a5a4a1be-8ac8-49e3-8e93-91fed85272e7`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:36:04,010::task::993::Storage.TaskManager.Task::(_decref) Task=`a5a4a1be-8ac8-49e3-8e93-91fed85272e7`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:36:04,026::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:04,026::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5a4a1be-8ac8-49e3-8e93-91fed85272e7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:04,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5a4a1be-8ac8-49e3-8e93-91fed85272e7`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:36:04,026::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:36:04,026::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:36:04,027::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:36:04,027::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:36:04,027::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:36:04,027::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:36:04,027::task::993::Storage.TaskManager.Task::(_decref) Task=`a5a4a1be-8ac8-49e3-8e93-91fed85272e7`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:36:04,425::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:04,504::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0203805 s, 50.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:36:05,524::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:05,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:05,525::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:05,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e0c639-73ac-4cf8-812a-70fb99a721dc`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:05,675::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:36:05,676::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683662', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000929357', 'lastCheck': '9.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:05,676::task::1191::Storage.TaskManager.Task::(prepare) Task=`36e0c639-73ac-4cf8-812a-70fb99a721dc`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000683662', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000929357', 'lastCheck': '9.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:05,676::task::595::Storage.TaskManager.Task::(_updateState) Task=`36e0c639-73ac-4cf8-812a-70fb99a721dc`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:05,676::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:05,676::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:05,676::task::993::Storage.TaskManager.Task::(_decref) Task=`36e0c639-73ac-4cf8-812a-70fb99a721dc`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:36:05,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:05,694::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:06,231::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:06,232::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:06,232::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) (541596) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:06,239::__init__::225::IOProcess::(_processLogs) (541596) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:06,241::__init__::225::IOProcess::(_processLogs) (541596) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:06,241::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:36:06,242::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:36:06,303::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00141278 s, 350 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:06,304::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:06,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:06,305::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:06,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:06,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:06,307::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:06,307::__init__::225::IOProcess::(_processLogs) (541597) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:06,308::__init__::225::IOProcess::(_processLogs) (541597) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:06,309::__init__::225::IOProcess::(_processLogs) (541597) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:06,310::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:06,310::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:36:06,311::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:36:06,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:06,312::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:06,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:06,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:06,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:06,314::__init__::225::IOProcess::(_processLogs) (541598) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:06,315::__init__::225::IOProcess::(_processLogs) (541598) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:06,316::__init__::225::IOProcess::(_processLogs) (541598) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:06,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:06,317::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:06,318::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:36:06,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:06,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:06,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:06,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:06,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:06,321::__init__::225::IOProcess::(_processLogs) (541599) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:06,322::__init__::225::IOProcess::(_processLogs) (541599) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:06,322::__init__::225::IOProcess::(_processLogs) (541599) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:06,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:06,324::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:06,325::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:36:06,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:06,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:06,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:06,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:06,327::__init__::225::IOProcess::(_processLogs) (541600) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:06,328::__init__::225::IOProcess::(_processLogs) (541600) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:06,329::__init__::225::IOProcess::(_processLogs) (541600) Building response >Thread-19::DEBUG::2014-08-11 17:36:06,329::__init__::225::IOProcess::(_processLogs) (541600) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:06,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:06,331::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:36:06,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:06,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600861 s, 17.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:36:08,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:08,758::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580051 s, 17.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:36:09,129::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:36:10,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:10,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:10,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:36:10,766::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:10,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265407 s, 38.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:11,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:11,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:11,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) (541601) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:11,915::__init__::225::IOProcess::(_processLogs) (541601) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:11,916::__init__::225::IOProcess::(_processLogs) (541601) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:11,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:36:11,916::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:36:11,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000859203 s, 426 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:11,976::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:11,976::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:11,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:11,977::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:11,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:11,977::__init__::225::IOProcess::(_processLogs) (541602) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:11,977::__init__::225::IOProcess::(_processLogs) (541602) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:11,977::__init__::225::IOProcess::(_processLogs) (541602) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:11,978::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:36:12,869::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:12,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051096 s, 20.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:36:14,130::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:36:14,149::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:36:14,149::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2ba10ee-0754-4dd5-a267-51fd0a13937b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:14,149::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:36:14,206::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:14,206::task::1191::Storage.TaskManager.Task::(prepare) Task=`b2ba10ee-0754-4dd5-a267-51fd0a13937b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:14,206::task::595::Storage.TaskManager.Task::(_updateState) Task=`b2ba10ee-0754-4dd5-a267-51fd0a13937b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:14,206::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:14,206::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:14,206::task::993::Storage.TaskManager.Task::(_decref) Task=`b2ba10ee-0754-4dd5-a267-51fd0a13937b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:36:14,218::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:36:14,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`922d1bb8-4d70-44e4-bd7e-f2b02802121a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:36:14,218::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:36:14,218::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2f6440e9-3630-4f3d-8613-45f79ea147bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:36:14,218::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:36:14,219::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:36:14,219::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2f6440e9-3630-4f3d-8613-45f79ea147bf`::Granted request >Thread-10197::DEBUG::2014-08-11 17:36:14,219::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`922d1bb8-4d70-44e4-bd7e-f2b02802121a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:36:14,219::task::993::Storage.TaskManager.Task::(_decref) Task=`922d1bb8-4d70-44e4-bd7e-f2b02802121a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:36:14,236::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:14,236::task::1191::Storage.TaskManager.Task::(prepare) Task=`922d1bb8-4d70-44e4-bd7e-f2b02802121a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:14,236::task::595::Storage.TaskManager.Task::(_updateState) Task=`922d1bb8-4d70-44e4-bd7e-f2b02802121a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:36:14,236::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:36:14,236::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:36:14,237::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:36:14,237::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:36:14,237::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:36:14,237::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:36:14,237::task::993::Storage.TaskManager.Task::(_decref) Task=`922d1bb8-4d70-44e4-bd7e-f2b02802121a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:36:14,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:15,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431444 s, 23.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:36:15,565::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:15,565::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:15,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:16,242::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:16,242::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:16,242::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) (541603) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:16,329::__init__::225::IOProcess::(_processLogs) (541603) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:16,330::__init__::225::IOProcess::(_processLogs) (541603) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:16,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:36:16,330::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:36:16,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00104852 s, 472 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:16,393::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:16,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:16,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:16,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:16,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:16,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:16,401::__init__::225::IOProcess::(_processLogs) (541604) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:16,402::__init__::225::IOProcess::(_processLogs) (541604) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:16,403::__init__::225::IOProcess::(_processLogs) (541604) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:16,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:16,405::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:36:16,406::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:36:16,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:16,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:16,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:16,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:16,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:16,409::__init__::225::IOProcess::(_processLogs) (541605) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:16,410::__init__::225::IOProcess::(_processLogs) (541605) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:16,411::__init__::225::IOProcess::(_processLogs) (541605) Building response >Thread-19::DEBUG::2014-08-11 17:36:16,411::__init__::225::IOProcess::(_processLogs) (541605) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:16,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:16,413::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:36:16,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:16,414::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:16,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:16,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:16,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:16,416::__init__::225::IOProcess::(_processLogs) (541606) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:16,417::__init__::225::IOProcess::(_processLogs) (541606) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:16,418::__init__::225::IOProcess::(_processLogs) (541606) Building response >Thread-19::DEBUG::2014-08-11 17:36:16,418::__init__::225::IOProcess::(_processLogs) (541606) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:16,419::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:16,420::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:36:16,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:16,421::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:16,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:16,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:16,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:16,423::__init__::225::IOProcess::(_processLogs) (541607) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:16,424::__init__::225::IOProcess::(_processLogs) (541607) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:16,425::__init__::225::IOProcess::(_processLogs) (541607) Building response >Thread-19::DEBUG::2014-08-11 17:36:16,425::__init__::225::IOProcess::(_processLogs) (541607) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:16,426::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:36:17,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:17,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0440508 s, 23.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:36:19,207::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:19,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.02502 s, 40.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:36:19,728::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:36:20,569::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:20,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:20,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:20,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fe9d9a1-02dc-4f21-80fe-a91023efcfb9`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:20,925::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:36:20,925::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000859203', 'lastCheck': '8.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104852', 'lastCheck': '4.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:20,925::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fe9d9a1-02dc-4f21-80fe-a91023efcfb9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000859203', 'lastCheck': '8.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104852', 'lastCheck': '4.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:20,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fe9d9a1-02dc-4f21-80fe-a91023efcfb9`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:20,926::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:20,926::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:20,926::task::993::Storage.TaskManager.Task::(_decref) Task=`3fe9d9a1-02dc-4f21-80fe-a91023efcfb9`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:36:21,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:21,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:21,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:21,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:21,248::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:36:21,302::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:21,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.068849 s, 14.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) (541608) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) (541608) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:21,979::__init__::225::IOProcess::(_processLogs) (541608) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:21,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:36:21,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:36:22,043::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00232174 s, 158 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:22,044::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:22,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:22,044::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:22,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:22,044::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:22,045::__init__::225::IOProcess::(_processLogs) (541609) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:22,045::__init__::225::IOProcess::(_processLogs) (541609) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:22,046::__init__::225::IOProcess::(_processLogs) (541609) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:22,046::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:36:23,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:23,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141328 s, 72.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:36:24,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`5379f154-a3b2-4c47-9610-b109a8d0056c`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:36:24,132::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:36:24,132::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:36:24,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:24,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:24,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:24,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:24,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:24,133::__init__::225::IOProcess::(_processLogs) (541610) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:36:24,133::__init__::225::IOProcess::(_processLogs) (541610) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:36:24,135::__init__::225::IOProcess::(_processLogs) DEBUG|(541610) Building response >Thread-19::DEBUG::2014-08-11 17:36:24,135::__init__::225::IOProcess::(_processLogs) (541610) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:24,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:24,136::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:36:24,137::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:24,137::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:36:24,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:24,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:24,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:24,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:24,138::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-10017::INFO::2014-08-11 17:36:24,138::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:36:24,139::__init__::225::IOProcess::(_processLogs) (541611) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:36:24,139::task::1191::Storage.TaskManager.Task::(prepare) Task=`5379f154-a3b2-4c47-9610-b109a8d0056c`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:36:24,139::__init__::225::IOProcess::(_processLogs) (541611) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:36:24,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`5379f154-a3b2-4c47-9610-b109a8d0056c`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:36:24,140::__init__::225::IOProcess::(_processLogs) (541611) Building response >Thread-10017::DEBUG::2014-08-11 17:36:24,140::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:36:24,140::__init__::225::IOProcess::(_processLogs) (541611) Queuing response >Thread-10017::DEBUG::2014-08-11 17:36:24,140::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:36:24,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:36:24,141::task::993::Storage.TaskManager.Task::(_decref) Task=`5379f154-a3b2-4c47-9610-b109a8d0056c`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:36:24,141::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:36:24,163::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:36:24,302::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:36:24,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd33f130-2053-46f6-a667-7a09a28de020`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:24,302::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:36:24,322::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:24,322::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd33f130-2053-46f6-a667-7a09a28de020`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:24,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd33f130-2053-46f6-a667-7a09a28de020`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:24,323::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:24,323::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:24,323::task::993::Storage.TaskManager.Task::(_decref) Task=`dd33f130-2053-46f6-a667-7a09a28de020`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:36:24,329::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:36:24,330::task::595::Storage.TaskManager.Task::(_updateState) Task=`9da5a197-a4c9-4ad5-92b5-fa9f9bafc18f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:36:24,330::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:36:24,330::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bf231e32-1ca4-4668-b0cc-d75ae8e00360`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:36:24,330::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:36:24,330::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:36:24,330::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bf231e32-1ca4-4668-b0cc-d75ae8e00360`::Granted request >Thread-10197::DEBUG::2014-08-11 17:36:24,330::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9da5a197-a4c9-4ad5-92b5-fa9f9bafc18f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:36:24,330::task::993::Storage.TaskManager.Task::(_decref) Task=`9da5a197-a4c9-4ad5-92b5-fa9f9bafc18f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:36:24,347::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:24,347::task::1191::Storage.TaskManager.Task::(prepare) Task=`9da5a197-a4c9-4ad5-92b5-fa9f9bafc18f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:24,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`9da5a197-a4c9-4ad5-92b5-fa9f9bafc18f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:36:24,347::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:36:24,347::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:36:24,348::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:36:24,348::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:36:24,348::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:36:24,348::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:36:24,348::task::993::Storage.TaskManager.Task::(_decref) Task=`9da5a197-a4c9-4ad5-92b5-fa9f9bafc18f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:36:25,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:36:25,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:25,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:25,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:36:25,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160811 s, 63.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:26,254::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:26,254::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:26,254::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:26,427::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:26,427::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:26,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:26,427::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:26,427::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:26,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:26,428::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:26,428::__init__::225::IOProcess::(_processLogs) (541612) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:26,428::__init__::225::IOProcess::(_processLogs) (541612) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:26,429::__init__::225::IOProcess::(_processLogs) DEBUG|(541612) Building response >Thread-19::DEBUG::2014-08-11 17:36:26,429::__init__::225::IOProcess::(_processLogs) (541612) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:26,429::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:36:26,430::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:36:26,430::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:36:26,495::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00350018 s, 141 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:26,497::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:26,497::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:26,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:26,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:26,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:26,500::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:26,501::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:26,502::__init__::225::IOProcess::(_processLogs) (541613) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:26,502::__init__::225::IOProcess::(_processLogs) (541613) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:26,503::__init__::225::IOProcess::(_processLogs) (541613) Building response >Thread-19::DEBUG::2014-08-11 17:36:26,503::__init__::225::IOProcess::(_processLogs) (541613) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:26,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:26,504::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:36:26,505::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:26,506::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:36:26,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:26,507::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:26,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:26,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:26,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:26,509::__init__::225::IOProcess::(_processLogs) (541614) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:26,509::__init__::225::IOProcess::(_processLogs) (541614) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:26,510::__init__::225::IOProcess::(_processLogs) DEBUG|(541614) Building response >Thread-19::DEBUG::2014-08-11 17:36:26,511::__init__::225::IOProcess::(_processLogs) (541614) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:26,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:26,512::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:26,513::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:26,513::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:36:26,514::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:26,514::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:26,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:26,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:26,516::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:26,516::__init__::225::IOProcess::(_processLogs) (541615) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:26,517::__init__::225::IOProcess::(_processLogs) (541615) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:26,517::__init__::225::IOProcess::(_processLogs) (541615) Building response >Thread-19::DEBUG::2014-08-11 17:36:26,518::__init__::225::IOProcess::(_processLogs) (541615) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:26,519::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:26,520::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:26,521::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:26,521::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:36:26,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:26,522::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:26,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:26,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:26,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:26,524::__init__::225::IOProcess::(_processLogs) (541616) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:26,524::__init__::225::IOProcess::(_processLogs) (541616) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:26,525::__init__::225::IOProcess::(_processLogs) (541616) Building response >Thread-19::DEBUG::2014-08-11 17:36:26,526::__init__::225::IOProcess::(_processLogs) (541616) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:26,527::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:36:26,527::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:36:27,648::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:27,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0139891 s, 73.2 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:36:29,138::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:36:29,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:29,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124036 s, 82.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:36:30,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:30,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:30,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:31,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:31,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:31,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:36:31,788::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:36:31,807::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:31,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0182407 s, 56.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:32,048::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:32,048::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:32,049::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:32,049::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:32,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:32,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:32,051::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Extracting request information... >Thread-27::DEBUG::2014-08-11 17:36:32,052::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:36:32,052::__init__::225::IOProcess::(_processLogs) (541617) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:32,111::__init__::225::IOProcess::(_processLogs) (541617) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:32,112::__init__::225::IOProcess::(_processLogs) (541617) Building response >Thread-19::DEBUG::2014-08-11 17:36:32,112::__init__::225::IOProcess::(_processLogs) (541617) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:32,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:32,113::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:36:32,114::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0008884 s, 412 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:32,115::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:32,116::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:32,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:32,117::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:32,117::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:32,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:32,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:32,119::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541618) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:32,120::__init__::225::IOProcess::(_processLogs) (541618) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:32,120::__init__::225::IOProcess::(_processLogs) (541618) Building response >Thread-19::DEBUG::2014-08-11 17:36:32,121::__init__::225::IOProcess::(_processLogs) (541618) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:32,121::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:32,122::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:36:33,941::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:34,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0467137 s, 21.9 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:36:34,376::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:36:34,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de37168-9395-4401-8658-772dc7af5c12`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:34,377::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:36:34,392::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:34,392::task::1191::Storage.TaskManager.Task::(prepare) Task=`9de37168-9395-4401-8658-772dc7af5c12`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:34,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`9de37168-9395-4401-8658-772dc7af5c12`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:34,392::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:34,392::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:34,393::task::993::Storage.TaskManager.Task::(_decref) Task=`9de37168-9395-4401-8658-772dc7af5c12`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:36:34,403::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:36:34,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e49a1b1-9bc8-44ca-9744-146905708f24`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:36:34,403::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:36:34,404::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9982b7dc-cc81-4904-b28e-b2bbb5bcd859`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:36:34,404::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:36:34,404::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:36:34,404::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9982b7dc-cc81-4904-b28e-b2bbb5bcd859`::Granted request >Thread-10197::DEBUG::2014-08-11 17:36:34,404::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5e49a1b1-9bc8-44ca-9744-146905708f24`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:36:34,404::task::993::Storage.TaskManager.Task::(_decref) Task=`5e49a1b1-9bc8-44ca-9744-146905708f24`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:36:34,425::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:34,425::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e49a1b1-9bc8-44ca-9744-146905708f24`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:34,425::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e49a1b1-9bc8-44ca-9744-146905708f24`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:36:34,425::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:36:34,425::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:36:34,425::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:36:34,426::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:36:34,426::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:36:34,426::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:36:34,426::task::993::Storage.TaskManager.Task::(_decref) Task=`5e49a1b1-9bc8-44ca-9744-146905708f24`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:36:35,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:35,609::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:35,609::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:36:36,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:36,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132176 s, 77.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:36,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:36,260::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:36,261::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:36,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e6e9216-1cf0-45cb-8dd0-41902960967f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:36,332::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:36:36,332::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0008884', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00350018', 'lastCheck': '9.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:36,332::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e6e9216-1cf0-45cb-8dd0-41902960967f`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0008884', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00350018', 'lastCheck': '9.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:36,332::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e6e9216-1cf0-45cb-8dd0-41902960967f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:36,333::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:36,333::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:36,333::task::993::Storage.TaskManager.Task::(_decref) Task=`8e6e9216-1cf0-45cb-8dd0-41902960967f`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:36:36,347::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:36,347::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:36,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:36,529::__init__::225::IOProcess::(_processLogs) (541619) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:36,529::__init__::225::IOProcess::(_processLogs) (541619) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:36,529::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541619) Building response >Thread-19::DEBUG::2014-08-11 17:36:36,529::__init__::225::IOProcess::(_processLogs) (541619) Queuing response >Thread-28::DEBUG::2014-08-11 17:36:36,529::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:36:36,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:36,589::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:36:36,590::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000713801 s, 693 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:36,591::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:36,592::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:36,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:36,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:36,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:36,594::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:36,595::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:36,595::__init__::225::IOProcess::(_processLogs) (541620) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:36,596::__init__::225::IOProcess::(_processLogs) (541620) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:36,597::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541620) Building response >Thread-19::DEBUG::2014-08-11 17:36:36,599::__init__::225::IOProcess::(_processLogs) (541620) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:36,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:36,600::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:36:36,601::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:36,601::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:36:36,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:36,602::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:36,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:36,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:36,605::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:36,605::__init__::225::IOProcess::(_processLogs) (541621) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:36,606::__init__::225::IOProcess::(_processLogs) (541621) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:36,607::__init__::225::IOProcess::(_processLogs) (541621) Building response >Thread-19::DEBUG::2014-08-11 17:36:36,607::__init__::225::IOProcess::(_processLogs) (541621) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:36,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:36,608::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:36,609::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:36,610::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:36:36,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:36,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:36,611::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:36,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:36,613::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:36,613::__init__::225::IOProcess::(_processLogs) (541622) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:36,614::__init__::225::IOProcess::(_processLogs) (541622) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:36,614::__init__::225::IOProcess::(_processLogs) (541622) Building response >Thread-19::DEBUG::2014-08-11 17:36:36,615::__init__::225::IOProcess::(_processLogs) (541622) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:36,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:36,616::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:36,617::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:36,617::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:36:36,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:36,618::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:36,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:36,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:36,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:36,620::__init__::225::IOProcess::(_processLogs) (541623) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:36,621::__init__::225::IOProcess::(_processLogs) (541623) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:36,621::__init__::225::IOProcess::(_processLogs) (541623) Building response >Thread-19::DEBUG::2014-08-11 17:36:36,622::__init__::225::IOProcess::(_processLogs) (541623) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:36,623::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:36:36,624::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:36:38,135::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:38,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535357 s, 19.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:36:39,200::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:36:40,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:40,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.043516 s, 23.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:36:40,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:40,613::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:40,613::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:41,266::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:41,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:41,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:42,120::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:42,120::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) (541624) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) (541624) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:42,121::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541624) Building response >Thread-19::DEBUG::2014-08-11 17:36:42,122::__init__::225::IOProcess::(_processLogs) (541624) Queuing response >Thread-27::DEBUG::2014-08-11 17:36:42,122::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:36:42,122::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:42,181::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:36:42,183::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00102798 s, 356 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:42,183::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:42,183::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) (541625) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) (541625) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:42,184::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541625) Building response >Thread-19::DEBUG::2014-08-11 17:36:42,185::__init__::225::IOProcess::(_processLogs) (541625) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:42,185::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:42,185::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:36:42,367::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:42,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0513932 s, 19.9 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:36:44,194::task::595::Storage.TaskManager.Task::(_updateState) Task=`04fbcbe9-3455-4c1b-b034-39bcca70972d`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:36:44,195::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:36:44,195::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:44,195::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:36:44,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:44,195::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:44,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:44,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:44,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:44,196::__init__::225::IOProcess::(_processLogs) (541626) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:36:44,196::__init__::225::IOProcess::(_processLogs) (541626) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:36:44,197::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541626) Building response >Thread-19::DEBUG::2014-08-11 17:36:44,197::__init__::225::IOProcess::(_processLogs) (541626) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:44,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:44,197::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:36:44,197::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:44,198::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:36:44,198::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Marshaling message... >Thread-10102::INFO::2014-08-11 17:36:44,198::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:36:44,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:36:44,199::task::1191::Storage.TaskManager.Task::(prepare) Task=`04fbcbe9-3455-4c1b-b034-39bcca70972d`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10102::DEBUG::2014-08-11 17:36:44,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`04fbcbe9-3455-4c1b-b034-39bcca70972d`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:36:44,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:36:44,199::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:36:44,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:36:44,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:36:44,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:36:44,200::task::993::Storage.TaskManager.Task::(_decref) Task=`04fbcbe9-3455-4c1b-b034-39bcca70972d`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:36:44,201::__init__::225::IOProcess::(_processLogs) (541627) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:36:44,201::__init__::225::IOProcess::(_processLogs) (541627) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:36:44,201::__init__::225::IOProcess::(_processLogs) (541627) Building response >Thread-19::DEBUG::2014-08-11 17:36:44,202::__init__::225::IOProcess::(_processLogs) (541627) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:44,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:44,202::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:36:44,223::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:36:44,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:36:44,549::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:36:44,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`077866bd-173e-45e2-bf67-f932060e6417`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:44,550::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:36:44,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814031 s, 12.6 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:36:44,639::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:44,639::task::1191::Storage.TaskManager.Task::(prepare) Task=`077866bd-173e-45e2-bf67-f932060e6417`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:44,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`077866bd-173e-45e2-bf67-f932060e6417`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:44,640::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:44,640::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:44,640::task::993::Storage.TaskManager.Task::(_decref) Task=`077866bd-173e-45e2-bf67-f932060e6417`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:36:44,649::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:36:44,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9f185c1-2553-4a6b-9ce4-385e021e891c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:36:44,650::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:36:44,650::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`290abf64-7ba7-40cb-b86a-29571d6f6677`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:36:44,650::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:36:44,650::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:36:44,650::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`290abf64-7ba7-40cb-b86a-29571d6f6677`::Granted request >Thread-10197::DEBUG::2014-08-11 17:36:44,651::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a9f185c1-2553-4a6b-9ce4-385e021e891c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:36:44,651::task::993::Storage.TaskManager.Task::(_decref) Task=`a9f185c1-2553-4a6b-9ce4-385e021e891c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:36:44,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:44,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9f185c1-2553-4a6b-9ce4-385e021e891c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:44,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9f185c1-2553-4a6b-9ce4-385e021e891c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:36:44,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:36:44,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:36:44,670::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:36:44,671::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:36:44,671::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:36:44,671::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:36:44,671::task::993::Storage.TaskManager.Task::(_decref) Task=`a9f185c1-2553-4a6b-9ce4-385e021e891c`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:36:45,616::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:45,616::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:45,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:46,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:46,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:46,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:46,624::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:46,624::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:46,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:46,624::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) (541628) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) (541628) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541628) Building response >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) (541628) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:46,625::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:36:46,626::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:36:46,626::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:46,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:36:46,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00083181 s, 595 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:46,746::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:46,747::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:46,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:46,748::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:46,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:46,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:46,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:46,750::__init__::225::IOProcess::(_processLogs) (541629) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:46,751::__init__::225::IOProcess::(_processLogs) (541629) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:46,758::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|(541629) Building response >Thread-19::DEBUG::2014-08-11 17:36:46,758::__init__::225::IOProcess::(_processLogs) (541629) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:46,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:46,760::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:36:46,761::__init__::225::IOProcess::(_processLogs) (541615) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:46,761::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:36:46,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:46,762::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:46,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:46,764::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:46,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:46,765::__init__::225::IOProcess::(_processLogs) (541630) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:46,765::__init__::225::IOProcess::(_processLogs) (541630) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:46,766::__init__::225::IOProcess::(_processLogs) (541630) Building response >Thread-19::DEBUG::2014-08-11 17:36:46,766::__init__::225::IOProcess::(_processLogs) (541630) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:46,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:46,768::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:46,768::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:36:46,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:46,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:46,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:46,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:46,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:46,771::__init__::225::IOProcess::(_processLogs) (541631) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:46,772::__init__::225::IOProcess::(_processLogs) (541631) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:46,773::__init__::225::IOProcess::(_processLogs) (541631) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:46,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:46,774::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:46,775::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:36:46,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:46,778::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:46,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:46,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:46,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:46,782::__init__::225::IOProcess::(_processLogs) (541632) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:46,784::__init__::225::IOProcess::(_processLogs) (541632) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:46,786::__init__::225::IOProcess::(_processLogs) (541632) Queuing response >Dummy-51::DEBUG::2014-08-11 17:36:46,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0290891 s, 35.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:46,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:46,788::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:36:48,847::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:48,945::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392344 s, 26.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:36:49,808::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:36:50,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:50,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:50,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:36:50,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:51,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0426798 s, 24.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:51,278::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:51,278::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:51,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:51,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`8209825e-6fb3-45b3-b01d-47c3c9f2aab7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:51,598::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:36:51,598::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102798', 'lastCheck': '9.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083181', 'lastCheck': '4.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:51,598::task::1191::Storage.TaskManager.Task::(prepare) Task=`8209825e-6fb3-45b3-b01d-47c3c9f2aab7`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102798', 'lastCheck': '9.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00083181', 'lastCheck': '4.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:36:51,598::task::595::Storage.TaskManager.Task::(_updateState) Task=`8209825e-6fb3-45b3-b01d-47c3c9f2aab7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:51,598::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:51,598::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:51,599::task::993::Storage.TaskManager.Task::(_decref) Task=`8209825e-6fb3-45b3-b01d-47c3c9f2aab7`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:36:51,632::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:36:51,632::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:52,186::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:52,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:52,186::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:52,186::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:52,186::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:52,186::__init__::225::IOProcess::(_processLogs) (541633) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:52,187::__init__::225::IOProcess::(_processLogs) (541633) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:52,187::__init__::225::IOProcess::(_processLogs) (541633) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:52,187::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:36:52,188::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:36:52,248::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00071999 s, 508 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:52,248::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:52,248::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:52,248::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:52,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) (541634) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) (541634) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(541634) Building response >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) (541634) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:52,249::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:36:53,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:53,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.050467 s, 20.3 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:36:54,253::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:36:54,752::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:36:54,753::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c93ba7b-8350-4381-9ae8-0d240a80c27d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:36:54,753::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:36:54,786::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:54,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c93ba7b-8350-4381-9ae8-0d240a80c27d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:36:54,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c93ba7b-8350-4381-9ae8-0d240a80c27d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:36:54,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:36:54,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:36:54,786::task::993::Storage.TaskManager.Task::(_decref) Task=`2c93ba7b-8350-4381-9ae8-0d240a80c27d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:36:54,797::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:36:54,798::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e4bcb4f-8b62-4e84-bd0c-0fc6b547fd44`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:36:54,798::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:36:54,798::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`be6e7701-e6d5-459a-9ee0-f8ed7760f9cb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:36:54,798::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:36:54,798::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:36:54,798::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`be6e7701-e6d5-459a-9ee0-f8ed7760f9cb`::Granted request >Thread-10197::DEBUG::2014-08-11 17:36:54,799::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8e4bcb4f-8b62-4e84-bd0c-0fc6b547fd44`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:36:54,799::task::993::Storage.TaskManager.Task::(_decref) Task=`8e4bcb4f-8b62-4e84-bd0c-0fc6b547fd44`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:36:54,819::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:54,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e4bcb4f-8b62-4e84-bd0c-0fc6b547fd44`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:36:54,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e4bcb4f-8b62-4e84-bd0c-0fc6b547fd44`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:36:54,819::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:36:54,819::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:36:54,820::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:36:54,820::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:36:54,820::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:36:54,820::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:36:54,820::task::993::Storage.TaskManager.Task::(_decref) Task=`8e4bcb4f-8b62-4e84-bd0c-0fc6b547fd44`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:36:55,180::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:55,272::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332717 s, 30.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:36:55,624::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:55,624::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:36:55,625::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:56,284::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:56,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:36:56,285::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) (541635) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:56,788::__init__::225::IOProcess::(_processLogs) (541635) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:56,795::__init__::225::IOProcess::(_processLogs) (541635) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:56,795::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:56,795::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:36:56,795::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:36:56,914::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00112095 s, 442 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:36:56,916::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:36:56,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:56,917::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:56,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:56,918::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:56,919::__init__::225::IOProcess::(_processLogs) (541636) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:36:56,920::__init__::225::IOProcess::(_processLogs) (541636) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:36:56,920::__init__::225::IOProcess::(_processLogs) (541636) Building response >Thread-19::DEBUG::2014-08-11 17:36:56,921::__init__::225::IOProcess::(_processLogs) (541636) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:56,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:56,922::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:36:56,923::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:36:56,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:56,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:56,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:56,925::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:56,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:56,926::__init__::225::IOProcess::(_processLogs) (541637) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:56,926::__init__::225::IOProcess::(_processLogs) (541637) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:56,927::__init__::225::IOProcess::(_processLogs) (541637) Building response >Thread-19::DEBUG::2014-08-11 17:36:56,927::__init__::225::IOProcess::(_processLogs) (541637) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:56,928::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:56,929::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:36:56,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:56,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:56,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:56,931::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:56,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:56,932::__init__::225::IOProcess::(_processLogs) (541638) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:56,933::__init__::225::IOProcess::(_processLogs) (541638) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:36:56,934::__init__::225::IOProcess::(_processLogs) (541638) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:56,934::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:56,935::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:36:56,936::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:36:56,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:36:56,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:36:56,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:36:56,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:36:56,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:36:56,939::__init__::225::IOProcess::(_processLogs) (541639) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:36:56,940::__init__::225::IOProcess::(_processLogs) (541639) Building response >Thread-19::DEBUG::2014-08-11 17:36:56,941::__init__::225::IOProcess::(_processLogs) (541639) Queuing response >Thread-19::DEBUG::2014-08-11 17:36:56,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:36:56,942::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:36:57,279::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:57,391::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0522084 s, 19.6 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:36:59,254::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:36:59,400::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:36:59,489::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285625 s, 35.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:37:00,629::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:00,629::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:00,630::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:01,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:01,287::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:01,287::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:01,497::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:01,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0451623 s, 22.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:37:01,915::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:37:02,251::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:02,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:02,253::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:02,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:02,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:02,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:02,257::__init__::225::IOProcess::(_processLogs) (541640) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:02,258::__init__::225::IOProcess::(_processLogs) (541640) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:02,259::__init__::225::IOProcess::(_processLogs) (541640) Queuing response >Thread-27::DEBUG::2014-08-11 17:37:02,260::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:02,261::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:02,320::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:37:02,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000849624 s, 431 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:02,323::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:02,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:02,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:02,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:02,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:02,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:02,325::__init__::225::IOProcess::(_processLogs) (541641) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:02,326::__init__::225::IOProcess::(_processLogs) (541641) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:02,327::__init__::225::IOProcess::(_processLogs) (541641) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:02,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:02,328::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:37:03,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:03,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272659 s, 37.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:37:04,875::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:37:04,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`c38d0ccd-da21-4ffa-874e-fd6f130aa50f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:04,875::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:37:04,927::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:04,927::task::1191::Storage.TaskManager.Task::(prepare) Task=`c38d0ccd-da21-4ffa-874e-fd6f130aa50f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:04,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`c38d0ccd-da21-4ffa-874e-fd6f130aa50f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:04,928::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:04,928::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:04,928::task::993::Storage.TaskManager.Task::(_decref) Task=`c38d0ccd-da21-4ffa-874e-fd6f130aa50f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:37:04,939::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:37:04,939::task::595::Storage.TaskManager.Task::(_updateState) Task=`04afbc0c-43c6-4b99-9c1a-e28d065a0047`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:37:04,939::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:37:04,939::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c92815a-c6b0-448b-b918-edfc84e9edc8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:37:04,939::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:37:04,939::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:37:04,939::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c92815a-c6b0-448b-b918-edfc84e9edc8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:37:04,940::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`04afbc0c-43c6-4b99-9c1a-e28d065a0047`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:37:04,940::task::993::Storage.TaskManager.Task::(_decref) Task=`04afbc0c-43c6-4b99-9c1a-e28d065a0047`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:37:04,956::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:04,956::task::1191::Storage.TaskManager.Task::(prepare) Task=`04afbc0c-43c6-4b99-9c1a-e28d065a0047`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:04,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`04afbc0c-43c6-4b99-9c1a-e28d065a0047`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:37:04,957::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:37:04,957::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:37:04,957::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:37:04,957::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:37:04,957::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:37:04,957::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:37:04,957::task::993::Storage.TaskManager.Task::(_decref) Task=`04afbc0c-43c6-4b99-9c1a-e28d065a0047`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:37:05,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:05,632::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:05,632::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:05,713::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:05,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0470485 s, 21.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:06,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:06,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:06,293::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:37:06,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`95247f8e-27ca-4803-925c-f069a5bde758`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:06,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:37:06,891::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000849624', 'lastCheck': '4.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112095', 'lastCheck': '10.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:06,891::task::1191::Storage.TaskManager.Task::(prepare) Task=`95247f8e-27ca-4803-925c-f069a5bde758`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000849624', 'lastCheck': '4.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00112095', 'lastCheck': '10.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:06,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`95247f8e-27ca-4803-925c-f069a5bde758`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:06,891::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:06,891::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:06,891::task::993::Storage.TaskManager.Task::(_decref) Task=`95247f8e-27ca-4803-925c-f069a5bde758`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:37:06,941::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:06,941::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:06,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:06,941::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:06,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:06,941::__init__::225::IOProcess::(_processLogs) (541642) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:06,942::__init__::225::IOProcess::(_processLogs) (541642) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:06,942::__init__::225::IOProcess::(_processLogs) (541642) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:06,942::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:37:06,942::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:37:07,002::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000897326 s, 552 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:07,004::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:07,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:07,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:07,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:07,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:07,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:07,009::__init__::225::IOProcess::(_processLogs) (541643) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:07,010::__init__::225::IOProcess::(_processLogs) (541643) Building response >Thread-19::DEBUG::2014-08-11 17:37:07,011::__init__::225::IOProcess::(_processLogs) (541643) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:07,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:07,012::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:07,013::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:37:07,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:07,015::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:07,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:07,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:07,017::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:07,018::__init__::225::IOProcess::(_processLogs) (541644) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:07,019::__init__::225::IOProcess::(_processLogs) (541644) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:07,020::__init__::225::IOProcess::(_processLogs) (541644) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:07,021::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:07,022::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:07,023::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:37:07,024::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:07,024::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:07,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:07,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:07,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:07,028::__init__::225::IOProcess::(_processLogs) (541645) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:07,029::__init__::225::IOProcess::(_processLogs) (541645) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:07,030::__init__::225::IOProcess::(_processLogs) (541645) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:07,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:07,032::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:07,033::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:37:07,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:07,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:07,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:07,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:07,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:07,038::__init__::225::IOProcess::(_processLogs) (541646) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:07,039::__init__::225::IOProcess::(_processLogs) (541646) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:07,039::__init__::225::IOProcess::(_processLogs) (541646) Building response >Thread-19::DEBUG::2014-08-11 17:37:07,040::__init__::225::IOProcess::(_processLogs) (541646) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:07,041::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:37:07,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:37:07,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:07,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:07,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03604 s, 28.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:37:09,261::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:37:09,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:10,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153499 s, 66.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:37:10,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:10,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:10,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:11,297::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:11,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:11,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:12,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:12,118::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447762 s, 22.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:12,328::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:12,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:12,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:12,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:12,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:12,329::__init__::225::IOProcess::(_processLogs) (541647) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:12,329::__init__::225::IOProcess::(_processLogs) (541647) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:12,331::__init__::225::IOProcess::(_processLogs) (541647) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:12,331::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:37:12,332::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:37:12,425::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0119052 s, 30.7 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:12,426::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:12,426::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:12,426::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:12,426::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:12,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:12,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:12,427::__init__::225::IOProcess::(_processLogs) (541648) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:12,427::__init__::225::IOProcess::(_processLogs) (541648) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:12,441::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541648) Building response >Thread-19::DEBUG::2014-08-11 17:37:12,441::__init__::225::IOProcess::(_processLogs) (541648) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:12,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:12,441::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:37:14,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:14,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.063799 s, 16.1 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:37:14,262::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:37:14,989::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:37:14,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e1de2cb-3edb-40b7-baad-449c711667df`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:14,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:37:15,014::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:15,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e1de2cb-3edb-40b7-baad-449c711667df`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:15,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e1de2cb-3edb-40b7-baad-449c711667df`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:15,014::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:15,014::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:15,014::task::993::Storage.TaskManager.Task::(_decref) Task=`2e1de2cb-3edb-40b7-baad-449c711667df`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:37:15,026::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:37:15,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`21efd366-bceb-47d6-874a-f12dc213958d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:37:15,026::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:37:15,027::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`571a600c-334c-43b8-acc7-ee3157530430`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:37:15,027::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:37:15,027::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:37:15,027::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`571a600c-334c-43b8-acc7-ee3157530430`::Granted request >Thread-10197::DEBUG::2014-08-11 17:37:15,027::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`21efd366-bceb-47d6-874a-f12dc213958d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:37:15,027::task::993::Storage.TaskManager.Task::(_decref) Task=`21efd366-bceb-47d6-874a-f12dc213958d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:37:15,045::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:15,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`21efd366-bceb-47d6-874a-f12dc213958d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:15,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`21efd366-bceb-47d6-874a-f12dc213958d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:37:15,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:37:15,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:37:15,046::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:37:15,046::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:37:15,046::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:37:15,046::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:37:15,046::task::993::Storage.TaskManager.Task::(_decref) Task=`21efd366-bceb-47d6-874a-f12dc213958d`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:37:15,643::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:15,643::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:15,644::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:16,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:16,316::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:16,317::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:16,317::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:16,333::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0170724 s, 60.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:17,042::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) (541649) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:17,043::__init__::225::IOProcess::(_processLogs) (541649) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:17,046::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541649) Building response >Thread-19::DEBUG::2014-08-11 17:37:17,046::__init__::225::IOProcess::(_processLogs) (541649) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:17,046::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:37:17,047::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:17,047::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:37:17,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000732067 s, 676 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:17,110::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:17,111::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:17,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:17,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:17,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:17,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:17,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:17,115::__init__::225::IOProcess::(_processLogs) (541650) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:17,116::__init__::225::IOProcess::(_processLogs) (541650) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:17,117::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541650) Building response >Thread-19::DEBUG::2014-08-11 17:37:17,119::__init__::225::IOProcess::(_processLogs) (541650) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:17,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:17,120::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:17,122::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:17,123::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:37:17,124::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:17,124::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:17,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:17,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:17,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:17,128::__init__::225::IOProcess::(_processLogs) (541651) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:17,129::__init__::225::IOProcess::(_processLogs) (541651) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:17,129::__init__::225::IOProcess::(_processLogs) (541651) Building response >Thread-19::DEBUG::2014-08-11 17:37:17,130::__init__::225::IOProcess::(_processLogs) (541651) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:17,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:17,132::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:17,133::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:17,134::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:37:17,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:17,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:17,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:17,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:17,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:17,139::__init__::225::IOProcess::(_processLogs) (541652) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:17,139::__init__::225::IOProcess::(_processLogs) (541652) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:17,140::__init__::225::IOProcess::(_processLogs) (541652) Building response >Thread-19::DEBUG::2014-08-11 17:37:17,141::__init__::225::IOProcess::(_processLogs) (541652) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:17,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:17,143::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:17,144::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:17,145::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:37:17,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:17,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:17,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:17,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:17,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:17,149::__init__::225::IOProcess::(_processLogs) (541653) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:17,149::__init__::225::IOProcess::(_processLogs) (541653) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:17,150::__init__::225::IOProcess::(_processLogs) (541653) Building response >Thread-19::DEBUG::2014-08-11 17:37:17,150::__init__::225::IOProcess::(_processLogs) (541653) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:17,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:17,151::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:37:18,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:18,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124521 s, 82.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:37:19,935::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:37:20,421::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:20,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180074 s, 56.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:37:20,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:20,649::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:20,649::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:21,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:21,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:21,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:37:22,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`81b1f102-1985-479b-9643-b7f9f9f100ad`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:22,345::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:37:22,345::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119052', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732067', 'lastCheck': '5.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:22,345::task::1191::Storage.TaskManager.Task::(prepare) Task=`81b1f102-1985-479b-9643-b7f9f9f100ad`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0119052', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000732067', 'lastCheck': '5.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:22,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`81b1f102-1985-479b-9643-b7f9f9f100ad`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:22,345::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:22,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:22,346::task::993::Storage.TaskManager.Task::(_decref) Task=`81b1f102-1985-479b-9643-b7f9f9f100ad`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:37:22,359::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:37:22,359::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:37:22,442::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:22,442::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:22,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:22,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:22,443::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-27::DEBUG::2014-08-11 17:37:22,444::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:22,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:22,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:22,504::__init__::225::IOProcess::(_processLogs) (541654) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:22,590::__init__::225::IOProcess::(_processLogs) (541654) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:37:22,590::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-27::DEBUG::2014-08-11 17:37:22,592::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000393916 s, 929 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:22,592::__init__::225::IOProcess::(_processLogs) (541654) Building response >Thread-19::DEBUG::2014-08-11 17:37:22,681::__init__::225::IOProcess::(_processLogs) (541654) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:22,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:22,683::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:22,684::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:22,685::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:22,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:22,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:22,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:22,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:22,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:22,687::__init__::225::IOProcess::(_processLogs) (541655) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:22,688::__init__::225::IOProcess::(_processLogs) (541655) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:22,699::__init__::225::IOProcess::(_processLogs) DEBUG|(541655) Building response >Thread-19::DEBUG::2014-08-11 17:37:22,700::__init__::225::IOProcess::(_processLogs) (541655) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:22,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:22,703::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:37:22,705::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0538052 s, 19.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:37:24,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e166bc6-4e69-4a35-aacc-c4d7f5b8a30e`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:37:24,318::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:37:24,318::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) (541656) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:37:24,319::__init__::225::IOProcess::(_processLogs) (541656) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:37:24,322::__init__::225::IOProcess::(_processLogs) (541656) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:24,322::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:37:24,322::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:37:24,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:24,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:24,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:24,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:24,323::__init__::225::IOProcess::(_processLogs) (541657) Finding callback 'stat'... >Thread-10017::INFO::2014-08-11 17:37:24,323::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:37:24,323::__init__::225::IOProcess::(_processLogs) (541657) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:37:24,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e166bc6-4e69-4a35-aacc-c4d7f5b8a30e`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:37:24,324::__init__::225::IOProcess::(_processLogs) (541657) Building response >Thread-10017::DEBUG::2014-08-11 17:37:24,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e166bc6-4e69-4a35-aacc-c4d7f5b8a30e`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:37:24,325::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:37:24,325::__init__::225::IOProcess::(_processLogs) (541657) Queuing response >Thread-10017::DEBUG::2014-08-11 17:37:24,325::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:37:24,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:37:24,326::task::993::Storage.TaskManager.Task::(_decref) Task=`8e166bc6-4e69-4a35-aacc-c4d7f5b8a30e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:37:24,326::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:37:24,347::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:37:24,716::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:24,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0157997 s, 64.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:37:25,102::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:37:25,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`19901ae3-f525-405a-8dce-faab2d4db242`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:25,103::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:37:25,155::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:25,155::task::1191::Storage.TaskManager.Task::(prepare) Task=`19901ae3-f525-405a-8dce-faab2d4db242`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:25,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`19901ae3-f525-405a-8dce-faab2d4db242`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:25,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:25,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:25,156::task::993::Storage.TaskManager.Task::(_decref) Task=`19901ae3-f525-405a-8dce-faab2d4db242`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:37:25,167::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:37:25,167::task::595::Storage.TaskManager.Task::(_updateState) Task=`7389815d-db99-474f-85df-5396d7e6ce6e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:37:25,167::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:37:25,167::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dec209bd-afed-45d9-9d62-e9cce98b5680`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:37:25,168::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:37:25,168::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:37:25,169::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dec209bd-afed-45d9-9d62-e9cce98b5680`::Granted request >Thread-10197::DEBUG::2014-08-11 17:37:25,169::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7389815d-db99-474f-85df-5396d7e6ce6e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:37:25,169::task::993::Storage.TaskManager.Task::(_decref) Task=`7389815d-db99-474f-85df-5396d7e6ce6e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:37:25,220::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:25,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`7389815d-db99-474f-85df-5396d7e6ce6e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:25,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`7389815d-db99-474f-85df-5396d7e6ce6e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:37:25,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:37:25,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:37:25,221::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:37:25,221::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:37:25,221::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:37:25,221::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:37:25,221::task::993::Storage.TaskManager.Task::(_decref) Task=`7389815d-db99-474f-85df-5396d7e6ce6e`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:37:25,654::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:25,654::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:25,654::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:26,329::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:26,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:26,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:26,798::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:26,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0330083 s, 31.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:27,149::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:27,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:27,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:27,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:27,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:27,150::__init__::225::IOProcess::(_processLogs) (541658) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:27,150::__init__::225::IOProcess::(_processLogs) (541658) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:27,150::__init__::225::IOProcess::(_processLogs) (541658) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:27,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:37:27,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:37:27,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00359727 s, 138 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:27,214::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:27,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:27,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:27,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:27,216::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:27,217::__init__::225::IOProcess::(_processLogs) (541659) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:27,218::__init__::225::IOProcess::(_processLogs) (541659) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:27,219::__init__::225::IOProcess::(_processLogs) (541659) Building response >Thread-19::DEBUG::2014-08-11 17:37:27,219::__init__::225::IOProcess::(_processLogs) (541659) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:27,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:27,221::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:27,221::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:37:27,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:27,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:27,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:27,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:27,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:27,225::__init__::225::IOProcess::(_processLogs) (541660) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:27,225::__init__::225::IOProcess::(_processLogs) (541660) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:27,226::__init__::225::IOProcess::(_processLogs) (541660) Building response >Thread-19::DEBUG::2014-08-11 17:37:27,226::__init__::225::IOProcess::(_processLogs) (541660) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:27,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:27,228::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:27,229::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:27,229::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:37:27,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:27,230::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:27,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:27,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:27,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:27,233::__init__::225::IOProcess::(_processLogs) (541661) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:27,233::__init__::225::IOProcess::(_processLogs) (541661) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:27,234::__init__::225::IOProcess::(_processLogs) (541661) Building response >Thread-19::DEBUG::2014-08-11 17:37:27,234::__init__::225::IOProcess::(_processLogs) (541661) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:27,235::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:37:27,236::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:27,237::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:27,237::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:37:27,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:27,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:27,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:27,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:27,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:27,240::__init__::225::IOProcess::(_processLogs) (541662) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:27,241::__init__::225::IOProcess::(_processLogs) (541662) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:27,241::__init__::225::IOProcess::(_processLogs) (541662) Building response >Thread-19::DEBUG::2014-08-11 17:37:27,242::__init__::225::IOProcess::(_processLogs) (541662) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:27,243::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:37:27,244::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:37:28,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:28,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211693 s, 48.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:37:29,324::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:37:30,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:30,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:30,657::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:30,986::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:31,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0228533 s, 44.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:31,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:31,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:31,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:37:31,959::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:37:32,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:32,703::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:32,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:32,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:32,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:32,703::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:32,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:32,704::__init__::225::IOProcess::(_processLogs) (541663) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:32,704::__init__::225::IOProcess::(_processLogs) (541663) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:32,704::__init__::225::IOProcess::(_processLogs) DEBUG|(541663) Building response >Thread-19::DEBUG::2014-08-11 17:37:32,704::__init__::225::IOProcess::(_processLogs) (541663) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:32,705::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:37:32,706::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:32,706::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:37:32,770::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00233726 s, 157 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:32,770::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:32,770::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:32,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:32,770::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:32,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:32,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:32,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:32,771::__init__::225::IOProcess::(_processLogs) (541664) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:32,771::__init__::225::IOProcess::(_processLogs) (541664) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:32,771::__init__::225::IOProcess::(_processLogs) DEBUG|(541664) Building response >Thread-19::DEBUG::2014-08-11 17:37:32,772::__init__::225::IOProcess::(_processLogs) (541664) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:32,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:32,772::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:37:33,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:33,193::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0544252 s, 18.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:37:35,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:37:35,282::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:37:35,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e339ae3-cb95-4c91-830d-5c0562d27e95`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:35,282::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:37:35,322::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0610859 s, 16.8 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:37:35,338::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:35,338::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e339ae3-cb95-4c91-830d-5c0562d27e95`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:35,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e339ae3-cb95-4c91-830d-5c0562d27e95`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:35,338::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:35,338::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:35,338::task::993::Storage.TaskManager.Task::(_decref) Task=`8e339ae3-cb95-4c91-830d-5c0562d27e95`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:37:35,345::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:37:35,345::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5e317ea-0f09-40f4-87a4-d4f8cd499971`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:37:35,345::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:37:35,346::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`31721b72-a9c5-4e08-856e-1617d2ceb63e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:37:35,346::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:37:35,346::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:37:35,346::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`31721b72-a9c5-4e08-856e-1617d2ceb63e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:37:35,346::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b5e317ea-0f09-40f4-87a4-d4f8cd499971`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:37:35,346::task::993::Storage.TaskManager.Task::(_decref) Task=`b5e317ea-0f09-40f4-87a4-d4f8cd499971`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:37:35,363::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:35,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`b5e317ea-0f09-40f4-87a4-d4f8cd499971`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:35,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`b5e317ea-0f09-40f4-87a4-d4f8cd499971`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:37:35,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:37:35,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:37:35,363::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:37:35,364::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:37:35,364::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:37:35,364::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:37:35,364::task::993::Storage.TaskManager.Task::(_decref) Task=`b5e317ea-0f09-40f4-87a4-d4f8cd499971`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:37:35,663::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:35,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:35,664::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:36,342::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:36,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:36,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:37,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:37,245::__init__::225::IOProcess::(_processLogs) (541665) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:37,245::__init__::225::IOProcess::(_processLogs) (541665) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:37,245::__init__::225::IOProcess::(_processLogs) DEBUG|(541665) Building response >Thread-19::DEBUG::2014-08-11 17:37:37,245::__init__::225::IOProcess::(_processLogs) (541665) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:37,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:37,245::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:37:37,246::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:37:37,307::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00130374 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:37,309::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:37,310::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:37,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:37,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:37,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:37,312::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:37,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:37,314::__init__::225::IOProcess::(_processLogs) DEBUG|(541666) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:37,314::__init__::225::IOProcess::(_processLogs) (541666) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:37,315::__init__::225::IOProcess::(_processLogs) (541666) Building response >Thread-19::DEBUG::2014-08-11 17:37:37,316::__init__::225::IOProcess::(_processLogs) (541666) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:37,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:37,317::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:37,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:37,318::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:37:37,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:37,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:37,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:37,320::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:37,320::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:37,321::__init__::225::IOProcess::(_processLogs) (541667) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:37,322::__init__::225::IOProcess::(_processLogs) (541667) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:37,322::__init__::225::IOProcess::(_processLogs) DEBUG|(541667) Building response >Thread-19::DEBUG::2014-08-11 17:37:37,323::__init__::225::IOProcess::(_processLogs) (541667) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:37,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:37,324::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:37,325::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:37,325::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:37:37,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:37,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:37,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:37,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:37,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:37,328::__init__::225::IOProcess::(_processLogs) (541668) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:37,329::__init__::225::IOProcess::(_processLogs) (541668) Got request for method 'access' >Dummy-51::DEBUG::2014-08-11 17:37:37,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:37,330::__init__::225::IOProcess::(_processLogs) (541668) Building response >Thread-19::DEBUG::2014-08-11 17:37:37,390::__init__::225::IOProcess::(_processLogs) DEBUG|(541668) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:37,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:37,391::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:37,392::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:37,393::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:37:37,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:37,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:37,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:37,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:37,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:37,396::__init__::225::IOProcess::(_processLogs) (541669) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:37,397::__init__::225::IOProcess::(_processLogs) (541669) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:37,397::__init__::225::IOProcess::(_processLogs) (541669) Building response >Thread-19::DEBUG::2014-08-11 17:37:37,398::__init__::225::IOProcess::(_processLogs) (541669) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:37,399::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:37:37,399::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:37:37,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0865399 s, 11.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:37:37,561::task::595::Storage.TaskManager.Task::(_updateState) Task=`b18e881a-d816-4cbd-a924-c109b00571a8`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:37,561::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:37:37,561::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233726', 'lastCheck': '4.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00130374', 'lastCheck': '0.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:37,561::task::1191::Storage.TaskManager.Task::(prepare) Task=`b18e881a-d816-4cbd-a924-c109b00571a8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00233726', 'lastCheck': '4.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00130374', 'lastCheck': '0.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:37,562::task::595::Storage.TaskManager.Task::(_updateState) Task=`b18e881a-d816-4cbd-a924-c109b00571a8`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:37,562::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:37,562::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:37,562::task::993::Storage.TaskManager.Task::(_decref) Task=`b18e881a-d816-4cbd-a924-c109b00571a8`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:37:37,580::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:37:37,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:37:39,355::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:37:39,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:39,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131238 s, 78.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:37:40,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:40,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:40,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:41,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:41,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:41,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:41,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:41,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122071 s, 83.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) (541670) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:42,773::__init__::225::IOProcess::(_processLogs) (541670) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:42,774::__init__::225::IOProcess::(_processLogs) DEBUG|(541670) Building response >Thread-19::DEBUG::2014-08-11 17:37:42,774::__init__::225::IOProcess::(_processLogs) (541670) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:42,774::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:37:42,774::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:37:42,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:37:42,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00341377 s, 107 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:42,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:42,839::__init__::225::IOProcess::(_processLogs) (541671) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:42,839::__init__::225::IOProcess::(_processLogs) (541671) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:42,839::__init__::225::IOProcess::(_processLogs) DEBUG|(541671) Building response >Thread-19::DEBUG::2014-08-11 17:37:42,839::__init__::225::IOProcess::(_processLogs) (541671) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:42,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:42,840::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:37:43,646::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:43,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365462 s, 28.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:37:44,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f38987b-e332-4a4b-8a5f-05009301e758`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:37:44,326::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:37:44,326::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) (541672) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:37:44,327::__init__::225::IOProcess::(_processLogs) (541672) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:37:44,328::__init__::225::IOProcess::(_processLogs) DEBUG|(541672) Building response >Thread-19::DEBUG::2014-08-11 17:37:44,328::__init__::225::IOProcess::(_processLogs) (541672) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:44,329::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-10102::INFO::2014-08-11 17:37:44,330::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:37:44,330::__init__::225::IOProcess::(_processLogs) (541673) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:37:44,330::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f38987b-e332-4a4b-8a5f-05009301e758`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:37:44,331::__init__::225::IOProcess::(_processLogs) (541673) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:37:44,331::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f38987b-e332-4a4b-8a5f-05009301e758`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:37:44,331::__init__::225::IOProcess::(_processLogs) (541673) Building response >Thread-10102::DEBUG::2014-08-11 17:37:44,331::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:37:44,332::__init__::225::IOProcess::(_processLogs) (541673) Queuing response >Thread-10102::DEBUG::2014-08-11 17:37:44,332::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:37:44,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10102::DEBUG::2014-08-11 17:37:44,332::task::993::Storage.TaskManager.Task::(_decref) Task=`8f38987b-e332-4a4b-8a5f-05009301e758`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:37:44,333::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:37:44,354::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:37:45,394::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:37:45,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`e918ef42-1df1-4f58-8f8a-41994319750c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:45,394::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:37:45,442::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:45,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`e918ef42-1df1-4f58-8f8a-41994319750c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:45,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`e918ef42-1df1-4f58-8f8a-41994319750c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:45,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:45,442::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:45,443::task::993::Storage.TaskManager.Task::(_decref) Task=`e918ef42-1df1-4f58-8f8a-41994319750c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:37:45,454::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:37:45,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e4d0c9a-fb63-457f-a359-4c9136f3313a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:37:45,454::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:37:45,454::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`072550ca-19e5-4b03-83a1-1ce127c43308`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:37:45,454::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:37:45,455::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:37:45,455::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`072550ca-19e5-4b03-83a1-1ce127c43308`::Granted request >Thread-10197::DEBUG::2014-08-11 17:37:45,455::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1e4d0c9a-fb63-457f-a359-4c9136f3313a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:37:45,455::task::993::Storage.TaskManager.Task::(_decref) Task=`1e4d0c9a-fb63-457f-a359-4c9136f3313a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:37:45,508::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:45,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`1e4d0c9a-fb63-457f-a359-4c9136f3313a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:45,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`1e4d0c9a-fb63-457f-a359-4c9136f3313a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:37:45,508::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:37:45,508::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:37:45,509::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:37:45,509::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:37:45,509::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:37:45,509::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:37:45,509::task::993::Storage.TaskManager.Task::(_decref) Task=`1e4d0c9a-fb63-457f-a359-4c9136f3313a`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:37:45,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:45,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:45,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:45,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:45,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0900447 s, 11.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:46,355::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:46,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:46,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) (541674) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:47,400::__init__::225::IOProcess::(_processLogs) (541674) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:47,401::__init__::225::IOProcess::(_processLogs) DEBUG|(541674) Building response >Thread-19::DEBUG::2014-08-11 17:37:47,401::__init__::225::IOProcess::(_processLogs) (541674) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:47,401::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:37:47,401::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:47,401::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:37:47,462::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000446369 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:47,464::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:47,465::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:47,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:47,466::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:47,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:47,467::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:47,468::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:47,469::__init__::225::IOProcess::(_processLogs) (541675) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:47,470::__init__::225::IOProcess::(_processLogs) (541675) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:47,470::__init__::225::IOProcess::(_processLogs) (541675) Building response >Thread-19::DEBUG::2014-08-11 17:37:47,471::__init__::225::IOProcess::(_processLogs) (541675) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:47,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:47,472::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:47,473::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:47,473::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:37:47,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:47,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:47,475::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:47,475::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:47,476::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:47,476::__init__::225::IOProcess::(_processLogs) (541676) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:47,477::__init__::225::IOProcess::(_processLogs) (541676) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:47,477::__init__::225::IOProcess::(_processLogs) (541676) Building response >Thread-19::DEBUG::2014-08-11 17:37:47,478::__init__::225::IOProcess::(_processLogs) (541676) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:47,478::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:47,479::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:47,480::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:47,481::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:37:47,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:47,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:47,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:47,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:47,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:47,484::__init__::225::IOProcess::(_processLogs) (541677) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:47,485::__init__::225::IOProcess::(_processLogs) (541677) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:47,485::__init__::225::IOProcess::(_processLogs) (541677) Building response >Thread-19::DEBUG::2014-08-11 17:37:47,486::__init__::225::IOProcess::(_processLogs) (541677) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:47,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:47,488::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:47,489::__init__::225::IOProcess::(_processLogs) (541677) Finding callback 'access'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:47,489::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:37:47,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:47,490::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:47,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:47,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:47,492::__init__::225::IOProcess::(_processLogs) (541677) Finding callback 'access'...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:47,493::__init__::225::IOProcess::(_processLogs) (541678) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:47,494::__init__::225::IOProcess::(_processLogs) (541678) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:47,494::__init__::225::IOProcess::(_processLogs) (541678) Building response >Thread-19::DEBUG::2014-08-11 17:37:47,495::__init__::225::IOProcess::(_processLogs) (541678) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:47,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:47,496::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:37:47,910::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:47,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125698 s, 81.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:37:49,978::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:37:49,989::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:50,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055977 s, 18.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:37:50,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:50,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:50,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:51,362::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:51,362::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:51,363::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:52,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:52,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128863 s, 79.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:52,840::__init__::225::IOProcess::(_processLogs) (541677) Finding callback 'access'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:52,840::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:52,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:52,840::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) (541679) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) (541679) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541679) Building response >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) (541679) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:52,841::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:37:52,842::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:37:52,842::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:37:52,903::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000552669 s, 662 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:52,904::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:52,905::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:52,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:52,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:52,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:52,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:52,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:52,910::__init__::225::IOProcess::(_processLogs) (541680) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:52,911::__init__::225::IOProcess::(_processLogs) (541680) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:52,912::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541680) Building response >Thread-19::DEBUG::2014-08-11 17:37:52,913::__init__::225::IOProcess::(_processLogs) (541680) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:52,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:52,913::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:37:52,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe8a1335-da9d-4a94-8c71-6c3987eab68b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:52,976::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:37:52,976::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552669', 'lastCheck': '0.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446369', 'lastCheck': '5.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:52,976::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe8a1335-da9d-4a94-8c71-6c3987eab68b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000552669', 'lastCheck': '0.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000446369', 'lastCheck': '5.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:37:52,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe8a1335-da9d-4a94-8c71-6c3987eab68b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:52,976::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:52,976::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:52,976::task::993::Storage.TaskManager.Task::(_decref) Task=`fe8a1335-da9d-4a94-8c71-6c3987eab68b`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:37:52,996::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:37:52,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:54,192::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:54,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.035915 s, 28.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:37:54,375::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:37:55,575::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:37:55,575::task::595::Storage.TaskManager.Task::(_updateState) Task=`9553a5d5-3ed2-46ff-a6a5-5c0ffa3a43a4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:37:55,575::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:37:55,589::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:55,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`9553a5d5-3ed2-46ff-a6a5-5c0ffa3a43a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:37:55,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`9553a5d5-3ed2-46ff-a6a5-5c0ffa3a43a4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:37:55,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:37:55,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:37:55,589::task::993::Storage.TaskManager.Task::(_decref) Task=`9553a5d5-3ed2-46ff-a6a5-5c0ffa3a43a4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:37:55,600::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:37:55,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`eecd601e-6074-4290-a883-5c3c40698d7d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:37:55,601::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:37:55,601::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c05e400-9c2a-44e5-93d3-2e4e1b04ebd1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:37:55,601::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:37:55,601::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:37:55,601::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c05e400-9c2a-44e5-93d3-2e4e1b04ebd1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:37:55,602::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`eecd601e-6074-4290-a883-5c3c40698d7d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:37:55,602::task::993::Storage.TaskManager.Task::(_decref) Task=`eecd601e-6074-4290-a883-5c3c40698d7d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:37:55,619::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:55,620::task::1191::Storage.TaskManager.Task::(prepare) Task=`eecd601e-6074-4290-a883-5c3c40698d7d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:37:55,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`eecd601e-6074-4290-a883-5c3c40698d7d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:37:55,620::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:37:55,620::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:37:55,620::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:37:55,620::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:37:55,620::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:37:55,620::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:37:55,620::task::993::Storage.TaskManager.Task::(_decref) Task=`eecd601e-6074-4290-a883-5c3c40698d7d`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:37:55,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:55,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:37:55,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:56,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:56,369::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:56,369::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:37:56,370::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:37:56,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256725 s, 39.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) (541681) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:57,494::__init__::225::IOProcess::(_processLogs) (541681) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:57,495::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541681) Building response >Thread-19::DEBUG::2014-08-11 17:37:57,495::__init__::225::IOProcess::(_processLogs) (541681) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:57,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:57,495::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:37:57,496::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:37:57,557::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000804857 s, 615 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:37:57,558::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:57,559::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:37:57,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:57,560::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:57,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:57,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:57,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:57,562::__init__::225::IOProcess::(_processLogs) (541682) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:37:57,563::__init__::225::IOProcess::(_processLogs) (541682) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:37:57,563::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541682) Building response >Thread-19::DEBUG::2014-08-11 17:37:57,564::__init__::225::IOProcess::(_processLogs) (541682) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:57,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:57,566::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:37:57,566::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:57,567::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:37:57,567::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:57,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:57,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:57,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:57,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:57,570::__init__::225::IOProcess::(_processLogs) (541683) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:57,571::__init__::225::IOProcess::(_processLogs) (541683) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:57,571::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541683) Building response >Thread-19::DEBUG::2014-08-11 17:37:57,572::__init__::225::IOProcess::(_processLogs) (541683) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:57,573::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:57,573::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:57,574::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:57,575::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:37:57,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:57,576::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:57,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:57,577::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:57,577::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:57,578::__init__::225::IOProcess::(_processLogs) (541684) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:57,578::__init__::225::IOProcess::(_processLogs) (541684) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:57,579::__init__::225::IOProcess::(_processLogs) (541684) Building response >Thread-19::DEBUG::2014-08-11 17:37:57,580::__init__::225::IOProcess::(_processLogs) (541684) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:57,580::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:37:57,581::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:37:57,582::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:37:57,583::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:37:57,583::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:37:57,583::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:37:57,584::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:37:57,585::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:37:57,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:37:57,587::__init__::225::IOProcess::(_processLogs) (541685) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:37:57,588::__init__::225::IOProcess::(_processLogs) (541685) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:37:57,588::__init__::225::IOProcess::(_processLogs) (541685) Building response >Thread-19::DEBUG::2014-08-11 17:37:57,589::__init__::225::IOProcess::(_processLogs) (541685) Queuing response >Thread-19::DEBUG::2014-08-11 17:37:57,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:37:57,590::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:37:58,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:37:58,466::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0211603 s, 48.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:37:59,376::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:38:00,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:00,546::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013391 s, 76.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:38:00,691::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:00,691::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:00,692::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:01,376::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:01,376::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:01,377::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:38:01,990::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:38:02,554::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:02,656::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415217 s, 24.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:02,913::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) (541686) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) (541686) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541686) Building response >Thread-19::DEBUG::2014-08-11 17:38:02,914::__init__::225::IOProcess::(_processLogs) (541686) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:02,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:38:02,915::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:38:02,915::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:38:02,976::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000700514 s, 522 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:02,978::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:02,979::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:02,979::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:02,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:02,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:02,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:02,981::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:02,983::__init__::225::IOProcess::(_processLogs) (541687) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:02,983::__init__::225::IOProcess::(_processLogs) (541687) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:02,984::__init__::225::IOProcess::(_processLogs) (541687) Building response >Thread-19::DEBUG::2014-08-11 17:38:02,984::__init__::225::IOProcess::(_processLogs) (541687) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:02,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:02,985::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:38:04,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:04,791::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0489185 s, 20.9 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:38:05,681::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:38:05,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`cadae2a9-76b7-4d0b-8900-16fedbd27b91`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:05,681::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >GuestMonitor-vm::DEBUG::2014-08-11 17:38:05,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:05,697::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:05,697::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::INFO::2014-08-11 17:38:05,717::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:05,717::task::1191::Storage.TaskManager.Task::(prepare) Task=`cadae2a9-76b7-4d0b-8900-16fedbd27b91`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:05,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`cadae2a9-76b7-4d0b-8900-16fedbd27b91`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:05,717::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:05,717::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:05,717::task::993::Storage.TaskManager.Task::(_decref) Task=`cadae2a9-76b7-4d0b-8900-16fedbd27b91`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:38:05,728::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:38:05,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b474405-5e47-42a8-9542-44008edc0630`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:38:05,729::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:38:05,729::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1bcd9125-ab61-4101-9239-e09dceba0817`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:38:05,729::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:38:05,729::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:38:05,729::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1bcd9125-ab61-4101-9239-e09dceba0817`::Granted request >Thread-10197::DEBUG::2014-08-11 17:38:05,730::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8b474405-5e47-42a8-9542-44008edc0630`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:38:05,730::task::993::Storage.TaskManager.Task::(_decref) Task=`8b474405-5e47-42a8-9542-44008edc0630`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:38:05,746::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:05,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b474405-5e47-42a8-9542-44008edc0630`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:05,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b474405-5e47-42a8-9542-44008edc0630`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:38:05,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:38:05,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:38:05,747::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:38:05,747::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:38:05,747::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:38:05,747::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:38:05,747::task::993::Storage.TaskManager.Task::(_decref) Task=`8b474405-5e47-42a8-9542-44008edc0630`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:06,380::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:06,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:06,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:06,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:06,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537571 s, 19.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:38:07,587::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:38:07,588::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,588::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:38:07,588::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) (541688) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) (541688) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,590::__init__::225::IOProcess::(_processLogs) (541689) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:38:07,590::__init__::225::IOProcess::(_processLogs) (541689) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:38:07,599::__init__::225::IOProcess::(_processLogs) DEBUG|(541688) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,599::__init__::225::IOProcess::(_processLogs) (541688) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,599::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,600::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:38:07,602::__init__::225::IOProcess::(_processLogs) DEBUG|(541689) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,603::__init__::225::IOProcess::(_processLogs) (541689) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,606::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:38:07,609::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:38:07,609::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) (541690) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:38:07,610::__init__::225::IOProcess::(_processLogs) (541690) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:38:07,614::__init__::225::IOProcess::(_processLogs) DEBUG|(541690) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,615::__init__::225::IOProcess::(_processLogs) (541690) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,616::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-28::DEBUG::2014-08-11 17:38:07,617::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:38:07,618::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,619::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:38:07,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,622::__init__::225::IOProcess::(_processLogs) (541691) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:38:07,623::__init__::225::IOProcess::(_processLogs) (541691) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:38:07,624::__init__::225::IOProcess::(_processLogs) DEBUG|(541691) Building response >Thread-28::DEBUG::2014-08-11 17:38:07,624::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:38:07,625::__init__::225::IOProcess::(_processLogs) (541691) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,627::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,627::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:38:07,628::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,629::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:38:07,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,632::__init__::225::IOProcess::(_processLogs) (541692) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:07,633::__init__::225::IOProcess::(_processLogs) (541692) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:07,633::__init__::225::IOProcess::(_processLogs) (541692) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,634::__init__::225::IOProcess::(_processLogs) (541692) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,635::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,636::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:07,637::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,637::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:38:07,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,638::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,640::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,641::__init__::225::IOProcess::(_processLogs) (541693) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:38:07,641::__init__::225::IOProcess::(_processLogs) (541693) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:38:07,642::__init__::225::IOProcess::(_processLogs) DEBUG|(541693) Building response >Thread-28::DEBUG::2014-08-11 17:38:07,642::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:38:07,643::__init__::225::IOProcess::(_processLogs) (541693) Queuing response >Thread-28::INFO::2014-08-11 17:38:07,643::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:38:07,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::INFO::2014-08-11 17:38:07,644::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:38:07,645::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:38:07,646::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,647::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:07,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,648::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,648::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,650::__init__::225::IOProcess::(_processLogs) (541694) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:07,651::__init__::225::IOProcess::(_processLogs) (541694) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:07,652::__init__::225::IOProcess::(_processLogs) DEBUG|(541694) Building response >Thread-28::DEBUG::2014-08-11 17:38:07,653::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:38:07,653::__init__::225::IOProcess::(_processLogs) (541694) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,715::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:38:07,739::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0253451 s, 19.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:07,739::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,739::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:07,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,740::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,740::__init__::225::IOProcess::(_processLogs) (541695) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:07,740::__init__::225::IOProcess::(_processLogs) (541695) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:07,745::__init__::225::IOProcess::(_processLogs) DEBUG|(541695) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,745::__init__::225::IOProcess::(_processLogs) (541695) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,746::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) (541696) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:07,747::__init__::225::IOProcess::(_processLogs) (541696) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:07,757::__init__::225::IOProcess::(_processLogs) DEBUG|(541696) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,757::__init__::225::IOProcess::(_processLogs) (541696) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,757::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,758::__init__::225::IOProcess::(_processLogs) (541697) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:07,759::__init__::225::IOProcess::(_processLogs) (541697) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:07,770::__init__::225::IOProcess::(_processLogs) DEBUG|(541697) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,770::__init__::225::IOProcess::(_processLogs) (541697) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,770::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,770::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:07,770::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:07,771::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:38:07,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:07,771::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) (541698) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) (541698) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) (541698) Building response >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) (541698) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:07,772::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:38:08,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`aadc577b-32a8-4eb5-b5c9-280ea343fbba`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:08,189::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:38:08,189::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700514', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0253451', 'lastCheck': '0.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:08,189::task::1191::Storage.TaskManager.Task::(prepare) Task=`aadc577b-32a8-4eb5-b5c9-280ea343fbba`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000700514', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0253451', 'lastCheck': '0.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:08,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`aadc577b-32a8-4eb5-b5c9-280ea343fbba`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:08,189::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:08,189::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:08,189::task::993::Storage.TaskManager.Task::(_decref) Task=`aadc577b-32a8-4eb5-b5c9-280ea343fbba`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:38:08,201::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:08,202::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:08,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:09,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0335784 s, 30.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:38:09,383::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:38:10,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:10,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:10,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:11,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:11,169::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026037 s, 39.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:11,387::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:11,387::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:11,388::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:38:12,983::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:12,983::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:12,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:12,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:12,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:12,984::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:38:12,985::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:38:12,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:13,043::__init__::225::IOProcess::(_processLogs) (541699) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:13,044::__init__::225::IOProcess::(_processLogs) (541699) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:13,044::__init__::225::IOProcess::(_processLogs) (541699) Building response >Thread-19::DEBUG::2014-08-11 17:38:13,044::__init__::225::IOProcess::(_processLogs) (541699) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:13,044::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:13,044::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:38:13,045::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000777226 s, 471 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:13,047::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:13,048::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:13,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:13,049::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:13,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:13,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:13,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:13,050::__init__::225::IOProcess::(_processLogs) (541700) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:13,051::__init__::225::IOProcess::(_processLogs) (541700) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:13,052::__init__::225::IOProcess::(_processLogs) DEBUG|(541700) Building response >Thread-19::DEBUG::2014-08-11 17:38:13,053::__init__::225::IOProcess::(_processLogs) (541700) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:13,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:13,054::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:38:13,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:13,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.042028 s, 24.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:38:14,383::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:38:15,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:15,370::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0261371 s, 39.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:38:15,706::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:15,706::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:15,706::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:15,803::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:38:15,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cdefb2a-6c2b-49dd-9a06-aa0b8101b585`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:15,803::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:38:15,854::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:15,854::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cdefb2a-6c2b-49dd-9a06-aa0b8101b585`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:15,854::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cdefb2a-6c2b-49dd-9a06-aa0b8101b585`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:15,854::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:15,854::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:15,854::task::993::Storage.TaskManager.Task::(_decref) Task=`4cdefb2a-6c2b-49dd-9a06-aa0b8101b585`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:38:15,865::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:38:15,865::task::595::Storage.TaskManager.Task::(_updateState) Task=`63983288-ec90-4e19-9002-5909e500cb62`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:38:15,865::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:38:15,866::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3867969f-c727-4bf2-bd72-0fa4fd49ae8e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:38:15,866::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:38:15,866::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:38:15,866::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3867969f-c727-4bf2-bd72-0fa4fd49ae8e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:38:15,866::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`63983288-ec90-4e19-9002-5909e500cb62`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:38:15,866::task::993::Storage.TaskManager.Task::(_decref) Task=`63983288-ec90-4e19-9002-5909e500cb62`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:38:15,890::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:15,890::task::1191::Storage.TaskManager.Task::(prepare) Task=`63983288-ec90-4e19-9002-5909e500cb62`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:15,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`63983288-ec90-4e19-9002-5909e500cb62`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:38:15,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:38:15,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:38:15,890::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:38:15,890::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:38:15,891::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:38:15,891::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:38:15,891::task::993::Storage.TaskManager.Task::(_decref) Task=`63983288-ec90-4e19-9002-5909e500cb62`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:16,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:16,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:16,391::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:17,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:17,513::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0765208 s, 13.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:17,772::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:17,772::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:17,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:17,772::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:17,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:17,773::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:17,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:17,773::__init__::225::IOProcess::(_processLogs) (541701) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:17,773::__init__::225::IOProcess::(_processLogs) (541701) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:17,773::__init__::225::IOProcess::(_processLogs) DEBUG|(541701) Building response >Thread-19::DEBUG::2014-08-11 17:38:17,774::__init__::225::IOProcess::(_processLogs) (541701) Queuing response >Thread-28::DEBUG::2014-08-11 17:38:17,774::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:38:17,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:17,832::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:38:17,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000371515 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:17,833::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) (541702) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:17,834::__init__::225::IOProcess::(_processLogs) (541702) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:17,835::__init__::225::IOProcess::(_processLogs) DEBUG|(541702) Building response >Thread-19::DEBUG::2014-08-11 17:38:17,835::__init__::225::IOProcess::(_processLogs) (541702) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:17,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:17,835::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:38:17,835::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:17,835::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) (541703) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) (541703) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) (541703) Building response >Thread-19::DEBUG::2014-08-11 17:38:17,836::__init__::225::IOProcess::(_processLogs) (541703) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:17,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) (541704) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) (541704) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) (541704) Building response >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) (541704) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:17,838::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) (541705) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:17,839::__init__::225::IOProcess::(_processLogs) (541705) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:17,840::__init__::225::IOProcess::(_processLogs) (541705) Building response >Thread-19::DEBUG::2014-08-11 17:38:17,840::__init__::225::IOProcess::(_processLogs) (541705) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:17,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:17,840::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:38:19,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:19,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0435281 s, 23.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:38:20,078::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:38:20,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:20,713::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:20,713::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:21,395::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:21,396::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:21,396::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:21,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:21,727::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365287 s, 28.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:23,053::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:23,053::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:23,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) (541706) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) (541706) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) DEBUG|(541706) Building response >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) (541706) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:23,054::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:23,055::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:38:23,055::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:38:23,124::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000962371 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) (541707) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:23,125::__init__::225::IOProcess::(_processLogs) (541707) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:23,126::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(541707) Building response >Thread-19::DEBUG::2014-08-11 17:38:23,126::__init__::225::IOProcess::(_processLogs) (541707) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:23,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:23,127::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:38:23,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`babd895f-0bcf-4eee-88f5-46091157cfc8`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:23,365::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:38:23,365::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000962371', 'lastCheck': '0.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371515', 'lastCheck': '5.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:23,366::task::1191::Storage.TaskManager.Task::(prepare) Task=`babd895f-0bcf-4eee-88f5-46091157cfc8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000962371', 'lastCheck': '0.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371515', 'lastCheck': '5.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:23,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`babd895f-0bcf-4eee-88f5-46091157cfc8`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:23,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:23,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:23,366::task::993::Storage.TaskManager.Task::(_decref) Task=`babd895f-0bcf-4eee-88f5-46091157cfc8`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:38:23,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:23,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:23,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:23,809::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015855 s, 64.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:38:24,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`df560bf1-e56f-4376-9e76-9a1f05a06eed`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:38:24,406::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:38:24,407::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:24,407::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:38:24,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:24,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:24,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:24,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:24,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:24,408::__init__::225::IOProcess::(_processLogs) (541708) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:38:24,408::__init__::225::IOProcess::(_processLogs) (541708) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:38:24,410::__init__::225::IOProcess::(_processLogs) (541708) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:24,410::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:38:24,411::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:38:24,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:24,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:24,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:24,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::INFO::2014-08-11 17:38:24,412::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:38:24,412::__init__::225::IOProcess::(_processLogs) (541709) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:38:24,412::task::1191::Storage.TaskManager.Task::(prepare) Task=`df560bf1-e56f-4376-9e76-9a1f05a06eed`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:38:24,413::__init__::225::IOProcess::(_processLogs) (541709) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:38:24,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`df560bf1-e56f-4376-9e76-9a1f05a06eed`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:38:24,413::__init__::225::IOProcess::(_processLogs) (541709) Building response >Thread-10017::DEBUG::2014-08-11 17:38:24,413::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:38:24,414::__init__::225::IOProcess::(_processLogs) (541709) Queuing response >Thread-10017::DEBUG::2014-08-11 17:38:24,414::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:38:24,414::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:38:24,415::task::993::Storage.TaskManager.Task::(_decref) Task=`df560bf1-e56f-4376-9e76-9a1f05a06eed`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:38:24,415::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:38:24,441::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:38:25,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:25,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:25,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:25,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:25,920::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443762 s, 23.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:38:25,950::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:38:25,951::task::595::Storage.TaskManager.Task::(_updateState) Task=`89d30579-9da7-46fa-9c4d-57fd3f090553`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:25,951::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:38:25,996::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:25,996::task::1191::Storage.TaskManager.Task::(prepare) Task=`89d30579-9da7-46fa-9c4d-57fd3f090553`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:25,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`89d30579-9da7-46fa-9c4d-57fd3f090553`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:25,996::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:25,997::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:25,997::task::993::Storage.TaskManager.Task::(_decref) Task=`89d30579-9da7-46fa-9c4d-57fd3f090553`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:38:26,004::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:38:26,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`df6dd482-6837-417d-a8a3-5705251199a1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:38:26,004::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:38:26,004::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9580cc80-43b2-4d92-a81f-d3f23ef259c6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:38:26,004::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:38:26,004::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:38:26,004::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9580cc80-43b2-4d92-a81f-d3f23ef259c6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:38:26,005::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`df6dd482-6837-417d-a8a3-5705251199a1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:38:26,005::task::993::Storage.TaskManager.Task::(_decref) Task=`df6dd482-6837-417d-a8a3-5705251199a1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:38:26,039::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:26,039::task::1191::Storage.TaskManager.Task::(prepare) Task=`df6dd482-6837-417d-a8a3-5705251199a1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:26,039::task::595::Storage.TaskManager.Task::(_updateState) Task=`df6dd482-6837-417d-a8a3-5705251199a1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:38:26,039::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:38:26,039::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:38:26,040::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:38:26,040::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:38:26,040::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:38:26,040::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:38:26,040::task::993::Storage.TaskManager.Task::(_decref) Task=`df6dd482-6837-417d-a8a3-5705251199a1`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:26,402::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:26,402::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:26,403::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:38:27,839::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) (541710) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) (541710) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:27,840::__init__::225::IOProcess::(_processLogs) (541710) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:27,841::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:38:27,841::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:38:27,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000818151 s, 605 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) (541711) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:27,902::__init__::225::IOProcess::(_processLogs) (541711) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:27,903::__init__::225::IOProcess::(_processLogs) (541711) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:27,903::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:27,903::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:38:27,903::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) (541712) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) (541712) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) (541712) Building response >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) (541712) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:27,904::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) (541713) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:27,905::__init__::225::IOProcess::(_processLogs) (541713) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) (541713) Building response >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) (541713) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:27,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) (541714) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) (541714) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) (541714) Building response >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) (541714) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:27,907::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:38:27,928::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:28,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.041898 s, 24.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:38:29,412::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:38:30,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:30,166::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0682112 s, 15.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:38:30,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:30,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:30,726::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:31,408::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:31,409::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:31,409::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:38:32,124::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:38:32,174::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:32,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0815404 s, 12.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) (541715) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:33,127::__init__::225::IOProcess::(_processLogs) (541715) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:33,130::__init__::225::IOProcess::(_processLogs) (541715) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:33,130::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:38:33,131::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:38:33,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000993618 s, 368 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:33,194::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) (541716) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:33,195::__init__::225::IOProcess::(_processLogs) (541716) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:33,196::__init__::225::IOProcess::(_processLogs) (541716) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:33,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:33,197::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:38:34,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:34,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0786133 s, 13.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:38:35,727::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:35,728::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:35,728::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:36,085::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:38:36,085::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c04cf7a-048b-4221-b39e-93e3fe4badc7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:36,085::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:38:36,133::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:36,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c04cf7a-048b-4221-b39e-93e3fe4badc7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:36,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c04cf7a-048b-4221-b39e-93e3fe4badc7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:36,134::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:36,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:36,134::task::993::Storage.TaskManager.Task::(_decref) Task=`2c04cf7a-048b-4221-b39e-93e3fe4badc7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:38:36,145::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:38:36,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`45c7e673-4019-4e96-87a5-1a95967ec6cf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:38:36,145::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:38:36,146::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`46dbe2f0-4ae3-4ab6-8bee-70fa5bb37950`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:38:36,146::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:38:36,146::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:38:36,146::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`46dbe2f0-4ae3-4ab6-8bee-70fa5bb37950`::Granted request >Thread-10197::DEBUG::2014-08-11 17:38:36,146::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`45c7e673-4019-4e96-87a5-1a95967ec6cf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:38:36,146::task::993::Storage.TaskManager.Task::(_decref) Task=`45c7e673-4019-4e96-87a5-1a95967ec6cf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:38:36,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:36,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`45c7e673-4019-4e96-87a5-1a95967ec6cf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:36,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`45c7e673-4019-4e96-87a5-1a95967ec6cf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:38:36,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:38:36,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:38:36,181::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:38:36,181::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:38:36,181::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:38:36,181::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:38:36,182::task::993::Storage.TaskManager.Task::(_decref) Task=`45c7e673-4019-4e96-87a5-1a95967ec6cf`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:36,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:36,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:36,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:36,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:36,602::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127645 s, 80.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:37,907::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:37,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:37,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:37,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:37,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:37,908::__init__::225::IOProcess::(_processLogs) (541717) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:37,908::__init__::225::IOProcess::(_processLogs) (541717) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:37,908::__init__::225::IOProcess::(_processLogs) (541717) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:37,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:38:37,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:38:37,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00120958 s, 409 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:37,969::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:37,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:37,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:37,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:37,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:37,970::__init__::225::IOProcess::(_processLogs) (541718) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:37,970::__init__::225::IOProcess::(_processLogs) (541718) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:37,970::__init__::225::IOProcess::(_processLogs) (541718) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:37,971::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) (541719) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) (541719) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) (541719) Building response >Thread-19::DEBUG::2014-08-11 17:38:37,972::__init__::225::IOProcess::(_processLogs) (541719) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:37,973::__init__::225::IOProcess::(_processLogs) (541720) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:37,974::__init__::225::IOProcess::(_processLogs) (541720) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:37,974::__init__::225::IOProcess::(_processLogs) (541720) Building response >Thread-19::DEBUG::2014-08-11 17:38:37,974::__init__::225::IOProcess::(_processLogs) (541720) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:37,974::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:37,974::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) (541721) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) (541721) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) (541721) Building response >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) (541721) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:37,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10237::DEBUG::2014-08-11 17:38:38,540::task::595::Storage.TaskManager.Task::(_updateState) Task=`dca3959e-3f5c-4238-bc75-1930b1b8ef4d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:38,541::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:38:38,541::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000993618', 'lastCheck': '5.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120958', 'lastCheck': '0.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:38,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`dca3959e-3f5c-4238-bc75-1930b1b8ef4d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000993618', 'lastCheck': '5.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00120958', 'lastCheck': '0.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:38,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`dca3959e-3f5c-4238-bc75-1930b1b8ef4d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:38,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:38,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:38,541::task::993::Storage.TaskManager.Task::(_decref) Task=`dca3959e-3f5c-4238-bc75-1930b1b8ef4d`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:38:38,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:38,559::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:38,609::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:38,736::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0678222 s, 15.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:38:39,448::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:38:40,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:40,735::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:40,735::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:40,745::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:40,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0667789 s, 15.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:41,421::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:41,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:41,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:42,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:42,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0266856 s, 38.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:43,197::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) (541722) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) (541722) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:43,198::__init__::225::IOProcess::(_processLogs) (541722) Queuing response >Thread-27::DEBUG::2014-08-11 17:38:43,199::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:38:43,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:43,257::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:38:43,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000703697 s, 520 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:43,260::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:43,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:43,262::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:43,262::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:43,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:43,264::__init__::225::IOProcess::(_processLogs) (541723) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:43,265::__init__::225::IOProcess::(_processLogs) (541723) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:43,266::__init__::225::IOProcess::(_processLogs) (541723) Building response >Thread-19::DEBUG::2014-08-11 17:38:43,266::__init__::225::IOProcess::(_processLogs) (541723) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:43,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:43,267::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:38:44,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`a91704c2-039f-4dc0-953a-b6318e980d5a`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:38:44,443::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) (541724) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) (541724) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:38:44,444::__init__::225::IOProcess::(_processLogs) (541724) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:44,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:44,445::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:38:44,445::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:38:44,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:44,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:38:44,445::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:38:44,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:38:44,446::task::1191::Storage.TaskManager.Task::(prepare) Task=`a91704c2-039f-4dc0-953a-b6318e980d5a`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10102::DEBUG::2014-08-11 17:38:44,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`a91704c2-039f-4dc0-953a-b6318e980d5a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:38:44,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:38:44,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:38:44,447::__init__::225::IOProcess::(_processLogs) (541725) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:38:44,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:38:44,448::__init__::225::IOProcess::(_processLogs) (541725) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:38:44,448::task::993::Storage.TaskManager.Task::(_decref) Task=`a91704c2-039f-4dc0-953a-b6318e980d5a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:38:44,448::__init__::225::IOProcess::(_processLogs) (541725) Building response >Thread-19::DEBUG::2014-08-11 17:38:44,449::__init__::225::IOProcess::(_processLogs) (541725) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:44,449::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:44,449::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:38:44,470::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:38:44,972::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:45,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0504712 s, 20.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:38:45,741::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:45,741::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:45,742::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:46,309::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:38:46,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0e71eb6-773c-45b5-b3ba-651a7ea2d843`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:46,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:38:46,341::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:46,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`c0e71eb6-773c-45b5-b3ba-651a7ea2d843`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:46,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`c0e71eb6-773c-45b5-b3ba-651a7ea2d843`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:46,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:46,341::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:46,341::task::993::Storage.TaskManager.Task::(_decref) Task=`c0e71eb6-773c-45b5-b3ba-651a7ea2d843`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:38:46,353::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:38:46,353::task::595::Storage.TaskManager.Task::(_updateState) Task=`774a67dc-1cff-4761-bb7a-d6dd7ceb4101`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:38:46,354::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:38:46,354::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b7645ebe-37db-459f-a1fe-3dc4edac8402`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:38:46,354::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:38:46,354::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:38:46,354::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b7645ebe-37db-459f-a1fe-3dc4edac8402`::Granted request >Thread-10197::DEBUG::2014-08-11 17:38:46,354::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`774a67dc-1cff-4761-bb7a-d6dd7ceb4101`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:38:46,354::task::993::Storage.TaskManager.Task::(_decref) Task=`774a67dc-1cff-4761-bb7a-d6dd7ceb4101`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:38:46,399::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:46,399::task::1191::Storage.TaskManager.Task::(prepare) Task=`774a67dc-1cff-4761-bb7a-d6dd7ceb4101`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:46,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`774a67dc-1cff-4761-bb7a-d6dd7ceb4101`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:38:46,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:38:46,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:38:46,400::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:38:46,400::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:38:46,400::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:38:46,400::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:38:46,400::task::993::Storage.TaskManager.Task::(_decref) Task=`774a67dc-1cff-4761-bb7a-d6dd7ceb4101`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:46,427::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:46,427::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:46,428::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:47,167::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:47,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0233924 s, 43.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:47,976::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:47,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:47,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:47,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:47,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:47,977::__init__::225::IOProcess::(_processLogs) (541726) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:47,977::__init__::225::IOProcess::(_processLogs) (541726) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:47,979::__init__::225::IOProcess::(_processLogs) (541726) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:47,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:38:47,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:38:48,061::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00538102 s, 92.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) (541727) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:48,062::__init__::225::IOProcess::(_processLogs) (541727) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:48,063::__init__::225::IOProcess::(_processLogs) (541727) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:48,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:48,064::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:38:48,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:48,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:48,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:48,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:48,064::__init__::225::IOProcess::(_processLogs) (541728) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) (541728) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) (541728) Building response >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) (541728) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:48,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) (541729) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) (541729) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) (541729) Building response >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) (541729) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:38:48,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:48,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:48,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:48,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:48,067::__init__::225::IOProcess::(_processLogs) (541730) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:48,067::__init__::225::IOProcess::(_processLogs) (541730) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:48,069::__init__::225::IOProcess::(_processLogs) (541730) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:48,069::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:38:49,257::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:49,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431055 s, 23.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:38:50,144::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:38:50,747::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:50,748::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:50,748::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:51,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:51,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:51,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:51,433::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:38:51,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334332 s, 30.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) (541731) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:53,266::__init__::225::IOProcess::(_processLogs) (541731) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:53,267::__init__::225::IOProcess::(_processLogs) (541731) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:53,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:38:53,267::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:38:53,268::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:38:53,327::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000374577 s, 977 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:53,329::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:53,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:53,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:53,333::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:53,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:53,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:53,335::__init__::225::IOProcess::(_processLogs) (541732) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:53,336::__init__::225::IOProcess::(_processLogs) (541732) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:53,337::__init__::225::IOProcess::(_processLogs) (541732) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:53,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:53,339::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:38:53,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:53,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135345 s, 75.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:38:53,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea7d0796-fbb4-43d0-a622-d7db872533a7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:53,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:38:53,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374577', 'lastCheck': '0.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538102', 'lastCheck': '5.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:53,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea7d0796-fbb4-43d0-a622-d7db872533a7`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000374577', 'lastCheck': '0.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00538102', 'lastCheck': '5.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:38:53,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea7d0796-fbb4-43d0-a622-d7db872533a7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:53,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:53,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:53,757::task::993::Storage.TaskManager.Task::(_decref) Task=`ea7d0796-fbb4-43d0-a622-d7db872533a7`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:38:53,775::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:53,775::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:38:54,456::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:38:55,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:55,620::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141615 s, 72.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:38:55,752::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:55,752::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:38:55,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:56,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:56,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:38:56,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:38:56,454::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:38:56,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`b44abdb4-b124-42ed-b96d-52856ba45814`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:38:56,455::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:38:56,496::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:56,497::task::1191::Storage.TaskManager.Task::(prepare) Task=`b44abdb4-b124-42ed-b96d-52856ba45814`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:38:56,497::task::595::Storage.TaskManager.Task::(_updateState) Task=`b44abdb4-b124-42ed-b96d-52856ba45814`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:38:56,497::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:38:56,497::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:38:56,497::task::993::Storage.TaskManager.Task::(_decref) Task=`b44abdb4-b124-42ed-b96d-52856ba45814`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:38:56,508::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:38:56,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`4170897b-293d-45da-9ee8-78e4273e11c5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:38:56,508::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:38:56,508::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`27e319c0-f17a-4419-9a72-184c81dcafba`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:38:56,508::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:38:56,508::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:38:56,508::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`27e319c0-f17a-4419-9a72-184c81dcafba`::Granted request >Thread-10197::DEBUG::2014-08-11 17:38:56,509::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4170897b-293d-45da-9ee8-78e4273e11c5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:38:56,509::task::993::Storage.TaskManager.Task::(_decref) Task=`4170897b-293d-45da-9ee8-78e4273e11c5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:38:56,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:56,538::task::1191::Storage.TaskManager.Task::(prepare) Task=`4170897b-293d-45da-9ee8-78e4273e11c5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:38:56,538::task::595::Storage.TaskManager.Task::(_updateState) Task=`4170897b-293d-45da-9ee8-78e4273e11c5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:38:56,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:38:56,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:38:56,538::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:38:56,538::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:38:56,538::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:38:56,538::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:38:56,538::task::993::Storage.TaskManager.Task::(_decref) Task=`4170897b-293d-45da-9ee8-78e4273e11c5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:38:57,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:57,700::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123537 s, 82.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:58,070::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:58,070::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:58,070::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:58,070::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:58,070::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:58,070::__init__::225::IOProcess::(_processLogs) (541733) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:58,071::__init__::225::IOProcess::(_processLogs) (541733) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:58,072::__init__::225::IOProcess::(_processLogs) (541733) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:58,072::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:38:58,072::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:38:58,132::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00128815 s, 384 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:38:58,133::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:38:58,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:58,133::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:58,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:58,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:58,134::__init__::225::IOProcess::(_processLogs) (541734) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:38:58,134::__init__::225::IOProcess::(_processLogs) (541734) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:38:58,134::__init__::225::IOProcess::(_processLogs) (541734) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:58,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) (541735) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) (541735) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) (541735) Building response >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) (541735) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:58,136::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) (541736) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) (541736) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) (541736) Building response >Thread-19::DEBUG::2014-08-11 17:38:58,137::__init__::225::IOProcess::(_processLogs) (541736) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:38:58,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:38:58,139::__init__::225::IOProcess::(_processLogs) (541737) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:38:58,139::__init__::225::IOProcess::(_processLogs) (541737) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:38:58,139::__init__::225::IOProcess::(_processLogs) (541737) Building response >Thread-19::DEBUG::2014-08-11 17:38:58,139::__init__::225::IOProcess::(_processLogs) (541737) Queuing response >Thread-19::DEBUG::2014-08-11 17:38:58,139::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:38:58,139::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:38:59,478::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:38:59,708::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:38:59,795::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0282191 s, 36.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:00,756::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:00,757::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:00,757::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:01,441::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:01,442::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:01,442::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:01,803::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:01,881::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0177737 s, 57.6 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:39:02,157::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:03,339::__init__::225::IOProcess::(_processLogs) (541738) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:03,340::__init__::225::IOProcess::(_processLogs) (541738) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:03,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541738) Building response >Thread-19::DEBUG::2014-08-11 17:39:03,340::__init__::225::IOProcess::(_processLogs) (541738) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:03,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:39:03,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:03,341::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:39:03,404::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00191774 s, 191 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:03,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) (541739) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:03,407::__init__::225::IOProcess::(_processLogs) (541739) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:03,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541739) Building response >Thread-19::DEBUG::2014-08-11 17:39:03,408::__init__::225::IOProcess::(_processLogs) (541739) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:03,408::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:03,409::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:39:03,946::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:04,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468926 s, 21.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:05,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:05,761::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:05,762::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:06,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:06,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329044 s, 31.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:06,448::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:06,448::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:06,449::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:06,578::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:06,578::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb1aacb6-4f02-4c08-a282-ba080bc9d8f5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:06,578::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:39:06,625::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:06,625::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb1aacb6-4f02-4c08-a282-ba080bc9d8f5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:06,625::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb1aacb6-4f02-4c08-a282-ba080bc9d8f5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:06,626::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:06,626::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:06,626::task::993::Storage.TaskManager.Task::(_decref) Task=`fb1aacb6-4f02-4c08-a282-ba080bc9d8f5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:39:06,638::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:39:06,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffaa0f12-0f65-453f-8d34-f0fddfecf4d9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:06,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:39:06,638::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`00c1bb10-f384-4340-b2a9-1956bb44d9e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:39:06,638::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:06,639::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:06,639::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`00c1bb10-f384-4340-b2a9-1956bb44d9e0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:06,639::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ffaa0f12-0f65-453f-8d34-f0fddfecf4d9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:06,639::task::993::Storage.TaskManager.Task::(_decref) Task=`ffaa0f12-0f65-453f-8d34-f0fddfecf4d9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:39:06,655::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:06,655::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffaa0f12-0f65-453f-8d34-f0fddfecf4d9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:06,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffaa0f12-0f65-453f-8d34-f0fddfecf4d9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:39:06,655::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:39:06,655::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:39:06,656::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:39:06,656::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:39:06,656::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:39:06,656::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:39:06,656::task::993::Storage.TaskManager.Task::(_decref) Task=`ffaa0f12-0f65-453f-8d34-f0fddfecf4d9`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:08,139::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:08,139::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:08,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) (541740) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) (541740) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:08,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541740) Building response >Thread-19::DEBUG::2014-08-11 17:39:08,141::__init__::225::IOProcess::(_processLogs) (541740) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:08,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:08,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:39:08,143::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:08,201::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:39:08,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000755121 s, 656 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:08,317::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:08,317::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:08,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:08,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:08,318::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:08,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:08,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:08,318::__init__::225::IOProcess::(_processLogs) (541741) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:08,318::__init__::225::IOProcess::(_processLogs) (541741) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) (541741) Building response >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) (541741) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:08,319::__init__::225::IOProcess::(_processLogs) (541742) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:08,320::__init__::225::IOProcess::(_processLogs) (541742) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:08,332::__init__::225::IOProcess::(_processLogs) (541742) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:08,332::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:08,333::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:08,334::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:08,335::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:08,335::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:08,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:08,336::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:08,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:08,337::__init__::225::IOProcess::(_processLogs) (541743) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:08,338::__init__::225::IOProcess::(_processLogs) (541743) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:08,339::__init__::225::IOProcess::(_processLogs) (541743) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:08,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:08,340::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:39:08,340::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0227705 s, 45.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:08,341::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:39:08,341::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:08,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:08,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:08,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:08,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:08,343::__init__::225::IOProcess::(_processLogs) (541744) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:08,344::__init__::225::IOProcess::(_processLogs) (541744) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:08,344::__init__::225::IOProcess::(_processLogs) (541744) Building response >Thread-19::DEBUG::2014-08-11 17:39:08,345::__init__::225::IOProcess::(_processLogs) (541744) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:08,346::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:08,346::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:39:08,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`715c57d0-7d3b-44cd-a0d9-ad8ac07ec266`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:08,958::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:39:08,958::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00191774', 'lastCheck': '5.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755121', 'lastCheck': '0.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:08,958::task::1191::Storage.TaskManager.Task::(prepare) Task=`715c57d0-7d3b-44cd-a0d9-ad8ac07ec266`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00191774', 'lastCheck': '5.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000755121', 'lastCheck': '0.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:08,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`715c57d0-7d3b-44cd-a0d9-ad8ac07ec266`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:08,958::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:08,958::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:08,958::task::993::Storage.TaskManager.Task::(_decref) Task=`715c57d0-7d3b-44cd-a0d9-ad8ac07ec266`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:39:08,977::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:08,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:39:09,477::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:39:10,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:10,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0354331 s, 28.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:10,768::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:10,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:10,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:11,454::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:11,455::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:11,455::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:12,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:12,598::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0819527 s, 12.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:13,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:13,410::__init__::225::IOProcess::(_processLogs) (541745) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:13,410::__init__::225::IOProcess::(_processLogs) (541745) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:13,411::__init__::225::IOProcess::(_processLogs) DEBUG|(541745) Building response >Thread-19::DEBUG::2014-08-11 17:39:13,411::__init__::225::IOProcess::(_processLogs) (541745) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:13,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:13,411::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:39:13,412::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:39:13,482::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00804414 s, 45.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:13,483::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:13,483::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:13,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:13,483::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:13,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:13,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:13,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:13,484::__init__::225::IOProcess::(_processLogs) (541746) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:13,484::__init__::225::IOProcess::(_processLogs) (541746) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:13,500::__init__::225::IOProcess::(_processLogs) DEBUG|(541746) Building response >Thread-19::DEBUG::2014-08-11 17:39:13,500::__init__::225::IOProcess::(_processLogs) (541746) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:13,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:13,500::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:39:14,521::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:39:14,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:14,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168338 s, 60.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:15,775::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:15,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:15,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:16,461::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:16,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:16,462::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:16,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:39:16,747::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:16,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d936cb3-ef4a-4a11-ad2c-22102863a6d0`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:16,747::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:39:16,815::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633473 s, 16.2 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:39:16,823::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:16,823::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d936cb3-ef4a-4a11-ad2c-22102863a6d0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:16,823::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d936cb3-ef4a-4a11-ad2c-22102863a6d0`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:16,823::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:16,823::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:16,823::task::993::Storage.TaskManager.Task::(_decref) Task=`9d936cb3-ef4a-4a11-ad2c-22102863a6d0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:39:16,834::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:39:16,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f0c3ed4-f2a2-4d88-810c-1ea581647bb0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:16,834::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:39:16,835::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`eed4e126-0aa7-4b3f-be6d-c79fe1c6a634`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:39:16,835::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:16,835::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:16,835::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`eed4e126-0aa7-4b3f-be6d-c79fe1c6a634`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:16,835::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4f0c3ed4-f2a2-4d88-810c-1ea581647bb0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:16,835::task::993::Storage.TaskManager.Task::(_decref) Task=`4f0c3ed4-f2a2-4d88-810c-1ea581647bb0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:39:16,852::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:16,852::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f0c3ed4-f2a2-4d88-810c-1ea581647bb0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:16,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f0c3ed4-f2a2-4d88-810c-1ea581647bb0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:39:16,853::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:39:16,853::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:39:16,853::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:39:16,853::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:39:16,853::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:39:16,853::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:39:16,853::task::993::Storage.TaskManager.Task::(_decref) Task=`4f0c3ed4-f2a2-4d88-810c-1ea581647bb0`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:18,346::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:18,346::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:18,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:18,346::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:18,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:18,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:18,347::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:18,347::__init__::225::IOProcess::(_processLogs) (541747) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:18,347::__init__::225::IOProcess::(_processLogs) (541747) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:18,347::__init__::225::IOProcess::(_processLogs) DEBUG|(541747) Building response >Thread-19::DEBUG::2014-08-11 17:39:18,348::__init__::225::IOProcess::(_processLogs) (541747) Queuing response >Thread-28::DEBUG::2014-08-11 17:39:18,348::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:18,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:18,407::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:39:18,407::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000448258 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:18,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:18,409::__init__::225::IOProcess::(_processLogs) (541748) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:18,409::__init__::225::IOProcess::(_processLogs) (541748) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:18,409::__init__::225::IOProcess::(_processLogs) DEBUG|(541748) Building response >Thread-19::DEBUG::2014-08-11 17:39:18,409::__init__::225::IOProcess::(_processLogs) (541748) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:18,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:18,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) (541749) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) (541749) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) (541749) Building response >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) (541749) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:18,411::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) (541750) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) (541750) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) (541750) Building response >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) (541750) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:18,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:18,413::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:18,413::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:39:18,413::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:18,413::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:18,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) (541751) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) (541751) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) (541751) Building response >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) (541751) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:18,414::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:39:18,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:18,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0447185 s, 22.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:39:20,214::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Thread-10197::DEBUG::2014-08-11 17:39:20,691::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [10126e78] >Thread-10197::DEBUG::2014-08-11 17:39:20,692::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:20,692::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='4c2b3c72-a901-435d-9a9f-8628b2263c7e', size='1350565888', volFormat=5, preallocate=2, diskType=2, volUUID='bdca8406-da33-4323-9fa9-53d245f0a0ed', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-10197::DEBUG::2014-08-11 17:39:20,692::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`11868e8d-6e5e-4b16-bc9d-77546df3a0fd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-10197::DEBUG::2014-08-11 17:39:20,692::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:20,692::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:20,693::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`11868e8d-6e5e-4b16-bc9d-77546df3a0fd`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:20,693::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:20,693::task::993::Storage.TaskManager.Task::(_decref) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:39:20,693::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,693::__init__::225::IOProcess::(_processLogs) Message size is 73 >Thread-19::DEBUG::2014-08-11 17:39:20,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) (541752) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) (541752) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) (541752) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) (541752) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,694::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) Message size is 77 >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) (541753) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) (541753) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) (541753) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) (541753) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) Message size is 89 >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) (541754) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) (541754) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) (541754) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) (541754) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,697::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) (541755) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) (541755) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) (541755) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) (541755) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) Message size is 135 >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,699::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) (541756) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) (541756) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) (541756) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) (541756) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,700::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) (541757) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) (541757) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,701::__init__::225::IOProcess::(_processLogs) (541757) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) (541758) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) (541758) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,702::__init__::225::IOProcess::(_processLogs) (541758) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) (541758) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Message size is 185 >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) (541759) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,703::__init__::225::IOProcess::(_processLogs) (541759) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,719::__init__::225::IOProcess::(_processLogs) (541759) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,719::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) (541760) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,721::__init__::225::IOProcess::(_processLogs) (541760) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,722::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541760) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,722::__init__::225::IOProcess::(_processLogs) (541760) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,722::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:20,722::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,723::__init__::225::IOProcess::(_processLogs) (541761) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) (541761) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541761) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) (541761) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:20,724::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) (541762) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) (541762) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) (541762) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,725::__init__::225::IOProcess::(_processLogs) (541762) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) (541763) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,726::__init__::225::IOProcess::(_processLogs) (541763) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,736::__init__::225::IOProcess::(_processLogs) (541763) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) (541764) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:20,737::__init__::225::IOProcess::(_processLogs) (541764) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:20,758::__init__::225::IOProcess::(_processLogs) (541764) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,758::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:20,758::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:20,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) (541765) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) (541765) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) (541765) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,759::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-10197::WARNING::2014-08-11 17:39:20,759::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) (541766) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:20,760::__init__::225::IOProcess::(_processLogs) (541766) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:20,769::__init__::225::IOProcess::(_processLogs) (541766) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,769::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:39:20,769::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) (541767) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:20,770::__init__::225::IOProcess::(_processLogs) (541767) Got request for method 'rename' >GuestMonitor-vm::DEBUG::2014-08-11 17:39:20,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:20,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:20,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:39:20,785::__init__::225::IOProcess::(_processLogs) DEBUG|(541767) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,785::__init__::225::IOProcess::(_processLogs) (541767) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,786::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,787::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,787::__init__::225::IOProcess::(_processLogs) (541768) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,787::__init__::225::IOProcess::(_processLogs) (541768) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:20,789::__init__::225::IOProcess::(_processLogs) DEBUG|(541768) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,789::__init__::225::IOProcess::(_processLogs) (541768) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,789::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,789::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) (541769) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,790::__init__::225::IOProcess::(_processLogs) (541769) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:20,800::__init__::225::IOProcess::(_processLogs) DEBUG|(541769) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,800::__init__::225::IOProcess::(_processLogs) (541769) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,800::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) (541770) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:20,801::__init__::225::IOProcess::(_processLogs) (541770) Got request for method 'lexists' >Thread-10197::DEBUG::2014-08-11 17:39:20,802::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task fd387023-cd7f-4ba1-9d20-6d42f853109f >Thread-19::DEBUG::2014-08-11 17:39:20,802::__init__::225::IOProcess::(_processLogs) DEBUG|(541770) Building response >Thread-10197::INFO::2014-08-11 17:39:20,802::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-19::DEBUG::2014-08-11 17:39:20,802::__init__::225::IOProcess::(_processLogs) (541770) Queuing response >Thread-10197::DEBUG::2014-08-11 17:39:20,803::task::1183::Storage.TaskManager.Task::(prepare) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::Prepare: 1 jobs exist, move to acquiring >Thread-19::DEBUG::2014-08-11 17:39:20,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:20,803::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,804::__init__::225::IOProcess::(_processLogs) (541771) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,805::__init__::225::IOProcess::(_processLogs) (541771) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,805::__init__::225::IOProcess::(_processLogs) DEBUG|(541771) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,805::__init__::225::IOProcess::(_processLogs) (541771) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,805::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:20,805::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,806::__init__::225::IOProcess::(_processLogs) (541772) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) (541772) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) DEBUG|(541772) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) (541772) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:20,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) (541773) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) (541773) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) (541773) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) (541773) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,808::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) (541774) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,809::__init__::225::IOProcess::(_processLogs) (541774) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,817::__init__::225::IOProcess::(_processLogs) DEBUG|(541774) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,817::__init__::225::IOProcess::(_processLogs) (541774) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,817::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,818::__init__::225::IOProcess::(_processLogs) (541775) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:20,819::__init__::225::IOProcess::(_processLogs) (541775) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:20,835::__init__::225::IOProcess::(_processLogs) DEBUG|(541775) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,836::__init__::225::IOProcess::(_processLogs) (541775) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,836::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,836::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:20,836::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,836::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) (541776) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:20,837::__init__::225::IOProcess::(_processLogs) (541776) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:20,856::__init__::225::IOProcess::(_processLogs) DEBUG|(541776) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,856::__init__::225::IOProcess::(_processLogs) (541776) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,856::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,856::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:20,857::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,857::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:20,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::WARNING::2014-08-11 17:39:20,857::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:20,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,858::__init__::225::IOProcess::(_processLogs) (541777) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,858::__init__::225::IOProcess::(_processLogs) (541777) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:20,858::__init__::225::IOProcess::(_processLogs) (541777) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,858::__init__::225::IOProcess::(_processLogs) (541777) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) (541778) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:20,859::__init__::225::IOProcess::(_processLogs) (541778) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:20,869::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541778) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,869::__init__::225::IOProcess::(_processLogs) (541778) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,870::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::WARNING::2014-08-11 17:39:20,870::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:20,870::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) (541779) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:20,871::__init__::225::IOProcess::(_processLogs) (541779) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:20,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541779) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,877::__init__::225::IOProcess::(_processLogs) (541779) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) (541780) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,878::__init__::225::IOProcess::(_processLogs) (541780) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:20,880::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541780) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,880::__init__::225::IOProcess::(_processLogs) (541780) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Sending response sized 99 >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) (541781) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) (541781) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) (541781) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) (541781) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:20,882::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) (541782) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:20,883::__init__::225::IOProcess::(_processLogs) (541782) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:20,892::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541782) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,892::__init__::225::IOProcess::(_processLogs) (541782) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,892::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,892::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,892::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,892::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) (541783) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,893::__init__::225::IOProcess::(_processLogs) (541783) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:20,900::__init__::225::IOProcess::(_processLogs) DEBUG|(541783) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,900::__init__::225::IOProcess::(_processLogs) (541783) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,900::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,900::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,900::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,900::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) (541784) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) (541784) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) DEBUG|(541784) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) (541784) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,901::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:20,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-08-11 17:39:20,902::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,902::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,902::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:20,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) (541785) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) (541785) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,903::__init__::225::IOProcess::(_processLogs) DEBUG|(541785) Building response >Thread-10197::DEBUG::2014-08-11 17:39:20,903::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) (541785) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,904::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) (541786) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) (541786) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) DEBUG|(541786) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) (541786) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,905::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) (541787) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:20,906::__init__::225::IOProcess::(_processLogs) (541787) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) (541787) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) (541787) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,907::__init__::225::IOProcess::(_processLogs) (541788) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:20,908::__init__::225::IOProcess::(_processLogs) (541788) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:20,915::__init__::225::IOProcess::(_processLogs) DEBUG|(541788) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,916::__init__::225::IOProcess::(_processLogs) (541788) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,916::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:20,916::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) (541789) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:20,917::__init__::225::IOProcess::(_processLogs) (541789) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:20,947::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541789) Building response >Thread-19::DEBUG::2014-08-11 17:39:20,947::__init__::225::IOProcess::(_processLogs) (541789) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:20,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:20,948::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:20,949::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:20,949::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:20,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:20,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:20,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:20,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:20,950::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:20,950::__init__::225::IOProcess::(_processLogs) (541790) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:20,950::__init__::225::IOProcess::(_processLogs) (541790) Got request for method 'writefile' >Dummy-51::DEBUG::2014-08-11 17:39:20,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:21,019::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541790) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,047::__init__::225::IOProcess::(_processLogs) (541790) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,048::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,049::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,051::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,052::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,053::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,053::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,054::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,055::__init__::225::IOProcess::(_processLogs) (541791) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,056::__init__::225::IOProcess::(_processLogs) (541791) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,057::__init__::225::IOProcess::(_processLogs) (541791) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,057::__init__::225::IOProcess::(_processLogs) (541791) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,058::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:39:21,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387118 s, 26.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:21,059::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-10197::WARNING::2014-08-11 17:39:21,060::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,062::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,062::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,065::__init__::225::IOProcess::(_processLogs) (541792) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,066::__init__::225::IOProcess::(_processLogs) (541792) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,077::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541792) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,077::__init__::225::IOProcess::(_processLogs) (541792) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,077::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:39:21,077::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,078::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,078::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,078::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,079::__init__::225::IOProcess::(_processLogs) (541793) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,079::__init__::225::IOProcess::(_processLogs) (541793) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,092::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541793) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,092::__init__::225::IOProcess::(_processLogs) (541793) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,092::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,094::__init__::225::IOProcess::(_processLogs) (541794) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,094::__init__::225::IOProcess::(_processLogs) (541794) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,096::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541794) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,096::__init__::225::IOProcess::(_processLogs) (541794) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,096::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,096::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:39:21,096::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) (541795) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,097::__init__::225::IOProcess::(_processLogs) (541795) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) (541795) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) (541795) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,098::__init__::225::IOProcess::(_processLogs) (541796) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,099::__init__::225::IOProcess::(_processLogs) (541796) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,106::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541796) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,106::__init__::225::IOProcess::(_processLogs) (541796) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,106::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,107::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) (541797) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) (541797) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) (541797) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) (541797) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,108::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) (541798) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,109::__init__::225::IOProcess::(_processLogs) (541798) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,120::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541798) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,120::__init__::225::IOProcess::(_processLogs) (541798) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,120::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,120::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,121::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) (541799) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,122::__init__::225::IOProcess::(_processLogs) (541799) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,127::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541799) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,127::__init__::225::IOProcess::(_processLogs) (541799) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,128::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,129::__init__::225::IOProcess::(_processLogs) (541800) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:21,129::__init__::225::IOProcess::(_processLogs) (541800) Got request for method 'lexists' >Thread-10197::DEBUG::2014-08-11 17:39:21,129::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: fd387023-cd7f-4ba1-9d20-6d42f853109f >Thread-19::DEBUG::2014-08-11 17:39:21,129::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541800) Building response >Thread-10197::DEBUG::2014-08-11 17:39:21,129::taskManager::64::Storage.TaskManager::(_queueTask) task queued: fd387023-cd7f-4ba1-9d20-6d42f853109f >662974f8-c0cf-4c1f-93b1-14f4a8483cb1::DEBUG::2014-08-11 17:39:21,130::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-19::DEBUG::2014-08-11 17:39:21,130::__init__::225::IOProcess::(_processLogs) (541800) Queuing response >Thread-10197::DEBUG::2014-08-11 17:39:21,130::task::1188::Storage.TaskManager.Task::(prepare) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::returning >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,130::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: fd387023-cd7f-4ba1-9d20-6d42f853109f running: <bound method Task.commit of <storage.task.Task instance at 0x7f2c7d15de18>> with: None >Thread-19::DEBUG::2014-08-11 17:39:21,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:21,131::task::993::Storage.TaskManager.Task::(_decref) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::ref 0 aborting False >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,131::task::1200::Storage.TaskManager.Task::(commit) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::committing task: fd387023-cd7f-4ba1-9d20-6d42f853109f >Thread-19::DEBUG::2014-08-11 17:39:21,132::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,132::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::moving from state queued -> state running >Thread-19::DEBUG::2014-08-11 17:39:21,133::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,133::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,133::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,134::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,134::__init__::225::IOProcess::(_processLogs) (541801) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,134::__init__::225::IOProcess::(_processLogs) (541801) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,134::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541801) Building response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,134::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) (541801) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,136::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,136::__init__::225::IOProcess::(_processLogs) (541802) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,136::__init__::225::IOProcess::(_processLogs) (541802) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,136::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541802) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,136::__init__::225::IOProcess::(_processLogs) (541802) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,136::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,137::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) (541803) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) (541803) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) (541803) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) (541803) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,139::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,139::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,139::__init__::225::IOProcess::(_processLogs) (541804) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,139::__init__::225::IOProcess::(_processLogs) (541804) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,152::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541804) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,152::__init__::225::IOProcess::(_processLogs) (541804) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,153::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,153::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,153::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,153::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) (541805) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,154::__init__::225::IOProcess::(_processLogs) (541805) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,181::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541805) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,182::__init__::225::IOProcess::(_processLogs) (541805) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,182::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,182::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,182::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,182::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) (541806) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,183::__init__::225::IOProcess::(_processLogs) (541806) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,201::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541806) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,202::__init__::225::IOProcess::(_processLogs) (541806) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,202::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,202::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,202::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,202::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,203::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,203::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,203::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) (541807) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) (541807) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) (541807) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) (541807) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,204::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) (541808) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,205::__init__::225::IOProcess::(_processLogs) (541808) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,208::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541808) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,208::__init__::225::IOProcess::(_processLogs) (541808) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,208::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,208::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,209::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,209::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,209::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,210::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,210::__init__::225::IOProcess::(_processLogs) (541809) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,210::__init__::225::IOProcess::(_processLogs) (541809) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,219::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541809) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) (541809) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,220::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) (541810) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) (541810) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) DEBUG|(541810) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,221::__init__::225::IOProcess::(_processLogs) (541810) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,222::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) (541811) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) (541811) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) (541811) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) (541811) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) (541812) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,224::__init__::225::IOProcess::(_processLogs) (541812) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,227::__init__::225::IOProcess::(_processLogs) DEBUG|(541812) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,227::__init__::225::IOProcess::(_processLogs) (541812) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,227::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,228::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,228::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,228::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,228::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) (541813) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) (541813) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) (541813) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) (541813) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,230::__init__::225::IOProcess::(_processLogs) (541814) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,230::__init__::225::IOProcess::(_processLogs) (541814) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,236::__init__::225::IOProcess::(_processLogs) (541814) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) (541815) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,237::__init__::225::IOProcess::(_processLogs) (541815) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,248::__init__::225::IOProcess::(_processLogs) (541815) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) (541816) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:21,249::__init__::225::IOProcess::(_processLogs) (541816) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:21,250::__init__::225::IOProcess::(_processLogs) (541816) Queuing response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,250::task::905::Storage.TaskManager.Task::(_runJobs) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', '4c2b3c72-a901-435d-9a9f-8628b2263c7e', 2637824, 5, 2, 2, 'bdca8406-da33-4323-9fa9-53d245f0a0ed', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >Thread-19::DEBUG::2014-08-11 17:39:21,250::__init__::225::IOProcess::(_processLogs) Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,250::task::331::Storage.TaskManager.Task::(run) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', '4c2b3c72-a901-435d-9a9f-8628b2263c7e', 2637824, 5, 2, 2, 'bdca8406-da33-4323-9fa9-53d245f0a0ed', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >Thread-19::DEBUG::2014-08-11 17:39:21,251::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,251::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e`ReqID=`e646cab6-7088-4c25-a3cd-0baa7455a37d`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1792' at 'createVolume' >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,252::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e' for lock type 'exclusive' >Thread-19::DEBUG::2014-08-11 17:39:21,252::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:21,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,252::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,252::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,252::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,253::__init__::225::IOProcess::(_processLogs) (541817) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:39:21,253::__init__::225::IOProcess::(_processLogs) (541817) Got request for method 'glob' >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,253::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 4c2b3c72-a901-435d-9a9f-8628b2263c7e does not exist in domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:39:21,253::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541817) Building response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,253::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e' is free. Now locking as 'exclusive' (1 active user) >Thread-19::DEBUG::2014-08-11 17:39:21,254::__init__::225::IOProcess::(_processLogs) (541817) Queuing response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,254::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e`ReqID=`e646cab6-7088-4c25-a3cd-0baa7455a37d`::Granted request >Thread-19::DEBUG::2014-08-11 17:39:21,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,255::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >fd387023-cd7f-4ba1-9d20-6d42f853109f::INFO::2014-08-11 17:39:21,255::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/4c2b3c72-a901-435d-9a9f-8628b2263c7e for image's volumes >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) (541818) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,256::__init__::225::IOProcess::(_processLogs) (541818) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,257::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541818) Building response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,257::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:21,257::__init__::225::IOProcess::(_processLogs) (541818) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) (541819) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,258::__init__::225::IOProcess::(_processLogs) (541819) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541819) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) (541819) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) (541820) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) (541820) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) (541820) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) (541820) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,260::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) (541821) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,261::__init__::225::IOProcess::(_processLogs) (541821) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,270::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541821) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,271::__init__::225::IOProcess::(_processLogs) (541821) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,271::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,271::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) (541822) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,272::__init__::225::IOProcess::(_processLogs) (541822) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,284::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541822) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,284::__init__::225::IOProcess::(_processLogs) (541822) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,285::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,286::__init__::225::IOProcess::(_processLogs) (541823) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,286::__init__::225::IOProcess::(_processLogs) (541823) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,303::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541823) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,303::__init__::225::IOProcess::(_processLogs) (541823) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,303::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,303::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) (541824) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,304::__init__::225::IOProcess::(_processLogs) (541824) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,320::__init__::225::IOProcess::(_processLogs) (541824) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,320::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,321::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,321::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,321::__init__::225::IOProcess::(_processLogs) (541825) Finding callback 'listdir'... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,321::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,322::__init__::225::IOProcess::(_processLogs) (541825) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,322::__init__::225::IOProcess::(_processLogs) (541825) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,322::__init__::225::IOProcess::(_processLogs) (541825) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) (541826) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,323::__init__::225::IOProcess::(_processLogs) (541826) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,333::__init__::225::IOProcess::(_processLogs) (541826) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,333::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,333::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,334::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,335::__init__::225::IOProcess::(_processLogs) (541827) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,335::__init__::225::IOProcess::(_processLogs) (541827) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) (541827) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,346::__init__::225::IOProcess::(_processLogs) (541828) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,346::__init__::225::IOProcess::(_processLogs) (541828) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,346::__init__::225::IOProcess::(_processLogs) (541828) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,347::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:39:21,347::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:21,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,347::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,347::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,347::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) (541829) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) (541829) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) (541829) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) (541829) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,349::__init__::225::IOProcess::(_processLogs) (541830) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,349::__init__::225::IOProcess::(_processLogs) (541830) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,352::__init__::225::IOProcess::(_processLogs) (541830) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,352::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,353::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,353::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) (541831) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) (541831) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) (541831) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) (541831) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,355::__init__::225::IOProcess::(_processLogs) (541832) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,355::__init__::225::IOProcess::(_processLogs) (541832) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) (541832) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,366::__init__::225::IOProcess::(_processLogs) (541833) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,366::__init__::225::IOProcess::(_processLogs) (541833) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541833) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,375::__init__::225::IOProcess::(_processLogs) (541833) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,375::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) (541834) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) (541834) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:21,376::__init__::225::IOProcess::(_processLogs) (541834) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,377::__init__::225::IOProcess::(_processLogs) (541834) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,377::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::INFO::2014-08-11 17:39:21,387::volume::415::Storage.Volume::(create) Creating volume bdca8406-da33-4323-9fa9-53d245f0a0ed >Thread-19::DEBUG::2014-08-11 17:39:21,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,387::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,388::__init__::225::IOProcess::(_processLogs) (541835) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,388::__init__::225::IOProcess::(_processLogs) (541835) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541835) Building response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,388::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) (541835) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,389::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) (541836) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) (541836) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541836) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) (541836) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) (541837) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,391::__init__::225::IOProcess::(_processLogs) (541837) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) (541837) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) (541837) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,392::__init__::225::IOProcess::(_processLogs) (541838) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,393::__init__::225::IOProcess::(_processLogs) (541838) Got request for method 'mkdir' >Thread-10197::DEBUG::2014-08-11 17:39:21,399::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [10126e78] >Thread-10197::DEBUG::2014-08-11 17:39:21,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:21,400::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='cdc5a7e1-4d16-404d-90a4-c0ed6584c11b', size='10240', volFormat=4, preallocate=2, diskType=2, volUUID='269bcc1a-8426-49ae-a837-e9653759fcc8', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-10197::DEBUG::2014-08-11 17:39:21,400::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`15c24240-57f8-42e5-9122-e9eb2a00739a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-10197::DEBUG::2014-08-11 17:39:21,400::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:21,400::resourceManager::566::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-10197::DEBUG::2014-08-11 17:39:21,400::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`15c24240-57f8-42e5-9122-e9eb2a00739a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:21,400::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:21,400::task::993::Storage.TaskManager.Task::(_decref) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Message size is 73 >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) (541839) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) (541839) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) (541839) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) (541839) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) Message size is 77 >Thread-19::DEBUG::2014-08-11 17:39:21,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) (541840) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) (541840) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) (541840) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) (541840) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,403::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Message size is 89 >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) (541841) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,404::__init__::225::IOProcess::(_processLogs) (541841) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,405::__init__::225::IOProcess::(_processLogs) (541841) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,405::__init__::225::IOProcess::(_processLogs) (541841) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,405::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,405::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,405::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541838) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) (541838) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,406::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) (541842) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) (541842) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) (541842) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) (541842) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,407::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) (541843) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541843) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Message size is 135 >Thread-19::DEBUG::2014-08-11 17:39:21,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) (541844) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) (541844) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) (541844) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) (541844) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,409::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) (541845) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,410::__init__::225::IOProcess::(_processLogs) (541845) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541845) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) (541845) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,413::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,413::__init__::225::IOProcess::(_processLogs) (541846) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,413::__init__::225::IOProcess::(_processLogs) (541846) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541846) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,414::__init__::225::IOProcess::(_processLogs) (541846) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,414::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Message size is 185 >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) (541847) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,415::__init__::225::IOProcess::(_processLogs) (541847) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541843) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,441::__init__::225::IOProcess::(_processLogs) (541843) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,442::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,442::__init__::225::IOProcess::(_processLogs) (541847) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,442::__init__::225::IOProcess::(_processLogs) (541847) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,443::__init__::225::IOProcess::(_processLogs) (541848) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,444::__init__::225::IOProcess::(_processLogs) (541848) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,444::__init__::225::IOProcess::(_processLogs) (541849) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,444::__init__::225::IOProcess::(_processLogs) (541849) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541849) Building response >Thread-10197::DEBUG::2014-08-11 17:39:21,444::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) (541849) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) (541850) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) (541850) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541850) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) (541850) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,446::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,447::__init__::225::IOProcess::(_processLogs) (541851) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) (541851) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) (541851) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) (541851) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,449::__init__::225::IOProcess::(_processLogs) (541852) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,449::__init__::225::IOProcess::(_processLogs) (541852) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541852) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,459::__init__::225::IOProcess::(_processLogs) (541852) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,460::__init__::225::IOProcess::(_processLogs) (541853) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,461::__init__::225::IOProcess::(_processLogs) (541853) Got request for method 'writefile' >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:21,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:21,468::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:21,469::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:39:21,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541848) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,470::__init__::225::IOProcess::(_processLogs) (541848) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,472::__init__::225::IOProcess::(_processLogs) (541854) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,472::__init__::225::IOProcess::(_processLogs) (541854) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541854) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,497::__init__::225::IOProcess::(_processLogs) (541854) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,497::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,497::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,498::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,499::__init__::225::IOProcess::(_processLogs) (541855) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,499::__init__::225::IOProcess::(_processLogs) (541855) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541853) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,508::__init__::225::IOProcess::(_processLogs) (541853) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,508::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,510::__init__::225::IOProcess::(_processLogs) (541856) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,510::__init__::225::IOProcess::(_processLogs) (541856) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,510::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541856) Building response >Thread-10197::WARNING::2014-08-11 17:39:21,510::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) (541856) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,512::__init__::225::IOProcess::(_processLogs) (541857) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,512::__init__::225::IOProcess::(_processLogs) (541857) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541857) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,527::__init__::225::IOProcess::(_processLogs) (541857) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-10197::WARNING::2014-08-11 17:39:21,527::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,528::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) (541858) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,529::__init__::225::IOProcess::(_processLogs) (541858) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(541855) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,532::__init__::225::IOProcess::(_processLogs) (541855) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,532::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,532::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,533::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,533::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,533::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,533::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,534::__init__::225::IOProcess::(_processLogs) (541859) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,534::__init__::225::IOProcess::(_processLogs) (541859) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,534::__init__::225::IOProcess::(_processLogs) (541859) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,534::__init__::225::IOProcess::(_processLogs) (541859) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) (541860) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,535::__init__::225::IOProcess::(_processLogs) (541860) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,542::__init__::225::IOProcess::(_processLogs) DEBUG|(541858) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,542::__init__::225::IOProcess::(_processLogs) (541858) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,542::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,542::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,542::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) (541861) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,543::__init__::225::IOProcess::(_processLogs) (541861) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,546::__init__::225::IOProcess::(_processLogs) DEBUG|(541861) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,546::__init__::225::IOProcess::(_processLogs) (541861) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,546::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,547::__init__::225::IOProcess::(_processLogs) (541862) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,548::__init__::225::IOProcess::(_processLogs) (541862) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,553::__init__::225::IOProcess::(_processLogs) DEBUG|(541860) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,553::__init__::225::IOProcess::(_processLogs) (541860) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,553::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,553::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,554::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,554::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,554::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,555::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,555::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,555::__init__::225::IOProcess::(_processLogs) (541863) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,555::__init__::225::IOProcess::(_processLogs) (541863) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,561::__init__::225::IOProcess::(_processLogs) DEBUG|(541862) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,561::__init__::225::IOProcess::(_processLogs) (541862) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,562::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,563::__init__::225::IOProcess::(_processLogs) (541864) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:21,563::__init__::225::IOProcess::(_processLogs) (541864) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:21,563::__init__::225::IOProcess::(_processLogs) DEBUG|(541864) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,563::__init__::225::IOProcess::(_processLogs) (541864) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,563::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:21,563::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task ae83c418-616b-4224-8a8e-87057b8a90c2 >Thread-19::DEBUG::2014-08-11 17:39:21,564::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::INFO::2014-08-11 17:39:21,564::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-10197::DEBUG::2014-08-11 17:39:21,564::task::1183::Storage.TaskManager.Task::(prepare) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::Prepare: 1 jobs exist, move to acquiring >Thread-10197::DEBUG::2014-08-11 17:39:21,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-08-11 17:39:21,564::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,564::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) (541865) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) (541865) Got request for method 'access' >Thread-10197::DEBUG::2014-08-11 17:39:21,565::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:21,565::__init__::225::IOProcess::(_processLogs) DEBUG|(541865) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) (541865) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,566::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,567::__init__::225::IOProcess::(_processLogs) (541866) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,567::__init__::225::IOProcess::(_processLogs) (541866) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,573::__init__::225::IOProcess::(_processLogs) DEBUG|(541863) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,574::__init__::225::IOProcess::(_processLogs) (541863) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,574::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,574::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,574::__init__::225::IOProcess::(_processLogs) DEBUG|(541866) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) (541866) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) (541867) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,575::__init__::225::IOProcess::(_processLogs) (541867) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,576::__init__::225::IOProcess::(_processLogs) (541868) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) (541868) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) (541868) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) (541868) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) DEBUG|(541867) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) (541867) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,577::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) Sending response sized 193 >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) (541869) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) (541869) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,578::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) (541870) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,579::__init__::225::IOProcess::(_processLogs) (541870) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) (541870) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) (541870) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,580::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,581::__init__::225::IOProcess::(_processLogs) (541871) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,581::__init__::225::IOProcess::(_processLogs) (541871) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) DEBUG|(541871) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) (541871) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,592::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) (541872) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) (541872) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) (541872) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) (541872) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,593::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,594::__init__::225::IOProcess::(_processLogs) (541869) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,594::__init__::225::IOProcess::(_processLogs) (541869) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,594::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,594::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) (541873) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) (541873) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,595::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) (541874) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,596::__init__::225::IOProcess::(_processLogs) (541874) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,603::__init__::225::IOProcess::(_processLogs) DEBUG|(541873) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,603::__init__::225::IOProcess::(_processLogs) (541873) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,603::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,604::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,604::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,604::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:21,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,604::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) (541875) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) (541875) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) (541875) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) (541875) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,605::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) (541876) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,606::__init__::225::IOProcess::(_processLogs) (541876) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,627::__init__::225::IOProcess::(_processLogs) DEBUG|(541876) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,627::__init__::225::IOProcess::(_processLogs) (541876) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,627::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,627::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,627::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) (541877) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,628::__init__::225::IOProcess::(_processLogs) (541877) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,637::__init__::225::IOProcess::(_processLogs) DEBUG|(541874) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,637::__init__::225::IOProcess::(_processLogs) (541874) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,637::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) (541878) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,638::__init__::225::IOProcess::(_processLogs) (541878) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,684::__init__::225::IOProcess::(_processLogs) DEBUG|(541877) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,684::__init__::225::IOProcess::(_processLogs) (541877) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,684::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) (541879) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:21,685::__init__::225::IOProcess::(_processLogs) (541879) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) DEBUG|(541879) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) (541879) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,687::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,687::__init__::225::IOProcess::(_processLogs) (541880) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,687::__init__::225::IOProcess::(_processLogs) (541880) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,687::__init__::225::IOProcess::(_processLogs) DEBUG|(541880) Building response >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:21,687::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) (541880) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) (541881) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) (541881) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) DEBUG|(541881) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) (541881) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,689::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,690::__init__::225::IOProcess::(_processLogs) (541882) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) (541882) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) (541882) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) (541882) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,692::__init__::225::IOProcess::(_processLogs) (541883) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,692::__init__::225::IOProcess::(_processLogs) (541883) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,702::__init__::225::IOProcess::(_processLogs) DEBUG|(541883) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,702::__init__::225::IOProcess::(_processLogs) (541883) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,702::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,702::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) (541884) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,703::__init__::225::IOProcess::(_processLogs) (541884) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,711::__init__::225::IOProcess::(_processLogs) DEBUG|(541878) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,711::__init__::225::IOProcess::(_processLogs) (541878) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,711::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,712::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,712::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,712::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,712::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10197::WARNING::2014-08-11 17:39:21,712::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,713::__init__::225::IOProcess::(_processLogs) (541885) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) (541885) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) (541885) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) (541885) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,714::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,715::__init__::225::IOProcess::(_processLogs) (541886) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,715::__init__::225::IOProcess::(_processLogs) (541886) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,735::__init__::225::IOProcess::(_processLogs) DEBUG|(541884) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,735::__init__::225::IOProcess::(_processLogs) (541884) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,735::__init__::225::IOProcess::(_processLogs) DEBUG|(541886) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,736::__init__::225::IOProcess::(_processLogs) (541886) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,736::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,736::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:39:21,736::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,737::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,737::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:21,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) (541887) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) (541887) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,738::__init__::225::IOProcess::(_processLogs) (541888) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,739::__init__::225::IOProcess::(_processLogs) (541888) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) DEBUG|(541888) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) (541888) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,762::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,763::__init__::225::IOProcess::(_processLogs) (541889) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,763::__init__::225::IOProcess::(_processLogs) (541889) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) DEBUG|(541889) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) (541889) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) Sending response sized 99 >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,765::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) (541890) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) (541890) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) (541890) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,766::__init__::225::IOProcess::(_processLogs) (541890) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,768::__init__::225::IOProcess::(_processLogs) (541891) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,768::__init__::225::IOProcess::(_processLogs) (541891) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,772::__init__::225::IOProcess::(_processLogs) DEBUG|(541887) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,772::__init__::225::IOProcess::(_processLogs) (541887) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,773::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,773::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,773::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,773::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:21,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,774::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,774::__init__::225::IOProcess::(_processLogs) (541892) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,774::__init__::225::IOProcess::(_processLogs) (541892) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,780::__init__::225::IOProcess::(_processLogs) DEBUG|(541891) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,780::__init__::225::IOProcess::(_processLogs) (541891) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,780::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,781::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,782::__init__::225::IOProcess::(_processLogs) (541893) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,782::__init__::225::IOProcess::(_processLogs) (541893) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,803::__init__::225::IOProcess::(_processLogs) DEBUG|(541893) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,803::__init__::225::IOProcess::(_processLogs) (541893) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,803::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,803::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) (541894) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:21,804::__init__::225::IOProcess::(_processLogs) (541894) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:21,805::__init__::225::IOProcess::(_processLogs) DEBUG|(541894) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,805::__init__::225::IOProcess::(_processLogs) (541894) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,805::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:39:21,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,807::__init__::225::IOProcess::(_processLogs) (541895) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,807::__init__::225::IOProcess::(_processLogs) (541895) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,807::__init__::225::IOProcess::(_processLogs) DEBUG|(541895) Building response >Thread-10197::DEBUG::2014-08-11 17:39:21,807::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:21,807::__init__::225::IOProcess::(_processLogs) (541895) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) (541896) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,808::__init__::225::IOProcess::(_processLogs) (541896) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) DEBUG|(541896) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) (541896) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:21,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) (541897) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) (541897) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) (541897) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) (541897) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,810::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) (541898) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,811::__init__::225::IOProcess::(_processLogs) (541898) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:21,812::__init__::225::IOProcess::(_processLogs) DEBUG|(541892) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,812::__init__::225::IOProcess::(_processLogs) (541892) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,813::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,813::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,813::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,813::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:39:21,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,813::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,814::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,814::__init__::225::IOProcess::(_processLogs) (541899) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,814::__init__::225::IOProcess::(_processLogs) (541899) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,840::__init__::225::IOProcess::(_processLogs) DEBUG|(541898) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,840::__init__::225::IOProcess::(_processLogs) (541898) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,840::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) (541900) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,841::__init__::225::IOProcess::(_processLogs) (541900) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,871::__init__::225::IOProcess::(_processLogs) DEBUG|(541899) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,871::__init__::225::IOProcess::(_processLogs) (541899) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,871::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,872::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,872::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,872::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:39:21,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,872::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,872::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,873::__init__::225::IOProcess::(_processLogs) (541901) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,873::__init__::225::IOProcess::(_processLogs) (541901) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,877::__init__::225::IOProcess::(_processLogs) DEBUG|(541900) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,877::__init__::225::IOProcess::(_processLogs) (541900) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,877::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,877::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,877::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) (541902) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:21,878::__init__::225::IOProcess::(_processLogs) (541902) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:21,899::__init__::225::IOProcess::(_processLogs) DEBUG|(541901) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,899::__init__::225::IOProcess::(_processLogs) (541901) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,899::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,899::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,899::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,899::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,900::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,900::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) (541903) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) (541903) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) (541903) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) (541903) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,901::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) (541904) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,902::__init__::225::IOProcess::(_processLogs) (541904) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,907::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541902) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,907::__init__::225::IOProcess::(_processLogs) (541902) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,907::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,908::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-10197::WARNING::2014-08-11 17:39:21,908::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,909::__init__::225::IOProcess::(_processLogs) (541905) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,909::__init__::225::IOProcess::(_processLogs) (541905) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) (541905) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) (541905) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,911::__init__::225::IOProcess::(_processLogs) (541906) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,911::__init__::225::IOProcess::(_processLogs) (541906) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,915::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541904) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,915::__init__::225::IOProcess::(_processLogs) (541904) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,915::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541904) Building responseDEBUG|Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:21,915::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,915::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,916::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541904) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,916::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,916::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,917::__init__::225::IOProcess::(_processLogs) (541907) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,917::__init__::225::IOProcess::(_processLogs) (541907) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,924::__init__::225::IOProcess::(_processLogs) DEBUG|(541906) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,925::__init__::225::IOProcess::(_processLogs) (541906) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,925::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::WARNING::2014-08-11 17:39:21,925::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:21,925::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,926::__init__::225::IOProcess::(_processLogs) (541908) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:21,927::__init__::225::IOProcess::(_processLogs) (541908) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:21,935::__init__::225::IOProcess::(_processLogs) DEBUG|(541907) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) (541907) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,936::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,937::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,937::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,937::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,937::__init__::225::IOProcess::(_processLogs) (541909) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,937::__init__::225::IOProcess::(_processLogs) (541909) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,941::__init__::225::IOProcess::(_processLogs) DEBUG|(541909) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,941::__init__::225::IOProcess::(_processLogs) (541909) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,941::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,942::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) (541910) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) (541910) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) (541910) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) (541910) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,943::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,944::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,944::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,944::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,944::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,944::__init__::225::IOProcess::(_processLogs) (541911) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,944::__init__::225::IOProcess::(_processLogs) (541911) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,949::__init__::225::IOProcess::(_processLogs) DEBUG|(541908) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,949::__init__::225::IOProcess::(_processLogs) (541908) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,949::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,949::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,949::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) (541912) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,950::__init__::225::IOProcess::(_processLogs) (541912) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:21,952::__init__::225::IOProcess::(_processLogs) DEBUG|(541912) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,952::__init__::225::IOProcess::(_processLogs) (541912) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,952::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,952::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,953::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) (541913) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) (541913) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) (541913) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) (541913) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,954::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,955::__init__::225::IOProcess::(_processLogs) (541914) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,955::__init__::225::IOProcess::(_processLogs) (541914) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,956::__init__::225::IOProcess::(_processLogs) DEBUG|(541911) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) (541911) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,957::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) (541915) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) (541915) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) (541915) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) (541915) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,958::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) (541916) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,959::__init__::225::IOProcess::(_processLogs) (541916) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,966::__init__::225::IOProcess::(_processLogs) DEBUG|(541914) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,966::__init__::225::IOProcess::(_processLogs) (541914) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,967::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,967::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,967::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,967::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:21,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) (541917) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) (541917) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) (541917) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) (541917) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,968::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) (541918) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,969::__init__::225::IOProcess::(_processLogs) (541918) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,976::__init__::225::IOProcess::(_processLogs) DEBUG|(541916) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,976::__init__::225::IOProcess::(_processLogs) (541916) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,976::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,977::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,977::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,977::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:21,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,977::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) (541919) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) (541919) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) (541919) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) (541919) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:21,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,979::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,979::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,979::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,979::__init__::225::IOProcess::(_processLogs) (541920) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,979::__init__::225::IOProcess::(_processLogs) (541920) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:21,986::__init__::225::IOProcess::(_processLogs) DEBUG|(541918) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) (541918) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,987::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,988::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,988::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,988::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,988::__init__::225::IOProcess::(_processLogs) (541921) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:21,988::__init__::225::IOProcess::(_processLogs) (541921) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:21,993::__init__::225::IOProcess::(_processLogs) DEBUG|(541920) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) (541920) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) (541922) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) (541922) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) (541922) Building response >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) (541922) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:21,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) (541923) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:21,996::__init__::225::IOProcess::(_processLogs) (541923) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,000::__init__::225::IOProcess::(_processLogs) DEBUG|(541921) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,000::__init__::225::IOProcess::(_processLogs) (541921) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,000::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,000::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,000::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,000::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:22,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,001::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10197::DEBUG::2014-08-11 17:39:22,001::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: ae83c418-616b-4224-8a8e-87057b8a90c2 >Thread-19::DEBUG::2014-08-11 17:39:22,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::DEBUG::2014-08-11 17:39:22,001::taskManager::64::Storage.TaskManager::(_queueTask) task queued: ae83c418-616b-4224-8a8e-87057b8a90c2 >c55c14c4-091e-4219-9d11-75156cdb023b::DEBUG::2014-08-11 17:39:22,002::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-19::DEBUG::2014-08-11 17:39:22,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10197::DEBUG::2014-08-11 17:39:22,002::task::1188::Storage.TaskManager.Task::(prepare) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::returning >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,002::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: ae83c418-616b-4224-8a8e-87057b8a90c2 running: <bound method Task.commit of <storage.task.Task instance at 0x7f2c7d15dbd8>> with: None >Thread-19::DEBUG::2014-08-11 17:39:22,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10197::DEBUG::2014-08-11 17:39:22,003::task::993::Storage.TaskManager.Task::(_decref) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::ref 0 aborting False >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,003::task::1200::Storage.TaskManager.Task::(commit) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::committing task: ae83c418-616b-4224-8a8e-87057b8a90c2 >Thread-19::DEBUG::2014-08-11 17:39:22,004::__init__::225::IOProcess::(_processLogs) (541924) Finding callback 'lexists'... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::moving from state queued -> state running >Thread-19::DEBUG::2014-08-11 17:39:22,005::__init__::225::IOProcess::(_processLogs) (541924) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:22,005::__init__::225::IOProcess::(_processLogs) (541924) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,005::__init__::225::IOProcess::(_processLogs) (541924) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,005::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,006::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,006::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:22,006::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,006::__init__::225::IOProcess::(_processLogs) Queuing request... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,006::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:22,006::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) (541925) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) (541925) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) (541925) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) (541925) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,007::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) (541923) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) (541926) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,008::__init__::225::IOProcess::(_processLogs) (541926) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) (541926) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) (541927) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,010::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) (541928) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) (541928) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) (541928) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) (541928) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,011::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,012::__init__::225::IOProcess::(_processLogs) (541929) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,012::__init__::225::IOProcess::(_processLogs) (541929) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:22,020::__init__::225::IOProcess::(_processLogs) (541927) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,020::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,020::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) (541930) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) (541930) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:22,021::__init__::225::IOProcess::(_processLogs) (541930) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) Message size is 281 >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) (541931) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:39:22,022::__init__::225::IOProcess::(_processLogs) (541931) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:39:22,057::__init__::225::IOProcess::(_processLogs) (541929) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,057::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) (541932) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,058::__init__::225::IOProcess::(_processLogs) (541932) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,090::__init__::225::IOProcess::(_processLogs) (541931) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,090::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,091::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,091::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:39:22,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,091::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,091::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,092::__init__::225::IOProcess::(_processLogs) (541933) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:39:22,092::__init__::225::IOProcess::(_processLogs) (541933) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:39:22,108::__init__::225::IOProcess::(_processLogs) (541933) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,108::__init__::225::IOProcess::(_processLogs) Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::INFO::2014-08-11 17:39:22,108::fileVolume::133::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/4c2b3c72-a901-435d-9a9f-8628b2263c7e/bdca8406-da33-4323-9fa9-53d245f0a0ed with size = 2637824 sectors >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) (541934) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:39:22,109::__init__::225::IOProcess::(_processLogs) (541934) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:39:22,117::__init__::225::IOProcess::(_processLogs) (541932) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,118::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,118::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:22,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,119::__init__::225::IOProcess::(_processLogs) (541935) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,119::__init__::225::IOProcess::(_processLogs) (541935) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,124::__init__::225::IOProcess::(_processLogs) (541934) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,125::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,125::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:39:22,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,125::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,125::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) (541936) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) (541936) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) (541936) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) (541936) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:22,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) (541937) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) (541937) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) (541937) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,127::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:22,128::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:22,128::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,129::__init__::225::IOProcess::(_processLogs) (541938) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,129::__init__::225::IOProcess::(_processLogs) (541938) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,129::__init__::225::IOProcess::(_processLogs) (541938) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,130::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,130::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) (541939) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) (541939) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) (541939) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) (541939) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,132::__init__::225::IOProcess::(_processLogs) (541940) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,132::__init__::225::IOProcess::(_processLogs) (541940) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:22,149::__init__::225::IOProcess::(_processLogs) (541940) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,149::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) (541941) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,150::__init__::225::IOProcess::(_processLogs) (541941) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,162::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541935) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) (541935) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,163::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:22,164::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) (541942) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) (541942) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) (541942) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) (541942) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,165::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) (541943) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,166::__init__::225::IOProcess::(_processLogs) (541943) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) DEBUG|(541943) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) (541943) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) (541941) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) (541941) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,192::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:22,192::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,193::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) (541944) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,194::__init__::225::IOProcess::(_processLogs) (541944) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) (541945) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,195::__init__::225::IOProcess::(_processLogs) (541945) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,208::__init__::225::IOProcess::(_processLogs) DEBUG|(541944) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,208::__init__::225::IOProcess::(_processLogs) (541944) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,208::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) (541946) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,209::__init__::225::IOProcess::(_processLogs) (541946) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,210::__init__::225::IOProcess::(_processLogs) DEBUG|(541946) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,210::__init__::225::IOProcess::(_processLogs) (541946) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,210::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,210::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:39:22,210::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,211::__init__::225::IOProcess::(_processLogs) (541947) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) (541947) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) (541947) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) (541947) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,213::__init__::225::IOProcess::(_processLogs) (541948) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,213::__init__::225::IOProcess::(_processLogs) (541948) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,225::__init__::225::IOProcess::(_processLogs) DEBUG|(541948) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,225::__init__::225::IOProcess::(_processLogs) (541948) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,225::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) (541949) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) (541949) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) (541949) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) (541949) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,227::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,228::__init__::225::IOProcess::(_processLogs) (541950) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,228::__init__::225::IOProcess::(_processLogs) (541950) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,233::__init__::225::IOProcess::(_processLogs) DEBUG|(541945) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,233::__init__::225::IOProcess::(_processLogs) (541945) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,233::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,235::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,235::__init__::225::IOProcess::(_processLogs) (541951) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,235::__init__::225::IOProcess::(_processLogs) (541951) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,241::__init__::225::IOProcess::(_processLogs) DEBUG|(541950) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,241::__init__::225::IOProcess::(_processLogs) (541950) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,241::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,242::__init__::225::IOProcess::(_processLogs) (541952) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,243::__init__::225::IOProcess::(_processLogs) (541952) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:22,263::__init__::225::IOProcess::(_processLogs) DEBUG|(541952) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,263::__init__::225::IOProcess::(_processLogs) (541952) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,265::__init__::225::IOProcess::(_processLogs) (541953) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:22,265::__init__::225::IOProcess::(_processLogs) (541953) Got request for method 'lexists' >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,265::task::905::Storage.TaskManager.Task::(_runJobs) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', 'cdc5a7e1-4d16-404d-90a4-c0ed6584c11b', 20, 4, 2, 2, '269bcc1a-8426-49ae-a837-e9653759fcc8', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >Thread-19::DEBUG::2014-08-11 17:39:22,265::__init__::225::IOProcess::(_processLogs) DEBUG|(541953) Building response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,265::task::331::Storage.TaskManager.Task::(run) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', 'cdc5a7e1-4d16-404d-90a4-c0ed6584c11b', 20, 4, 2, 2, '269bcc1a-8426-49ae-a837-e9653759fcc8', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >Thread-19::DEBUG::2014-08-11 17:39:22,266::__init__::225::IOProcess::(_processLogs) (541953) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,266::__init__::225::IOProcess::(_processLogs) Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,266::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b`ReqID=`681ddc86-e98e-4846-b921-aa34863ec97c`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1792' at 'createVolume' >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,267::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b' for lock type 'exclusive' >Thread-19::DEBUG::2014-08-11 17:39:22,267::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,269::__init__::225::IOProcess::(_processLogs) (541954) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:39:22,269::__init__::225::IOProcess::(_processLogs) (541954) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:39:22,269::__init__::225::IOProcess::(_processLogs) DEBUG|(541954) Building response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,269::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image cdc5a7e1-4d16-404d-90a4-c0ed6584c11b does not exist in domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,269::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b' is free. Now locking as 'exclusive' (1 active user) >Thread-19::DEBUG::2014-08-11 17:39:22,269::__init__::225::IOProcess::(_processLogs) (541954) Queuing response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,270::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b`ReqID=`681ddc86-e98e-4846-b921-aa34863ec97c`::Granted request >Thread-19::DEBUG::2014-08-11 17:39:22,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,271::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >ae83c418-616b-4224-8a8e-87057b8a90c2::INFO::2014-08-11 17:39:22,271::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/cdc5a7e1-4d16-404d-90a4-c0ed6584c11b for image's volumes >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) (541955) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,272::__init__::225::IOProcess::(_processLogs) (541955) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,273::__init__::225::IOProcess::(_processLogs) DEBUG|(541951) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,273::__init__::225::IOProcess::(_processLogs) (541951) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,273::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,273::__init__::225::IOProcess::(_processLogs) DEBUG|(541955) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,274::__init__::225::IOProcess::(_processLogs) (541955) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,274::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,274::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:22,274::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) (541956) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) (541956) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,275::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) (541957) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) (541957) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) DEBUG|(541957) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,276::__init__::225::IOProcess::(_processLogs) (541957) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,277::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,277::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,277::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,277::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,277::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) (541958) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) (541958) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) (541958) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) (541958) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,278::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) (541959) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,279::__init__::225::IOProcess::(_processLogs) (541959) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:22,294::__init__::225::IOProcess::(_processLogs) DEBUG|(541959) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,294::__init__::225::IOProcess::(_processLogs) (541959) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,295::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,296::__init__::225::IOProcess::(_processLogs) (541960) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,296::__init__::225::IOProcess::(_processLogs) (541960) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,302::__init__::225::IOProcess::(_processLogs) DEBUG|(541956) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,302::__init__::225::IOProcess::(_processLogs) (541956) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,303::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,303::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,303::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:39:22,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,304::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,304::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,304::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,304::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,304::__init__::225::IOProcess::(_processLogs) (541961) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,304::__init__::225::IOProcess::(_processLogs) (541961) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,327::__init__::225::IOProcess::(_processLogs) DEBUG|(541960) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,327::__init__::225::IOProcess::(_processLogs) (541960) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,327::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,327::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,327::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) (541962) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,328::__init__::225::IOProcess::(_processLogs) (541962) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,336::__init__::225::IOProcess::(_processLogs) DEBUG|(541961) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,336::__init__::225::IOProcess::(_processLogs) (541961) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,336::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,337::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,337::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,337::__init__::225::IOProcess::(_processLogs) Message size is 665 >Thread-19::DEBUG::2014-08-11 17:39:22,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,337::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,338::__init__::225::IOProcess::(_processLogs) (541963) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,338::__init__::225::IOProcess::(_processLogs) (541963) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,360::__init__::225::IOProcess::(_processLogs) DEBUG|(541962) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,360::__init__::225::IOProcess::(_processLogs) (541962) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,360::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,362::__init__::225::IOProcess::(_processLogs) (541964) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,362::__init__::225::IOProcess::(_processLogs) (541964) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,368::__init__::225::IOProcess::(_processLogs) DEBUG|(541963) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,368::__init__::225::IOProcess::(_processLogs) (541963) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,368::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,369::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,369::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,369::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,369::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,369::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:22,369::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,370::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,370::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,370::__init__::225::IOProcess::(_processLogs) (541965) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,370::__init__::225::IOProcess::(_processLogs) (541965) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,370::__init__::225::IOProcess::(_processLogs) (541965) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) (541965) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,371::__init__::225::IOProcess::(_processLogs) (541966) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,372::__init__::225::IOProcess::(_processLogs) (541966) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,386::__init__::225::IOProcess::(_processLogs) DEBUG|(541966) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,386::__init__::225::IOProcess::(_processLogs) (541966) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,386::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:22,386::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,387::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,387::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:22,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,387::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,388::__init__::225::IOProcess::(_processLogs) (541967) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,388::__init__::225::IOProcess::(_processLogs) (541967) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,401::__init__::225::IOProcess::(_processLogs) DEBUG|(541964) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,401::__init__::225::IOProcess::(_processLogs) (541964) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,401::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,401::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,402::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,402::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,402::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:22,402::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) (541968) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) (541968) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) (541968) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,403::__init__::225::IOProcess::(_processLogs) (541968) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) (541969) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,404::__init__::225::IOProcess::(_processLogs) (541969) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,412::__init__::225::IOProcess::(_processLogs) DEBUG|(541967) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,412::__init__::225::IOProcess::(_processLogs) (541967) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,412::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,412::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) (541970) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,413::__init__::225::IOProcess::(_processLogs) (541970) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,419::__init__::225::IOProcess::(_processLogs) DEBUG|(541970) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,419::__init__::225::IOProcess::(_processLogs) (541970) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,420::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,420::__init__::225::IOProcess::(_processLogs) Sending response sized 291 >Thread-19::DEBUG::2014-08-11 17:39:22,420::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,420::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,420::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) (541971) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) (541971) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) (541971) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) (541971) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,421::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) (541972) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,422::__init__::225::IOProcess::(_processLogs) (541972) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,424::__init__::225::IOProcess::(_processLogs) DEBUG|(541969) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,424::__init__::225::IOProcess::(_processLogs) (541969) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,424::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:22,424::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,425::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,425::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,425::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:22,425::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,425::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,426::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,426::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,426::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,426::__init__::225::IOProcess::(_processLogs) (541973) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,426::__init__::225::IOProcess::(_processLogs) (541973) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,432::__init__::225::IOProcess::(_processLogs) DEBUG|(541972) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,432::__init__::225::IOProcess::(_processLogs) (541972) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,432::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,432::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) (541974) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) (541974) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) (541974) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) (541974) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,435::__init__::225::IOProcess::(_processLogs) (541975) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,435::__init__::225::IOProcess::(_processLogs) (541975) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,441::__init__::225::IOProcess::(_processLogs) DEBUG|(541973) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,441::__init__::225::IOProcess::(_processLogs) (541973) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,441::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,441::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,441::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) (541976) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,442::__init__::225::IOProcess::(_processLogs) (541976) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,443::__init__::225::IOProcess::(_processLogs) DEBUG|(541976) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,443::__init__::225::IOProcess::(_processLogs) (541976) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,443::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,443::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:39:22,443::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) (541977) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,444::__init__::225::IOProcess::(_processLogs) (541977) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) (541977) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) (541977) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,445::__init__::225::IOProcess::(_processLogs) (541978) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,446::__init__::225::IOProcess::(_processLogs) (541978) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,448::__init__::225::IOProcess::(_processLogs) DEBUG|(541975) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,448::__init__::225::IOProcess::(_processLogs) (541975) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,448::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,448::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,448::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) (541979) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,449::__init__::225::IOProcess::(_processLogs) (541979) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) (541979) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) (541979) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,450::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,451::__init__::225::IOProcess::(_processLogs) (541980) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,451::__init__::225::IOProcess::(_processLogs) (541980) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,457::__init__::225::IOProcess::(_processLogs) DEBUG|(541978) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,457::__init__::225::IOProcess::(_processLogs) (541978) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) (541981) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) (541981) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) (541981) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) (541981) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,459::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) (541982) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,460::__init__::225::IOProcess::(_processLogs) (541982) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,466::__init__::225::IOProcess::(_processLogs) DEBUG|(541980) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,466::__init__::225::IOProcess::(_processLogs) (541980) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,466::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,466::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,466::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,466::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) (541983) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) (541983) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,467::__init__::225::IOProcess::(_processLogs) (541983) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) (541983) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) (541984) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,468::__init__::225::IOProcess::(_processLogs) (541984) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) DEBUG|(541982) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) (541982) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:22,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,478::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,478::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,478::__init__::225::IOProcess::(_processLogs) (541985) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,478::__init__::225::IOProcess::(_processLogs) (541985) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:22,485::__init__::225::IOProcess::(_processLogs) DEBUG|(541984) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,485::__init__::225::IOProcess::(_processLogs) (541984) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,485::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,485::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,485::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,485::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) (541986) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) (541986) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) (541986) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,486::__init__::225::IOProcess::(_processLogs) (541986) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) (541987) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,487::__init__::225::IOProcess::(_processLogs) (541987) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,493::__init__::225::IOProcess::(_processLogs) DEBUG|(541985) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,493::__init__::225::IOProcess::(_processLogs) (541985) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) (541988) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) (541988) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541988) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) (541988) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,495::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,502::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541987) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,502::__init__::225::IOProcess::(_processLogs) (541987) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,502::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) (541989) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,503::__init__::225::IOProcess::(_processLogs) (541989) Got request for method 'rmdir' >ae83c418-616b-4224-8a8e-87057b8a90c2::INFO::2014-08-11 17:39:22,510::volume::415::Storage.Volume::(create) Creating volume 269bcc1a-8426-49ae-a837-e9653759fcc8 >Thread-19::DEBUG::2014-08-11 17:39:22,510::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,510::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) (541990) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) (541990) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,511::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541990) Building response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,511::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) (541990) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,512::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,513::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,513::__init__::225::IOProcess::(_processLogs) (541991) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,513::__init__::225::IOProcess::(_processLogs) (541991) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,518::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541989) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,518::__init__::225::IOProcess::(_processLogs) (541989) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,519::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,519::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,519::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,519::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:22,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) (541992) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) (541992) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) (541991) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) (541991) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,520::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541992) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) (541992) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,521::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) (541993) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) (541993) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,522::__init__::225::IOProcess::(_processLogs) (541993) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) (541993) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,523::__init__::225::IOProcess::(_processLogs) (541994) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,524::__init__::225::IOProcess::(_processLogs) (541994) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:22,542::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541994) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,542::__init__::225::IOProcess::(_processLogs) (541994) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,542::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,543::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,543::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,543::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:22,543::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,543::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,544::__init__::225::IOProcess::(_processLogs) (541995) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,544::__init__::225::IOProcess::(_processLogs) (541995) Got request for method 'writefile' >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:22,552::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,552::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,552::__init__::225::IOProcess::(_processLogs) Message size is 436 >Thread-19::DEBUG::2014-08-11 17:39:22,552::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,552::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,552::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,553::__init__::225::IOProcess::(_processLogs) (541996) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,553::__init__::225::IOProcess::(_processLogs) (541996) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,577::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541996) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,577::__init__::225::IOProcess::(_processLogs) (541996) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,577::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:22,577::fileVolume::384::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=bdca8406-da33-4323-9fa9-53d245f0a0ed sdUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f, metaId=(u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/4c2b3c72-a901-435d-9a9f-8628b2263c7e/bdca8406-da33-4323-9fa9-53d245f0a0ed',) >Thread-19::DEBUG::2014-08-11 17:39:22,578::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,578::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,578::__init__::225::IOProcess::(_processLogs) Message size is 280 >Thread-19::DEBUG::2014-08-11 17:39:22,578::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,578::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,578::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,579::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,579::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,579::__init__::225::IOProcess::(_processLogs) (541997) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:39:22,579::__init__::225::IOProcess::(_processLogs) (541997) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:39:22,586::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541995) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,586::__init__::225::IOProcess::(_processLogs) (541995) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,586::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,587::__init__::225::IOProcess::(_processLogs) (541998) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,588::__init__::225::IOProcess::(_processLogs) (541998) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,628::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541997) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,628::__init__::225::IOProcess::(_processLogs) (541997) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,629::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,629::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,629::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,629::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:39:22,629::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,629::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) (541999) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) (541999) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) (541999) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) (541999) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,630::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Message size is 250 >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) (542000) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:39:22,631::__init__::225::IOProcess::(_processLogs) (542000) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:39:22,669::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542000) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,669::__init__::225::IOProcess::(_processLogs) (542000) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,669::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,669::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,678::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(541998) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,678::__init__::225::IOProcess::(_processLogs) (541998) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,678::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,678::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) (542001) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,679::__init__::225::IOProcess::(_processLogs) (542001) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,719::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,719::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) (542002) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) (542002) Got request for method 'access' >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:22,720::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:22,720::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542002) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) (542002) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,721::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) (542003) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) (542003) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) (542003) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) (542003) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,722::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,723::__init__::225::IOProcess::(_processLogs) (542004) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) (542004) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) (542004) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) (542004) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,724::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,725::__init__::225::IOProcess::(_processLogs) (542005) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,725::__init__::225::IOProcess::(_processLogs) (542005) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:22,726::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542001) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,726::__init__::225::IOProcess::(_processLogs) (542001) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,727::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,727::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,727::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,727::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:39:22,727::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,727::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,728::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,728::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,728::__init__::225::IOProcess::(_processLogs) (542006) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,728::__init__::225::IOProcess::(_processLogs) (542006) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542005) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,744::__init__::225::IOProcess::(_processLogs) (542005) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,745::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,745::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,745::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:22,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,746::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,746::__init__::225::IOProcess::(_processLogs) (542007) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,746::__init__::225::IOProcess::(_processLogs) (542007) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,752::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542006) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,752::__init__::225::IOProcess::(_processLogs) (542006) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,752::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,752::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,753::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:22,753::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,754::__init__::225::IOProcess::(_processLogs) (542008) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,754::__init__::225::IOProcess::(_processLogs) (542008) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,754::__init__::225::IOProcess::(_processLogs) (542008) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,754::__init__::225::IOProcess::(_processLogs) (542008) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,754::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,754::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) (542009) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,755::__init__::225::IOProcess::(_processLogs) (542009) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,769::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542009) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,769::__init__::225::IOProcess::(_processLogs) (542009) Queuing response >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:22,769::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) (542009) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) (542009) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,770::__init__::225::IOProcess::(_processLogs) (542010) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,771::__init__::225::IOProcess::(_processLogs) (542010) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,780::__init__::225::IOProcess::(_processLogs) (542009) Queuing responseDEBUG|(542007) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,780::__init__::225::IOProcess::(_processLogs) (542007) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) (542009) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) (542009) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,781::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,782::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,782::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,782::__init__::225::IOProcess::(_processLogs) (542011) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,782::__init__::225::IOProcess::(_processLogs) (542011) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,796::__init__::225::IOProcess::(_processLogs) (542010) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,796::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,796::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,797::__init__::225::IOProcess::(_processLogs) (542012) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,797::__init__::225::IOProcess::(_processLogs) (542012) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,805::__init__::225::IOProcess::(_processLogs) (542012) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,805::__init__::225::IOProcess::(_processLogs) Sending response sized 193 >Thread-19::DEBUG::2014-08-11 17:39:22,805::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:22,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) (542013) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) (542013) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) (542013) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) (542013) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,806::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:22,807::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,807::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,807::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,807::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,807::__init__::225::IOProcess::(_processLogs) (542014) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,807::__init__::225::IOProcess::(_processLogs) (542014) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,833::__init__::225::IOProcess::(_processLogs) (542014) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,833::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,833::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:22,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) (542015) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) (542015) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) (542015) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) (542015) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,834::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) (542016) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,835::__init__::225::IOProcess::(_processLogs) (542016) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,840::__init__::225::IOProcess::(_processLogs) (542011) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,840::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,841::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:22,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,841::__init__::225::IOProcess::(_processLogs) (542017) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,842::__init__::225::IOProcess::(_processLogs) (542017) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,843::__init__::225::IOProcess::(_processLogs) (542016) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,843::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,843::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) (542018) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) (542018) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) (542018) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,844::__init__::225::IOProcess::(_processLogs) (542018) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) (542019) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,845::__init__::225::IOProcess::(_processLogs) (542019) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,860::__init__::225::IOProcess::(_processLogs) (542019) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,860::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) (542020) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,861::__init__::225::IOProcess::(_processLogs) (542020) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:22,868::__init__::225::IOProcess::(_processLogs) (542017) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,868::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,868::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:39:22,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,869::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,869::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,869::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,869::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,869::__init__::225::IOProcess::(_processLogs) (542021) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,869::__init__::225::IOProcess::(_processLogs) (542021) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542020) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) (542020) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:22,877::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) (542022) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) (542022) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542022) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,878::__init__::225::IOProcess::(_processLogs) (542022) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) (542023) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,879::__init__::225::IOProcess::(_processLogs) (542023) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,880::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542023) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,880::__init__::225::IOProcess::(_processLogs) (542023) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,880::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:22,880::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:22,880::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) (542024) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,881::__init__::225::IOProcess::(_processLogs) (542024) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542024) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) (542024) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:22,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) (542025) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) (542025) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) (542025) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) (542025) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,883::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) (542026) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,884::__init__::225::IOProcess::(_processLogs) (542026) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542021) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) (542021) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,908::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:22,908::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) (542027) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) (542027) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) (542027) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) (542027) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:22,909::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542026) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,910::__init__::225::IOProcess::(_processLogs) (542026) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,910::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,910::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,910::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,910::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:22,910::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) (542028) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) (542028) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,911::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,912::__init__::225::IOProcess::(_processLogs) (542029) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,912::__init__::225::IOProcess::(_processLogs) (542029) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,913::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542028) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,913::__init__::225::IOProcess::(_processLogs) (542028) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,914::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:22,914::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:22,914::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) (542030) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:22,915::__init__::225::IOProcess::(_processLogs) (542030) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:22,927::__init__::225::IOProcess::(_processLogs) DEBUG|(542030) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,927::__init__::225::IOProcess::(_processLogs) (542030) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,927::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,927::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) (542031) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:22,928::__init__::225::IOProcess::(_processLogs) (542031) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:22,929::__init__::225::IOProcess::(_processLogs) (542031) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,929::__init__::225::IOProcess::(_processLogs) Sending response sized 340 >Thread-19::DEBUG::2014-08-11 17:39:22,929::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:22,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,929::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) (542032) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) (542032) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) (542032) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) (542032) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,930::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,931::__init__::225::IOProcess::(_processLogs) (542029) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,931::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,931::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:22,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,931::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) (542033) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) (542033) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) (542034) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,932::__init__::225::IOProcess::(_processLogs) (542034) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,938::__init__::225::IOProcess::(_processLogs) (542033) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,939::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,939::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,939::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,939::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,939::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,939::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) (542035) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) (542035) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) (542035) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) (542035) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,940::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,941::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,941::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,941::__init__::225::IOProcess::(_processLogs) (542036) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,941::__init__::225::IOProcess::(_processLogs) (542036) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,954::__init__::225::IOProcess::(_processLogs) (542036) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,954::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,955::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,955::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) (542037) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) (542037) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) (542037) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) (542037) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,957::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,957::__init__::225::IOProcess::(_processLogs) (542038) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,957::__init__::225::IOProcess::(_processLogs) (542038) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,959::__init__::225::IOProcess::(_processLogs) (542034) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,959::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) (542039) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,960::__init__::225::IOProcess::(_processLogs) (542039) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,963::__init__::225::IOProcess::(_processLogs) (542038) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,963::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,964::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) (542040) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) (542040) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) (542040) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) (542040) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,966::__init__::225::IOProcess::(_processLogs) (542041) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,966::__init__::225::IOProcess::(_processLogs) (542041) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,980::__init__::225::IOProcess::(_processLogs) (542041) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,980::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,980::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) (542042) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) (542042) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) (542042) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) (542042) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,981::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) (542043) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,982::__init__::225::IOProcess::(_processLogs) (542043) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:22,983::__init__::225::IOProcess::(_processLogs) (542039) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,983::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) (542044) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:22,984::__init__::225::IOProcess::(_processLogs) (542044) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:22,989::__init__::225::IOProcess::(_processLogs) (542043) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,989::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:22,989::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:22,989::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,989::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) (542045) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) (542045) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) (542045) Building response >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) (542045) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:22,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:22,991::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:22,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:22,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:22,991::__init__::225::IOProcess::(_processLogs) (542046) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:22,991::__init__::225::IOProcess::(_processLogs) (542046) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,004::__init__::225::IOProcess::(_processLogs) (542046) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) (542047) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,005::__init__::225::IOProcess::(_processLogs) (542047) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:23,013::__init__::225::IOProcess::(_processLogs) (542044) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,013::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,013::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:39:23,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,014::__init__::225::IOProcess::(_processLogs) (542048) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,014::__init__::225::IOProcess::(_processLogs) (542048) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,022::__init__::225::IOProcess::(_processLogs) (542047) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,022::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) (542049) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:23,023::__init__::225::IOProcess::(_processLogs) (542049) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:23,024::__init__::225::IOProcess::(_processLogs) (542049) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,024::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,024::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e' >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,024::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e' (0 active users) >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,024::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e' is free, finding out if anyone is waiting for it. >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,025::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.4c2b3c72-a901-435d-9a9f-8628b2263c7e', Clearing records. >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::moving from state running -> state finished >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) (542050) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:23,025::__init__::225::IOProcess::(_processLogs) (542050) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:23,026::__init__::225::IOProcess::(_processLogs) (542050) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,026::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,026::task::752::Storage.TaskManager.Task::(_save) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/fd387023-cd7f-4ba1-9d20-6d42f853109f.temp >Thread-19::DEBUG::2014-08-11 17:39:23,026::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) (542051) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) (542051) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) (542051) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,027::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,028::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) (542052) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) (542052) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) (542052) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) (542052) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,030::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,030::__init__::225::IOProcess::(_processLogs) (542053) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,030::__init__::225::IOProcess::(_processLogs) (542053) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:23,047::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|(542048) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,047::__init__::225::IOProcess::(_processLogs) (542048) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,047::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,048::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,048::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,048::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:23,048::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,048::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,048::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,049::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Queuing request in the thread pool... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:23,049::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,049::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,049::__init__::225::IOProcess::(_processLogs) (542054) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) (542054) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) (542054) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) (542054) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) (542053) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) (542053) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,050::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,051::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,051::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:23,051::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,051::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) (542055) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) (542055) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,052::__init__::225::IOProcess::(_processLogs) (542056) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,053::__init__::225::IOProcess::(_processLogs) (542056) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,062::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|(542055) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,062::__init__::225::IOProcess::(_processLogs) (542055) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,062::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:23,062::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,063::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,063::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,063::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:23,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,064::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,064::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,064::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,064::__init__::225::IOProcess::(_processLogs) (542057) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,064::__init__::225::IOProcess::(_processLogs) (542057) Got request for method 'rename' >Dummy-51::DEBUG::2014-08-11 17:39:23,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:23,132::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|(542057) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,132::__init__::225::IOProcess::(_processLogs) (542057) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,133::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,133::__init__::225::IOProcess::(_processLogs) (542056) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,133::__init__::225::IOProcess::(_processLogs) (542056) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,133::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,134::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,134::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:23,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,134::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) (542058) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) (542058) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) (542051) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Message size is 398 >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,136::__init__::225::IOProcess::(_processLogs) (542059) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,136::__init__::225::IOProcess::(_processLogs) (542059) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,164::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542058) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,165::__init__::225::IOProcess::(_processLogs) (542058) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,167::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:23,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,169::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:23,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,173::__init__::225::IOProcess::(_processLogs) (542060) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,174::__init__::225::IOProcess::(_processLogs) (542060) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,174::__init__::225::IOProcess::(_processLogs) (542060) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,175::__init__::225::IOProcess::(_processLogs) (542060) Queuing response >Dummy-51::DEBUG::2014-08-11 17:39:23,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0414723 s, 24.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:23,176::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,177::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,177::__init__::225::IOProcess::(_processLogs) (542059) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,178::__init__::225::IOProcess::(_processLogs) (542059) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,179::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,181::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:23,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,184::__init__::225::IOProcess::(_processLogs) (542061) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,184::__init__::225::IOProcess::(_processLogs) (542061) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,185::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,186::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:39:23,186::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,187::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,187::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,187::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,188::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,188::__init__::225::IOProcess::(_processLogs) (542062) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,189::__init__::225::IOProcess::(_processLogs) (542062) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542061) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,190::__init__::225::IOProcess::(_processLogs) (542061) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,190::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,191::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,191::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,192::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,193::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,193::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,195::__init__::225::IOProcess::(_processLogs) (542063) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,195::__init__::225::IOProcess::(_processLogs) (542063) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,195::__init__::225::IOProcess::(_processLogs) (542063) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,196::__init__::225::IOProcess::(_processLogs) (542063) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,197::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,197::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,198::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,198::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,200::__init__::225::IOProcess::(_processLogs) (542064) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,201::__init__::225::IOProcess::(_processLogs) (542064) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542062) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,204::__init__::225::IOProcess::(_processLogs) (542062) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,205::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,206::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:23,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,209::__init__::225::IOProcess::(_processLogs) (542065) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,209::__init__::225::IOProcess::(_processLogs) (542065) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542064) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,211::__init__::225::IOProcess::(_processLogs) (542064) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,213::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:23,213::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,213::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) (542066) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) (542066) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) (542066) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) (542067) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,215::__init__::225::IOProcess::(_processLogs) (542067) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,228::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|(542067) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,228::__init__::225::IOProcess::(_processLogs) (542067) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,228::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,229::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) (542068) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) (542068) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) (542068) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) (542068) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,230::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,231::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,231::__init__::225::IOProcess::(_processLogs) (542069) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,231::__init__::225::IOProcess::(_processLogs) (542069) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,237::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|(542065) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,237::__init__::225::IOProcess::(_processLogs) (542065) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,237::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,238::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,238::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,238::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:39:23,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,239::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,239::__init__::225::IOProcess::(_processLogs) (542070) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,239::__init__::225::IOProcess::(_processLogs) (542070) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,248::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|(542069) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,248::__init__::225::IOProcess::(_processLogs) (542069) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,248::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,248::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,248::__init__::225::IOProcess::(_processLogs) (542066) Got request for method 'stat'DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) (542071) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,249::__init__::225::IOProcess::(_processLogs) (542071) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:23,262::__init__::225::IOProcess::(_processLogs) DEBUG|(542071) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,262::__init__::225::IOProcess::(_processLogs) (542071) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,263::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) (542072) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) (542072) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) DEBUG|(542072) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) (542072) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,264::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) Message size is 272 >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) (542073) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:39:23,265::__init__::225::IOProcess::(_processLogs) (542073) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) DEBUG|(542070) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) (542070) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:23,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:23,272::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) (542074) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) (542074) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) (542074) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) (542074) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:23,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,274::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,274::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,274::__init__::225::IOProcess::(_processLogs) (542075) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,274::__init__::225::IOProcess::(_processLogs) (542075) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:23,288::__init__::225::IOProcess::(_processLogs) (542075) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,288::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::WARNING::2014-08-11 17:39:23,288::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,289::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:23,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,289::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,290::__init__::225::IOProcess::(_processLogs) (542076) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,290::__init__::225::IOProcess::(_processLogs) (542076) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:23,307::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542076) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,307::__init__::225::IOProcess::(_processLogs) (542076) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,307::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,307::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) (542077) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,308::__init__::225::IOProcess::(_processLogs) (542077) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:23,311::__init__::225::IOProcess::(_processLogs) (542077) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,311::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:23,311::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) (542078) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) (542078) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) (542078) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) (542078) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,313::__init__::225::IOProcess::(_processLogs) (542079) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,313::__init__::225::IOProcess::(_processLogs) (542079) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) (542073) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,316::__init__::225::IOProcess::(_processLogs) (542080) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:39:23,316::__init__::225::IOProcess::(_processLogs) (542080) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:39:23,321::__init__::225::IOProcess::(_processLogs) (542079) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,322::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,322::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) (542081) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) (542081) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) (542081) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) (542081) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,324::__init__::225::IOProcess::(_processLogs) (542082) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,324::__init__::225::IOProcess::(_processLogs) (542082) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,328::__init__::225::IOProcess::(_processLogs) (542080) Queuing response >ae83c418-616b-4224-8a8e-87057b8a90c2::INFO::2014-08-11 17:39:23,329::fileVolume::133::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/cdc5a7e1-4d16-404d-90a4-c0ed6584c11b/269bcc1a-8426-49ae-a837-e9653759fcc8 with size = 20 sectors >Thread-19::DEBUG::2014-08-11 17:39:23,329::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:23,329::utils::738::root::(execCmd) /usr/bin/qemu-img create -f qcow2 /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/cdc5a7e1-4d16-404d-90a4-c0ed6584c11b/269bcc1a-8426-49ae-a837-e9653759fcc8 10240 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:23,388::__init__::225::IOProcess::(_processLogs) (542082) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,388::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,389::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:23,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,390::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,390::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,390::__init__::225::IOProcess::(_processLogs) (542083) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,391::__init__::225::IOProcess::(_processLogs) (542083) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,391::__init__::225::IOProcess::(_processLogs) (542083) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,391::__init__::225::IOProcess::(_processLogs) (542083) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,391::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,391::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,391::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:23,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,392::__init__::225::IOProcess::(_processLogs) (542084) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,392::__init__::225::IOProcess::(_processLogs) (542084) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,402::__init__::225::IOProcess::(_processLogs) (542084) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,403::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,403::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:23,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) (542085) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) (542085) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) (542085) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) (542085) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:23,404::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,405::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,405::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,405::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,405::__init__::225::IOProcess::(_processLogs) (542086) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,405::__init__::225::IOProcess::(_processLogs) (542086) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,424::__init__::225::IOProcess::(_processLogs) (542086) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,424::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,424::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:23,424::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,424::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,425::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,425::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,425::__init__::225::IOProcess::(_processLogs) (542087) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,425::__init__::225::IOProcess::(_processLogs) (542087) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:23,441::__init__::225::IOProcess::(_processLogs) (542087) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) (542088) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:23,442::__init__::225::IOProcess::(_processLogs) (542088) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:23,445::__init__::225::IOProcess::(_processLogs) (542088) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,446::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,446::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,446::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,446::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,446::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (1 active users) >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,447::task::916::Storage.TaskManager.Task::(_runJobs) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::Task.run: exit - success: result {'uuid': 'bdca8406-da33-4323-9fa9-53d245f0a0ed'} >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,447::task::993::Storage.TaskManager.Task::(_decref) Task=`fd387023-cd7f-4ba1-9d20-6d42f853109f`::ref 0 aborting False >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:39:23,447::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-19::DEBUG::2014-08-11 17:39:23,501::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:23,501::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,501::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,501::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,502::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,502::__init__::225::IOProcess::(_processLogs) (542089) Finding callback 'statvfs'... >Thread-27::DEBUG::2014-08-11 17:39:23,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:23,503::__init__::225::IOProcess::(_processLogs) (542089) Got request for method 'statvfs' >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:23,618::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:23,618::__init__::225::IOProcess::(_processLogs) (542089) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,619::__init__::225::IOProcess::(_processLogs) (542089) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,619::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:23,619::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:39:23,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,620::__init__::225::IOProcess::(_processLogs) (542090) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:39:23,620::__init__::225::IOProcess::(_processLogs) (542090) Got request for method 'chmod' >Thread-27::DEBUG::2014-08-11 17:39:23,620::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00146033 s, 251 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) (542091) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:23,621::__init__::225::IOProcess::(_processLogs) (542091) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:23,622::__init__::225::IOProcess::(_processLogs) (542091) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,631::__init__::225::IOProcess::(_processLogs) (542090) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,631::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) (542092) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) (542092) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:23,632::__init__::225::IOProcess::(_processLogs) (542092) Queuing response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:23,632::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:23,633::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,633::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,633::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:23,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,633::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) (542093) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) (542093) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) (542093) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:23,634::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) (542094) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) (542094) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) (542094) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,635::__init__::225::IOProcess::(_processLogs) (542094) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) (542095) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,636::__init__::225::IOProcess::(_processLogs) (542095) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:23,646::__init__::225::IOProcess::(_processLogs) (542095) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,647::__init__::225::IOProcess::(_processLogs) (542096) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,648::__init__::225::IOProcess::(_processLogs) (542096) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) (542096) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,681::__init__::225::IOProcess::(_processLogs) (542097) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,681::__init__::225::IOProcess::(_processLogs) (542097) Got request for method 'writefile' >Thread-10237::DEBUG::2014-08-11 17:39:23,712::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:23,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fd6a240-7006-474d-87fe-b362f362d627`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:23,713::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:39:23,713::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-10237::DEBUG::2014-08-11 17:39:23,713::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ae83c418-616b-4224-8a8e-87057b8a90c2 >Thread-10237::DEBUG::2014-08-11 17:39:23,713::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'} >Thread-10237::DEBUG::2014-08-11 17:39:23,713::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: fd387023-cd7f-4ba1-9d20-6d42f853109f >Thread-10237::DEBUG::2014-08-11 17:39:23,713::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'} >Thread-10237::DEBUG::2014-08-11 17:39:23,713::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'ae83c418-616b-4224-8a8e-87057b8a90c2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'}, 'fd387023-cd7f-4ba1-9d20-6d42f853109f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'}} >Thread-10237::INFO::2014-08-11 17:39:23,713::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ae83c418-616b-4224-8a8e-87057b8a90c2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'}, 'fd387023-cd7f-4ba1-9d20-6d42f853109f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'}}} >Thread-10237::DEBUG::2014-08-11 17:39:23,713::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fd6a240-7006-474d-87fe-b362f362d627`::finished: {'allTasksStatus': {'ae83c418-616b-4224-8a8e-87057b8a90c2': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'}, 'fd387023-cd7f-4ba1-9d20-6d42f853109f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'}}} >Thread-10237::DEBUG::2014-08-11 17:39:23,713::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fd6a240-7006-474d-87fe-b362f362d627`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:23,713::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:23,714::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:23,714::task::993::Storage.TaskManager.Task::(_decref) Task=`2fd6a240-7006-474d-87fe-b362f362d627`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:23,734::__init__::225::IOProcess::(_processLogs) (542097) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,734::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,734::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:23,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,735::__init__::225::IOProcess::(_processLogs) (542098) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,735::__init__::225::IOProcess::(_processLogs) (542098) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,762::__init__::225::IOProcess::(_processLogs) (542098) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,762::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,763::__init__::225::IOProcess::(_processLogs) (542099) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,764::__init__::225::IOProcess::(_processLogs) (542099) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,782::__init__::225::IOProcess::(_processLogs) (542099) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,782::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) (542100) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,783::__init__::225::IOProcess::(_processLogs) (542100) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,803::__init__::225::IOProcess::(_processLogs) (542100) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,803::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,803::__init__::225::IOProcess::(_processLogs) Message size is 665 >Thread-19::DEBUG::2014-08-11 17:39:23,804::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,804::__init__::225::IOProcess::(_processLogs) (542101) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:23,804::__init__::225::IOProcess::(_processLogs) (542101) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:23,823::__init__::225::IOProcess::(_processLogs) (542101) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,823::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:23,824::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:23,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,824::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:23,824::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,825::__init__::225::IOProcess::(_processLogs) (542102) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,825::__init__::225::IOProcess::(_processLogs) (542102) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:23,825::__init__::225::IOProcess::(_processLogs) (542102) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,825::__init__::225::IOProcess::(_processLogs) (542102) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,825::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) (542103) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,826::__init__::225::IOProcess::(_processLogs) (542103) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:23,837::__init__::225::IOProcess::(_processLogs) (542103) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,837::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:23,837::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) (542104) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,838::__init__::225::IOProcess::(_processLogs) (542104) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:23,851::__init__::225::IOProcess::(_processLogs) (542104) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,851::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) (542105) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,852::__init__::225::IOProcess::(_processLogs) (542105) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:23,855::__init__::225::IOProcess::(_processLogs) (542105) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,855::__init__::225::IOProcess::(_processLogs) Sending response sized 291 >Thread-19::DEBUG::2014-08-11 17:39:23,855::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,855::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) (542106) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) (542106) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) (542106) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) (542106) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) (542107) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,857::__init__::225::IOProcess::(_processLogs) (542107) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,866::__init__::225::IOProcess::(_processLogs) (542107) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,866::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,866::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:23,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) (542108) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) (542108) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) (542108) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) (542108) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) (542109) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,868::__init__::225::IOProcess::(_processLogs) (542109) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,877::__init__::225::IOProcess::(_processLogs) (542109) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,878::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,878::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:23,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) (542110) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) (542110) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) (542110) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) (542110) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,880::__init__::225::IOProcess::(_processLogs) (542111) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,880::__init__::225::IOProcess::(_processLogs) (542111) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,890::__init__::225::IOProcess::(_processLogs) (542111) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,890::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,891::__init__::225::IOProcess::(_processLogs) (542112) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) (542112) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) (542112) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) (542112) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,892::__init__::225::IOProcess::(_processLogs) (542113) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,893::__init__::225::IOProcess::(_processLogs) (542113) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,906::__init__::225::IOProcess::(_processLogs) (542113) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,906::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,906::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:23,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) (542114) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) (542114) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) (542114) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,907::__init__::225::IOProcess::(_processLogs) (542114) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) (542115) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:23,908::__init__::225::IOProcess::(_processLogs) (542115) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:23,916::__init__::225::IOProcess::(_processLogs) (542115) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) (542116) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:23,917::__init__::225::IOProcess::(_processLogs) (542116) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:23,923::__init__::225::IOProcess::(_processLogs) (542116) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,923::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,923::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) (542117) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) (542117) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) (542117) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) (542117) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,925::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:23,961::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) Message size is 436 >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) (542118) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:23,962::__init__::225::IOProcess::(_processLogs) (542118) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:23,969::__init__::225::IOProcess::(_processLogs) (542118) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,969::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:23,969::fileVolume::384::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=269bcc1a-8426-49ae-a837-e9653759fcc8 sdUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f, metaId=(u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/cdc5a7e1-4d16-404d-90a4-c0ed6584c11b/269bcc1a-8426-49ae-a837-e9653759fcc8',) >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) Message size is 280 >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) (542119) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:39:23,970::__init__::225::IOProcess::(_processLogs) (542119) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:39:23,988::__init__::225::IOProcess::(_processLogs) (542119) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,989::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:23,989::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:39:23,989::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,989::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) (542120) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) (542120) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) (542120) Building response >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) (542120) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) Message size is 250 >Thread-19::DEBUG::2014-08-11 17:39:23,990::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:23,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:23,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:23,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:23,991::__init__::225::IOProcess::(_processLogs) (542121) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:39:23,991::__init__::225::IOProcess::(_processLogs) (542121) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:39:24,000::__init__::225::IOProcess::(_processLogs) (542121) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,000::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,074::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:24,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,074::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,075::__init__::225::IOProcess::(_processLogs) (542122) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:24,075::__init__::225::IOProcess::(_processLogs) (542122) Got request for method 'access' >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,075::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:24,075::__init__::225::IOProcess::(_processLogs) (542122) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,075::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,075::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) (542123) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) (542123) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:24,076::__init__::225::IOProcess::(_processLogs) (542123) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) (542124) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) (542124) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) (542124) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) (542124) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,079::__init__::225::IOProcess::(_processLogs) (542125) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,079::__init__::225::IOProcess::(_processLogs) (542125) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:24,087::__init__::225::IOProcess::(_processLogs) (542125) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,087::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) (542126) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,088::__init__::225::IOProcess::(_processLogs) (542126) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,110::__init__::225::IOProcess::(_processLogs) (542126) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,110::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,110::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:24,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,111::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,111::__init__::225::IOProcess::(_processLogs) (542127) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,111::__init__::225::IOProcess::(_processLogs) (542127) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,132::__init__::225::IOProcess::(_processLogs) (542127) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,132::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,132::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,132::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:24,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,133::__init__::225::IOProcess::(_processLogs) (542128) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,133::__init__::225::IOProcess::(_processLogs) (542128) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,151::__init__::225::IOProcess::(_processLogs) (542128) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,151::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,152::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:39:24,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,153::__init__::225::IOProcess::(_processLogs) (542129) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,153::__init__::225::IOProcess::(_processLogs) (542129) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,170::__init__::225::IOProcess::(_processLogs) (542129) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,170::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,170::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:24,170::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:24,170::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:24,171::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,171::__init__::225::IOProcess::(_processLogs) (542130) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) (542130) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) (542130) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) (542130) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,173::__init__::225::IOProcess::(_processLogs) (542131) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:24,173::__init__::225::IOProcess::(_processLogs) (542131) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:24,180::__init__::225::IOProcess::(_processLogs) (542131) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,180::__init__::225::IOProcess::(_processLogs) Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:24,181::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,181::__init__::225::IOProcess::(_processLogs) (542132) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:24,182::__init__::225::IOProcess::(_processLogs) (542132) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:24,191::__init__::225::IOProcess::(_processLogs) (542132) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,191::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) (542133) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,192::__init__::225::IOProcess::(_processLogs) (542133) Got request for method 'listdir' >Thread-10237::DEBUG::2014-08-11 17:39:24,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`270e4b12-96c7-459d-aaa9-dc4571857a51`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:24,222::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:39:24,222::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146033', 'lastCheck': '0.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448258', 'lastCheck': '5.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:24,222::task::1191::Storage.TaskManager.Task::(prepare) Task=`270e4b12-96c7-459d-aaa9-dc4571857a51`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146033', 'lastCheck': '0.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000448258', 'lastCheck': '5.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:24,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`270e4b12-96c7-459d-aaa9-dc4571857a51`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:24,223::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:24,223::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:24,223::task::993::Storage.TaskManager.Task::(_decref) Task=`270e4b12-96c7-459d-aaa9-dc4571857a51`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:24,230::__init__::225::IOProcess::(_processLogs) (542133) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,230::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:24,230::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,230::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) (542134) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) (542134) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) (542134) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) (542134) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:24,231::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,232::__init__::225::IOProcess::(_processLogs) (542135) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,232::__init__::225::IOProcess::(_processLogs) (542135) Got request for method 'unlink' >Thread-10237::DEBUG::2014-08-11 17:39:24,234::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:24,235::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:39:24,241::__init__::225::IOProcess::(_processLogs) (542135) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,241::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,241::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:24,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) (542136) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) (542136) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) (542136) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) (542136) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,242::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:24,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,243::__init__::225::IOProcess::(_processLogs) (542137) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,243::__init__::225::IOProcess::(_processLogs) (542137) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,253::__init__::225::IOProcess::(_processLogs) (542137) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,253::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,253::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:24,253::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,253::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) (542138) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) (542138) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) (542138) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) (542138) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,254::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) (542139) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,255::__init__::225::IOProcess::(_processLogs) (542139) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,265::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542139) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,265::__init__::225::IOProcess::(_processLogs) (542139) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,266::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,266::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,266::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,266::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:24,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,266::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) (542140) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) (542140) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) (542140) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) (542140) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,267::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) (542141) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,268::__init__::225::IOProcess::(_processLogs) (542141) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,279::__init__::225::IOProcess::(_processLogs) (542141) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,279::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,280::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:24,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,280::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) (542142) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) (542142) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) (542142) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) (542142) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,282::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,282::__init__::225::IOProcess::(_processLogs) (542143) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,282::__init__::225::IOProcess::(_processLogs) (542143) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,295::__init__::225::IOProcess::(_processLogs) DEBUG|(542143) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,295::__init__::225::IOProcess::(_processLogs) (542143) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,295::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,296::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,296::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,296::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:24,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,296::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) (542144) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) (542144) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) (542144) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) (542144) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:24,297::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,298::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,298::__init__::225::IOProcess::(_processLogs) (542145) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,298::__init__::225::IOProcess::(_processLogs) (542145) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,312::__init__::225::IOProcess::(_processLogs) DEBUG|(542145) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,312::__init__::225::IOProcess::(_processLogs) (542145) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,312::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,312::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,312::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) (542146) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,313::__init__::225::IOProcess::(_processLogs) (542146) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:24,322::__init__::225::IOProcess::(_processLogs) (542146) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,322::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,322::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:24,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) (542147) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) (542147) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:24,323::__init__::225::IOProcess::(_processLogs) DEBUG|(542147) Building response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,324::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b' >Thread-19::DEBUG::2014-08-11 17:39:24,324::__init__::225::IOProcess::(_processLogs) (542147) Queuing response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,324::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b' (0 active users) >Thread-19::DEBUG::2014-08-11 17:39:24,324::__init__::225::IOProcess::(_processLogs) Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,325::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b' is free, finding out if anyone is waiting for it. >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,325::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.cdc5a7e1-4d16-404d-90a4-c0ed6584c11b', Clearing records. >Thread-19::DEBUG::2014-08-11 17:39:24,325::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::moving from state running -> state finished >Thread-19::DEBUG::2014-08-11 17:39:24,326::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,326::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:39:24,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,327::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,327::task::752::Storage.TaskManager.Task::(_save) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/ae83c418-616b-4224-8a8e-87057b8a90c2.temp >Thread-19::DEBUG::2014-08-11 17:39:24,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,327::__init__::225::IOProcess::(_processLogs) (542148) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:24,327::__init__::225::IOProcess::(_processLogs) (542148) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) (542148) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) (542148) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,328::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) (542149) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) (542149) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) (542149) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) (542149) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:39:24,329::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) (542150) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) (542150) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) (542150) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) (542150) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,330::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) (542151) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,331::__init__::225::IOProcess::(_processLogs) (542151) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:39:24,341::__init__::225::IOProcess::(_processLogs) DEBUG|(542151) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,341::__init__::225::IOProcess::(_processLogs) (542151) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,341::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,342::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,342::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,342::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:39:24,342::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,342::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,343::__init__::225::IOProcess::(_processLogs) (542152) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,343::__init__::225::IOProcess::(_processLogs) (542152) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,355::__init__::225::IOProcess::(_processLogs) DEBUG|(542152) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,355::__init__::225::IOProcess::(_processLogs) (542152) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,355::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) Message size is 398 >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,357::__init__::225::IOProcess::(_processLogs) (542153) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,357::__init__::225::IOProcess::(_processLogs) (542153) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,378::__init__::225::IOProcess::(_processLogs) DEBUG|(542153) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,378::__init__::225::IOProcess::(_processLogs) (542153) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,378::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,378::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,378::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) (542154) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,379::__init__::225::IOProcess::(_processLogs) (542154) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,398::__init__::225::IOProcess::(_processLogs) DEBUG|(542154) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,398::__init__::225::IOProcess::(_processLogs) (542154) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,398::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,399::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,399::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,399::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:39:24,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,399::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,400::__init__::225::IOProcess::(_processLogs) (542155) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,400::__init__::225::IOProcess::(_processLogs) (542155) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,416::__init__::225::IOProcess::(_processLogs) DEBUG|(542155) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,416::__init__::225::IOProcess::(_processLogs) (542155) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,416::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,417::__init__::225::IOProcess::(_processLogs) (542156) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:39:24,418::__init__::225::IOProcess::(_processLogs) (542156) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:39:24,434::__init__::225::IOProcess::(_processLogs) DEBUG|(542156) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,434::__init__::225::IOProcess::(_processLogs) (542156) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,434::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,434::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:39:24,435::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,435::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:24,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,435::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:24,435::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:24,436::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,436::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,436::__init__::225::IOProcess::(_processLogs) (542157) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,436::__init__::225::IOProcess::(_processLogs) (542157) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:24,436::__init__::225::IOProcess::(_processLogs) (542157) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,436::__init__::225::IOProcess::(_processLogs) (542157) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) (542158) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:24,437::__init__::225::IOProcess::(_processLogs) (542158) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:24,442::__init__::225::IOProcess::(_processLogs) DEBUG|(542158) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,442::__init__::225::IOProcess::(_processLogs) (542158) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,443::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::WARNING::2014-08-11 17:39:24,443::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:39:24,443::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) (542159) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:39:24,444::__init__::225::IOProcess::(_processLogs) (542159) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:39:24,463::__init__::225::IOProcess::(_processLogs) (542159) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,463::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) (542160) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,464::__init__::225::IOProcess::(_processLogs) (542160) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:24,472::__init__::225::IOProcess::(_processLogs) (542160) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,472::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:24,472::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:24,472::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) (542161) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) (542161) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) (542161) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) (542161) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,473::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:24,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,474::__init__::225::IOProcess::(_processLogs) (542162) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,474::__init__::225::IOProcess::(_processLogs) (542162) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,486::__init__::225::IOProcess::(_processLogs) (542162) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,486::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,486::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:24,486::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,486::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) (542163) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) (542163) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) (542163) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) (542163) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,487::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:39:24,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,488::__init__::225::IOProcess::(_processLogs) (542164) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,488::__init__::225::IOProcess::(_processLogs) (542164) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,498::__init__::225::IOProcess::(_processLogs) (542164) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,498::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) (542165) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,499::__init__::225::IOProcess::(_processLogs) (542165) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) (542165) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) (542165) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,500::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,501::__init__::225::IOProcess::(_processLogs) (542166) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,501::__init__::225::IOProcess::(_processLogs) (542166) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:24,510::__init__::225::IOProcess::(_processLogs) DEBUG|(542166) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,510::__init__::225::IOProcess::(_processLogs) (542166) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,510::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,511::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) (542167) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) (542167) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) (542167) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) (542167) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,512::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) (542168) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:24,513::__init__::225::IOProcess::(_processLogs) (542168) Got request for method 'unlink' >Thread-10017::DEBUG::2014-08-11 17:39:24,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`394d4436-656c-4bce-8518-6553352ddd10`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:39:24,516::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:39:24,516::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,516::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) (542169) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:24,517::__init__::225::IOProcess::(_processLogs) (542169) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,518::__init__::225::IOProcess::(_processLogs) DEBUG|(542169) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,518::__init__::225::IOProcess::(_processLogs) (542169) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,518::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,518::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:24,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,518::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:39:24,519::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10017::INFO::2014-08-11 17:39:24,519::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:39:24,519::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::DEBUG::2014-08-11 17:39:24,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`394d4436-656c-4bce-8518-6553352ddd10`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:39:24,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:39:24,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`394d4436-656c-4bce-8518-6553352ddd10`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:39:24,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:39:24,520::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:39:24,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:39:24,521::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:39:24,521::__init__::225::IOProcess::(_processLogs) (542170) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:39:24,521::task::993::Storage.TaskManager.Task::(_decref) Task=`394d4436-656c-4bce-8518-6553352ddd10`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:24,522::__init__::225::IOProcess::(_processLogs) (542170) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:24,522::__init__::225::IOProcess::(_processLogs) (542170) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,522::__init__::225::IOProcess::(_processLogs) (542170) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,523::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:39:24,526::__init__::225::IOProcess::(_processLogs) DEBUG|(542168) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,526::__init__::225::IOProcess::(_processLogs) (542168) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,526::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,526::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,527::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,527::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:39:24,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,527::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,528::__init__::225::IOProcess::(_processLogs) (542171) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:24,528::__init__::225::IOProcess::(_processLogs) (542171) Got request for method 'rmdir' >Thread-10017::DEBUG::2014-08-11 17:39:24,544::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:39:24,550::__init__::225::IOProcess::(_processLogs) DEBUG|(542171) Building response >Thread-19::DEBUG::2014-08-11 17:39:24,550::__init__::225::IOProcess::(_processLogs) (542171) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:24,551::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:24,552::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:24,552::__init__::225::IOProcess::(_processLogs) (542172) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:39:24,552::__init__::225::IOProcess::(_processLogs) (542172) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:39:24,552::__init__::225::IOProcess::(_processLogs) DEBUG|(542172) Building response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,552::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:39:24,552::__init__::225::IOProcess::(_processLogs) (542172) Queuing response >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,552::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:39:24,553::__init__::225::IOProcess::(_processLogs) Generating json... >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,554::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-19::DEBUG::2014-08-11 17:39:24,554::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,555::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,555::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,556::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,557::task::916::Storage.TaskManager.Task::(_runJobs) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::Task.run: exit - success: result {'uuid': '269bcc1a-8426-49ae-a837-e9653759fcc8'} >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,558::task::993::Storage.TaskManager.Task::(_decref) Task=`ae83c418-616b-4224-8a8e-87057b8a90c2`::ref 0 aborting False >ae83c418-616b-4224-8a8e-87057b8a90c2::DEBUG::2014-08-11 17:39:24,558::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-08-11 17:39:25,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:25,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0119246 s, 85.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:25,785::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:25,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:25,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:26,473::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:26,474::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:26,474::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:26,912::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:26,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`d04fb494-6fd8-4d96-8009-d3f42664fc64`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:26,912::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:39:26,960::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:26,961::task::1191::Storage.TaskManager.Task::(prepare) Task=`d04fb494-6fd8-4d96-8009-d3f42664fc64`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:26,961::task::595::Storage.TaskManager.Task::(_updateState) Task=`d04fb494-6fd8-4d96-8009-d3f42664fc64`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:26,961::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:26,961::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:26,961::task::993::Storage.TaskManager.Task::(_decref) Task=`d04fb494-6fd8-4d96-8009-d3f42664fc64`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:39:26,972::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:39:26,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`059f2ea5-beaf-4c9c-8d30-31cc251766bd`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:26,972::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:39:26,972::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2945bbfa-ebc4-4642-985a-e036c1fa8559`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:39:26,972::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:26,972::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:26,973::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2945bbfa-ebc4-4642-985a-e036c1fa8559`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:26,973::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`059f2ea5-beaf-4c9c-8d30-31cc251766bd`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:26,973::task::993::Storage.TaskManager.Task::(_decref) Task=`059f2ea5-beaf-4c9c-8d30-31cc251766bd`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:39:26,989::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:26,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`059f2ea5-beaf-4c9c-8d30-31cc251766bd`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:26,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`059f2ea5-beaf-4c9c-8d30-31cc251766bd`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:39:26,990::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:39:26,990::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:39:26,990::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:39:26,990::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:39:26,990::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:39:26,990::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:39:26,990::task::993::Storage.TaskManager.Task::(_decref) Task=`059f2ea5-beaf-4c9c-8d30-31cc251766bd`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:39:27,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:27,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257477 s, 39.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:28,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:28,415::__init__::225::IOProcess::(_processLogs) (542173) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:28,415::__init__::225::IOProcess::(_processLogs) (542173) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:28,415::__init__::225::IOProcess::(_processLogs) DEBUG|(542173) Building response >Thread-19::DEBUG::2014-08-11 17:39:28,415::__init__::225::IOProcess::(_processLogs) (542173) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:28,415::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:28,416::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:39:28,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:39:28,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0478337 s, 10.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:28,526::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:28,526::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:28,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:28,527::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:28,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:28,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:28,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:28,527::__init__::225::IOProcess::(_processLogs) (542174) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:28,527::__init__::225::IOProcess::(_processLogs) (542174) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:28,529::__init__::225::IOProcess::(_processLogs) DEBUG|(542174) Building response >Thread-19::DEBUG::2014-08-11 17:39:28,529::__init__::225::IOProcess::(_processLogs) (542174) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:28,529::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:28,529::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:28,530::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:28,530::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:39:28,530::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:28,530::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:28,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:28,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) (542175) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) (542175) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) (542175) Building response >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) (542175) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:28,531::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) (542176) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) (542176) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) (542176) Building response >Thread-19::DEBUG::2014-08-11 17:39:28,532::__init__::225::IOProcess::(_processLogs) (542176) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:28,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:28,533::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:28,533::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:28,533::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:39:28,533::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:28,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) (542177) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) (542177) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) (542177) Building response >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) (542177) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:28,534::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:39:29,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:39:29,529::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:39:29,537::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0912216 s, 11.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:30,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:30,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:30,793::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:31,475::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:31,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:31,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:31,545::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:31,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188319 s, 54.4 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:39:32,281::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) (542178) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:33,623::__init__::225::IOProcess::(_processLogs) (542178) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:33,624::__init__::225::IOProcess::(_processLogs) DEBUG|(542178) Building response >Thread-19::DEBUG::2014-08-11 17:39:33,624::__init__::225::IOProcess::(_processLogs) (542178) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:33,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:33,624::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:39:33,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:33,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-27::DEBUG::2014-08-11 17:39:33,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00313559 s, 117 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) (542179) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) (542179) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:33,742::__init__::225::IOProcess::(_processLogs) DEBUG|(542179) Building response >Thread-19::DEBUG::2014-08-11 17:39:33,743::__init__::225::IOProcess::(_processLogs) (542179) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:33,743::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:33,743::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:39:33,804::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:33,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`00d0306c-28a7-4f41-92d2-f8299c4f9d9f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:33,805::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:39:33,805::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-10237::DEBUG::2014-08-11 17:39:33,805::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: ae83c418-616b-4224-8a8e-87057b8a90c2 >Thread-10237::DEBUG::2014-08-11 17:39:33,805::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'} >Thread-10237::DEBUG::2014-08-11 17:39:33,805::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: fd387023-cd7f-4ba1-9d20-6d42f853109f >Thread-10237::DEBUG::2014-08-11 17:39:33,805::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'} >Thread-10237::DEBUG::2014-08-11 17:39:33,805::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'ae83c418-616b-4224-8a8e-87057b8a90c2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'}, 'fd387023-cd7f-4ba1-9d20-6d42f853109f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'}} >Thread-10237::INFO::2014-08-11 17:39:33,805::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'ae83c418-616b-4224-8a8e-87057b8a90c2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'}, 'fd387023-cd7f-4ba1-9d20-6d42f853109f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'}}} >Thread-10237::DEBUG::2014-08-11 17:39:33,806::task::1191::Storage.TaskManager.Task::(prepare) Task=`00d0306c-28a7-4f41-92d2-f8299c4f9d9f`::finished: {'allTasksStatus': {'ae83c418-616b-4224-8a8e-87057b8a90c2': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'ae83c418-616b-4224-8a8e-87057b8a90c2'}, 'fd387023-cd7f-4ba1-9d20-6d42f853109f': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'fd387023-cd7f-4ba1-9d20-6d42f853109f'}}} >Thread-10237::DEBUG::2014-08-11 17:39:33,806::task::595::Storage.TaskManager.Task::(_updateState) Task=`00d0306c-28a7-4f41-92d2-f8299c4f9d9f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:33,806::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:33,806::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:33,806::task::993::Storage.TaskManager.Task::(_decref) Task=`00d0306c-28a7-4f41-92d2-f8299c4f9d9f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:39:33,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0707265 s, 14.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:39:33,936::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmHibernate with ('5b1ee280-4251-489a-899c-8e9dac73c327', '7158eae9-4886-4af7-af0b-d668ecee9e4f,00000002-0002-0002-0002-00000000037f,4c2b3c72-a901-435d-9a9f-8628b2263c7e,bdca8406-da33-4323-9fa9-53d245f0a0ed,cdc5a7e1-4d16-404d-90a4-c0ed6584c11b,269bcc1a-8426-49ae-a837-e9653759fcc8') {} >Thread-10237::DEBUG::2014-08-11 17:39:33,936::API::511::vds::(migrate) {'hiberVolHandle': '7158eae9-4886-4af7-af0b-d668ecee9e4f,00000002-0002-0002-0002-00000000037f,4c2b3c72-a901-435d-9a9f-8628b2263c7e,bdca8406-da33-4323-9fa9-53d245f0a0ed,cdc5a7e1-4d16-404d-90a4-c0ed6584c11b,269bcc1a-8426-49ae-a837-e9653759fcc8', 'vmId': '5b1ee280-4251-489a-899c-8e9dac73c327', 'mode': 'file'} >Thread-10237::DEBUG::2014-08-11 17:39:33,937::BindingXMLRPC::1134::vds::(wrapper) return vmHibernate with {'status': {'message': 'Hibernation process starting', 'code': 0}, 'progress': 0} >Thread-10242::DEBUG::2014-08-11 17:39:33,938::migration::135::vm.Vm::(_prepareGuest) vmId=`5b1ee280-4251-489a-899c-8e9dac73c327`::Save State begins >Thread-10242::ERROR::2014-08-11 17:39:33,938::migration::160::vm.Vm::(_recover) vmId=`5b1ee280-4251-489a-899c-8e9dac73c327`::'NoneType' object has no attribute 'isResponsive' >Thread-10242::ERROR::2014-08-11 17:39:33,940::migration::259::vm.Vm::(run) vmId=`5b1ee280-4251-489a-899c-8e9dac73c327`::Failed to migrate >Traceback (most recent call last): > File "/usr/share/vdsm/virt/migration.py", line 231, in run > self._prepareGuest() > File "/usr/share/vdsm/virt/migration.py", line 136, in _prepareGuest > if self._vm.guestAgent.isResponsive(): >AttributeError: 'NoneType' object has no attribute 'isResponsive' >Thread-10237::DEBUG::2014-08-11 17:39:33,980::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:33,980::task::595::Storage.TaskManager.Task::(_updateState) Task=`b35cc464-9e9d-405f-8a16-f1b8fec29d05`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:33,980::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='ae83c418-616b-4224-8a8e-87057b8a90c2', spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:39:33,980::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: ae83c418-616b-4224-8a8e-87057b8a90c2 >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) (542180) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:33,981::__init__::225::IOProcess::(_processLogs) (542180) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:33,982::__init__::225::IOProcess::(_processLogs) DEBUG|(542180) Building response >Thread-19::DEBUG::2014-08-11 17:39:33,982::__init__::225::IOProcess::(_processLogs) (542180) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:33,982::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:33,983::__init__::225::IOProcess::(_processLogs) Sending response sized 288 >Thread-19::DEBUG::2014-08-11 17:39:33,983::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:33,983::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-08-11 17:39:33,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) (542181) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) (542181) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) (542181) Building response >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) (542181) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:39:33,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,985::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,985::__init__::225::IOProcess::(_processLogs) (542182) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:33,985::__init__::225::IOProcess::(_processLogs) (542182) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:33,994::__init__::225::IOProcess::(_processLogs) (542182) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:33,994::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:33,995::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:39:33,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) (542183) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) (542183) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) (542183) Building response >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) (542183) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:33,996::__init__::225::IOProcess::(_processLogs) (542184) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:33,997::__init__::225::IOProcess::(_processLogs) (542184) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,007::__init__::225::IOProcess::(_processLogs) (542184) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,007::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,007::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-08-11 17:39:34,007::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) (542185) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) (542185) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) (542185) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) (542185) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) (542186) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,009::__init__::225::IOProcess::(_processLogs) (542186) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,021::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:39:34,021::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) (542187) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) (542187) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) (542187) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) (542187) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,022::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) (542188) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,023::__init__::225::IOProcess::(_processLogs) (542188) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,033::__init__::225::IOProcess::(_processLogs) (542188) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,033::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,034::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:39:34,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,034::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) (542189) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) (542189) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) (542189) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) (542189) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Message size is 217 >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,036::__init__::225::IOProcess::(_processLogs) (542190) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,036::__init__::225::IOProcess::(_processLogs) (542190) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,049::__init__::225::IOProcess::(_processLogs) (542190) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,049::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) (542191) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:34,050::__init__::225::IOProcess::(_processLogs) (542191) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:34,062::__init__::225::IOProcess::(_processLogs) (542191) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,063::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:39:34,063::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-10237::INFO::2014-08-11 17:39:34,063::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-10237::DEBUG::2014-08-11 17:39:34,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`b35cc464-9e9d-405f-8a16-f1b8fec29d05`::finished: None >Thread-10237::DEBUG::2014-08-11 17:39:34,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`b35cc464-9e9d-405f-8a16-f1b8fec29d05`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:34,063::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:34,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:34,064::task::993::Storage.TaskManager.Task::(_decref) Task=`b35cc464-9e9d-405f-8a16-f1b8fec29d05`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:39:34,078::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:34,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`55c68851-62ef-4271-851a-26c0b4883e16`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:34,078::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='fd387023-cd7f-4ba1-9d20-6d42f853109f', spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:39:34,078::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: fd387023-cd7f-4ba1-9d20-6d42f853109f >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) (542192) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:39:34,079::__init__::225::IOProcess::(_processLogs) (542192) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:39:34,081::__init__::225::IOProcess::(_processLogs) (542192) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,081::__init__::225::IOProcess::(_processLogs) Sending response sized 288 >Thread-19::DEBUG::2014-08-11 17:39:34,082::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:39:34,082::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,082::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,082::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,082::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,082::__init__::225::IOProcess::(_processLogs) (542193) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) (542193) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) (542193) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) (542193) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,083::__init__::225::IOProcess::(_processLogs) (542194) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,084::__init__::225::IOProcess::(_processLogs) (542194) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,092::__init__::225::IOProcess::(_processLogs) (542194) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,092::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,092::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-08-11 17:39:34,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) (542195) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) (542195) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) (542195) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) (542195) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,093::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:39:34,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,094::__init__::225::IOProcess::(_processLogs) (542196) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,094::__init__::225::IOProcess::(_processLogs) (542196) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,100::__init__::225::IOProcess::(_processLogs) (542196) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,100::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) (542197) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) (542197) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) (542197) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,101::__init__::225::IOProcess::(_processLogs) (542197) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Message size is 217 >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) (542198) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,102::__init__::225::IOProcess::(_processLogs) (542198) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,109::__init__::225::IOProcess::(_processLogs) (542198) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,109::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,110::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-08-11 17:39:34,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,111::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,111::__init__::225::IOProcess::(_processLogs) (542199) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,111::__init__::225::IOProcess::(_processLogs) (542199) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) (542199) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) (542199) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) (542200) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,112::__init__::225::IOProcess::(_processLogs) (542200) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,121::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542200) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,121::__init__::225::IOProcess::(_processLogs) (542200) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,121::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,121::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) (542201) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:34,122::__init__::225::IOProcess::(_processLogs) (542201) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) (542201) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) (542201) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,123::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,124::__init__::225::IOProcess::(_processLogs) (542202) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:39:34,124::__init__::225::IOProcess::(_processLogs) (542202) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:39:34,133::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542202) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,133::__init__::225::IOProcess::(_processLogs) (542202) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:34,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:34,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:34,135::__init__::225::IOProcess::(_processLogs) (542203) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:39:34,135::__init__::225::IOProcess::(_processLogs) (542203) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:39:34,142::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542203) Building response >Thread-19::DEBUG::2014-08-11 17:39:34,142::__init__::225::IOProcess::(_processLogs) (542203) Queuing response >Thread-10237::DEBUG::2014-08-11 17:39:34,142::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-19::DEBUG::2014-08-11 17:39:34,142::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-10237::INFO::2014-08-11 17:39:34,143::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-19::DEBUG::2014-08-11 17:39:34,143::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:39:34,143::task::1191::Storage.TaskManager.Task::(prepare) Task=`55c68851-62ef-4271-851a-26c0b4883e16`::finished: None >Thread-10237::DEBUG::2014-08-11 17:39:34,144::task::595::Storage.TaskManager.Task::(_updateState) Task=`55c68851-62ef-4271-851a-26c0b4883e16`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:34,144::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:34,144::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:34,144::task::993::Storage.TaskManager.Task::(_decref) Task=`55c68851-62ef-4271-851a-26c0b4883e16`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:39:35,795::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:35,796::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:35,796::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:35,821::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:35,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537909 s, 19.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:36,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:36,482::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:36,483::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:36,547::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmGetStats with ('5b1ee280-4251-489a-899c-8e9dac73c327',) {} >Thread-10237::DEBUG::2014-08-11 17:39:36,547::BindingXMLRPC::1134::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'displayInfo': [{'tlsPort': u'5900', 'ipAddress': '10.35.0.105', 'type': 'spice', 'port': '-1'}], 'hash': '217435967970351788', 'acpiEnable': 'true', 'pid': '25652', 'displayIp': '10.35.0.105', 'displayPort': '-1', 'displaySecurePort': u'5900', 'timeOffset': '0', 'kvmEnable': 'true', 'network': {}, 'vmId': '5b1ee280-4251-489a-899c-8e9dac73c327', 'vmType': 'kvm', 'disks': {}, 'monitorResponse': '0', 'elapsedTime': '971615', 'displayType': 'qxl', 'clientIp': ''}]} >Thread-10237::DEBUG::2014-08-11 17:39:37,049::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:37,049::task::595::Storage.TaskManager.Task::(_updateState) Task=`71a3c64a-dd78-4b8a-81c1-116bf9cf60ea`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:37,050::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:39:37,126::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:37,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`71a3c64a-dd78-4b8a-81c1-116bf9cf60ea`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:37,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`71a3c64a-dd78-4b8a-81c1-116bf9cf60ea`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:37,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:37,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:37,126::task::993::Storage.TaskManager.Task::(_decref) Task=`71a3c64a-dd78-4b8a-81c1-116bf9cf60ea`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:39:37,138::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:39:37,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`4464e1cd-3020-4c44-b5e3-2905c15aeb77`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:37,138::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:39:37,138::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1eb04954-c89d-40c2-a55a-4b5f142ca10d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:39:37,138::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:37,138::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:37,138::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1eb04954-c89d-40c2-a55a-4b5f142ca10d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:37,139::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4464e1cd-3020-4c44-b5e3-2905c15aeb77`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:37,139::task::993::Storage.TaskManager.Task::(_decref) Task=`4464e1cd-3020-4c44-b5e3-2905c15aeb77`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:39:37,156::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:37,156::task::1191::Storage.TaskManager.Task::(prepare) Task=`4464e1cd-3020-4c44-b5e3-2905c15aeb77`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:37,157::task::595::Storage.TaskManager.Task::(_updateState) Task=`4464e1cd-3020-4c44-b5e3-2905c15aeb77`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:39:37,157::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:39:37,157::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:39:37,157::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:39:37,157::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:39:37,157::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:39:37,157::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:39:37,157::task::993::Storage.TaskManager.Task::(_decref) Task=`4464e1cd-3020-4c44-b5e3-2905c15aeb77`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:39:37,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:38,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0273287 s, 37.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:38,534::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:38,534::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:38,534::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:38,534::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:38,535::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:38,535::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:38,535::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:38,535::__init__::225::IOProcess::(_processLogs) (542204) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:38,535::__init__::225::IOProcess::(_processLogs) (542204) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:38,535::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542204) Building response >Thread-19::DEBUG::2014-08-11 17:39:38,536::__init__::225::IOProcess::(_processLogs) (542204) Queuing response >Thread-28::DEBUG::2014-08-11 17:39:38,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:38,536::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:38,595::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:39:38,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000938663 s, 527 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:38,596::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:38,596::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:38,596::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:38,596::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:38,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:38,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:38,597::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:38,597::__init__::225::IOProcess::(_processLogs) (542205) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:38,597::__init__::225::IOProcess::(_processLogs) (542205) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:38,597::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542205) Building response >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) (542205) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:38,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) (542206) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) (542206) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) (542206) Building response >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) (542206) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:38,599::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) (542207) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:38,600::__init__::225::IOProcess::(_processLogs) (542207) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) (542207) Building response >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) (542207) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:38,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) (542208) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) (542208) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) (542208) Building response >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) (542208) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:38,602::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:39:39,601::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5c7ffa4-1965-4313-b097-1412b3d09751`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:39,601::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:39:39,601::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00313559', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000938663', 'lastCheck': '1.0', 'valid': True}} >Thread-10017::DEBUG::2014-08-11 17:39:39,601::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:39:39,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5c7ffa4-1965-4313-b097-1412b3d09751`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00313559', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000938663', 'lastCheck': '1.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:39,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5c7ffa4-1965-4313-b097-1412b3d09751`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:39,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:39,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:39,602::task::993::Storage.TaskManager.Task::(_decref) Task=`e5c7ffa4-1965-4313-b097-1412b3d09751`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:39:39,622::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:39,623::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:40,037::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:40,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133756 s, 76.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:40,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:40,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:40,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:41,488::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:41,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:41,489::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:42,117::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:42,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0631652 s, 16.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:43,744::__init__::225::IOProcess::(_processLogs) (542209) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:43,745::__init__::225::IOProcess::(_processLogs) (542209) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:43,745::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542209) Building response >Thread-19::DEBUG::2014-08-11 17:39:43,745::__init__::225::IOProcess::(_processLogs) (542209) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:43,745::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:39:43,746::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:43,746::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:39:43,821::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00794067 s, 46.1 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) (542210) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:43,822::__init__::225::IOProcess::(_processLogs) (542210) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:43,831::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542210) Building response >Thread-19::DEBUG::2014-08-11 17:39:43,831::__init__::225::IOProcess::(_processLogs) (542210) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:43,831::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:43,832::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:39:44,249::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:44,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155258 s, 66.0 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:39:44,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f1f1342-033f-4d0e-a35d-8b15869d217a`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:39:44,531::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:44,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:44,533::__init__::225::IOProcess::(_processLogs) (542211) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:39:44,533::__init__::225::IOProcess::(_processLogs) (542211) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:39:44,534::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542211) Building response >Thread-19::DEBUG::2014-08-11 17:39:44,534::__init__::225::IOProcess::(_processLogs) (542211) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:44,534::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:44,535::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:39:44,535::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:44,535::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:39:44,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:44,536::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:44,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:39:44,536::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:39:44,536::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:39:44,536::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f1f1342-033f-4d0e-a35d-8b15869d217a`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:39:44,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:39:44,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f1f1342-033f-4d0e-a35d-8b15869d217a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:39:44,537::__init__::225::IOProcess::(_processLogs) (542212) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:39:44,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:39:44,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:39:44,538::__init__::225::IOProcess::(_processLogs) (542212) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:39:44,538::task::993::Storage.TaskManager.Task::(_decref) Task=`3f1f1342-033f-4d0e-a35d-8b15869d217a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:44,539::__init__::225::IOProcess::(_processLogs) (542212) Building response >Thread-19::DEBUG::2014-08-11 17:39:44,539::__init__::225::IOProcess::(_processLogs) (542212) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:44,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:44,539::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:39:44,560::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:39:45,807::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:45,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:45,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:46,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:46,448::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0569685 s, 18.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:46,495::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:46,496::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:46,496::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:47,218::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:47,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2a3d830-d908-46c5-86de-9910b92efe4a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:47,219::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:39:47,269::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:47,269::task::1191::Storage.TaskManager.Task::(prepare) Task=`e2a3d830-d908-46c5-86de-9910b92efe4a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:47,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`e2a3d830-d908-46c5-86de-9910b92efe4a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:47,270::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:47,270::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:47,270::task::993::Storage.TaskManager.Task::(_decref) Task=`e2a3d830-d908-46c5-86de-9910b92efe4a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:39:47,281::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:39:47,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`c42051e8-e6e5-4f53-bfee-0ff6c1c634d5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:47,281::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:39:47,282::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0a9d0862-d6aa-4798-a823-07f2666bb7b1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:39:47,282::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:47,282::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:47,282::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0a9d0862-d6aa-4798-a823-07f2666bb7b1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:47,283::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c42051e8-e6e5-4f53-bfee-0ff6c1c634d5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:47,283::task::993::Storage.TaskManager.Task::(_decref) Task=`c42051e8-e6e5-4f53-bfee-0ff6c1c634d5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:39:47,300::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:47,300::task::1191::Storage.TaskManager.Task::(prepare) Task=`c42051e8-e6e5-4f53-bfee-0ff6c1c634d5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:47,300::task::595::Storage.TaskManager.Task::(_updateState) Task=`c42051e8-e6e5-4f53-bfee-0ff6c1c634d5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:39:47,300::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:39:47,300::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:39:47,300::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:39:47,301::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:39:47,301::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:39:47,301::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:39:47,301::task::993::Storage.TaskManager.Task::(_decref) Task=`c42051e8-e6e5-4f53-bfee-0ff6c1c634d5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:39:48,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:48,531::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144664 s, 70.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:48,602::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:48,603::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:48,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:48,603::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:48,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:48,604::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:39:48,604::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:48,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:48,663::__init__::225::IOProcess::(_processLogs) (542213) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:48,663::__init__::225::IOProcess::(_processLogs) (542213) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:48,664::__init__::225::IOProcess::(_processLogs) (542213) Building response >Thread-19::DEBUG::2014-08-11 17:39:48,664::__init__::225::IOProcess::(_processLogs) (542213) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:48,664::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:48,664::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:39:48,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00215459 s, 230 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:48,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:48,668::__init__::225::IOProcess::(_processLogs) (542214) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:48,668::__init__::225::IOProcess::(_processLogs) (542214) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:48,668::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542214) Building response >Thread-19::DEBUG::2014-08-11 17:39:48,668::__init__::225::IOProcess::(_processLogs) (542214) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:48,669::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:39:48,669::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:48,669::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:48,669::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:39:48,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) (542215) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) (542215) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:48,670::__init__::225::IOProcess::(_processLogs) (542215) Building response >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) (542215) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:48,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) (542216) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) (542216) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) (542216) Building response >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) (542216) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:48,672::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:39:48,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:48,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:48,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:48,673::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:48,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:48,674::__init__::225::IOProcess::(_processLogs) (542217) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:48,674::__init__::225::IOProcess::(_processLogs) (542217) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:48,674::__init__::225::IOProcess::(_processLogs) (542217) Building response >Thread-19::DEBUG::2014-08-11 17:39:48,674::__init__::225::IOProcess::(_processLogs) (542217) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:48,674::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:48,674::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:39:50,313::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:39:50,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:50,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125976 s, 81.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:39:50,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:50,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:50,838::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:51,501::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:51,502::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:51,502::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:52,618::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:52,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144413 s, 70.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:53,832::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) (542218) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) (542218) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) (542218) Building response >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) (542218) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:53,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:39:53,834::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:39:53,834::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:39:53,894::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000936832 s, 391 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:53,895::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:53,895::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:53,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:53,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:53,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:53,896::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:53,896::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:53,896::__init__::225::IOProcess::(_processLogs) (542219) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:53,896::__init__::225::IOProcess::(_processLogs) (542219) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:53,896::__init__::225::IOProcess::(_processLogs) DEBUG|(542219) Building response >Thread-19::DEBUG::2014-08-11 17:39:53,896::__init__::225::IOProcess::(_processLogs) (542219) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:53,897::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:53,897::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:39:54,609::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:39:54,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:54,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442525 s, 23.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:39:54,808::task::595::Storage.TaskManager.Task::(_updateState) Task=`17497a12-ef1f-42d0-89ca-3be4a59516d7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:54,809::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:39:54,809::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000936832', 'lastCheck': '0.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00215459', 'lastCheck': '6.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:54,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`17497a12-ef1f-42d0-89ca-3be4a59516d7`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000936832', 'lastCheck': '0.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00215459', 'lastCheck': '6.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:39:54,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`17497a12-ef1f-42d0-89ca-3be4a59516d7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:54,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:54,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:54,811::task::993::Storage.TaskManager.Task::(_decref) Task=`17497a12-ef1f-42d0-89ca-3be4a59516d7`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:39:54,835::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:39:54,835::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:55,841::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:55,842::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:39:55,842::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:56,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:56,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:39:56,509::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:39:56,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:56,936::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523073 s, 19.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:39:57,366::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:39:57,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`785e69bb-2387-4928-982b-164356626c47`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:39:57,367::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:39:57,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:57,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`785e69bb-2387-4928-982b-164356626c47`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:39:57,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`785e69bb-2387-4928-982b-164356626c47`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:39:57,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:39:57,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:39:57,387::task::993::Storage.TaskManager.Task::(_decref) Task=`785e69bb-2387-4928-982b-164356626c47`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:39:57,398::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:39:57,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`c912a8a8-eff9-4723-be36-84fe0abaf804`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:39:57,398::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:39:57,399::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`934e9e69-2209-4536-94b8-01f1c3b4f907`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:39:57,399::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:39:57,399::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:39:57,399::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`934e9e69-2209-4536-94b8-01f1c3b4f907`::Granted request >Thread-10197::DEBUG::2014-08-11 17:39:57,399::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c912a8a8-eff9-4723-be36-84fe0abaf804`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:39:57,399::task::993::Storage.TaskManager.Task::(_decref) Task=`c912a8a8-eff9-4723-be36-84fe0abaf804`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:39:57,415::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:57,416::task::1191::Storage.TaskManager.Task::(prepare) Task=`c912a8a8-eff9-4723-be36-84fe0abaf804`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:39:57,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`c912a8a8-eff9-4723-be36-84fe0abaf804`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:39:57,416::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:39:57,416::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:39:57,416::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:39:57,416::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:39:57,416::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:39:57,416::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:39:57,416::task::993::Storage.TaskManager.Task::(_decref) Task=`c912a8a8-eff9-4723-be36-84fe0abaf804`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:58,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:58,675::__init__::225::IOProcess::(_processLogs) (542220) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:58,675::__init__::225::IOProcess::(_processLogs) (542220) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:58,676::__init__::225::IOProcess::(_processLogs) DEBUG|(542220) Building response >Thread-19::DEBUG::2014-08-11 17:39:58,676::__init__::225::IOProcess::(_processLogs) (542220) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:58,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:58,677::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:39:58,677::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:39:58,739::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00111583 s, 444 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:58,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:58,741::__init__::225::IOProcess::(_processLogs) (542221) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:39:58,741::__init__::225::IOProcess::(_processLogs) (542221) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:39:58,741::__init__::225::IOProcess::(_processLogs) DEBUG|(542221) Building response >Thread-19::DEBUG::2014-08-11 17:39:58,741::__init__::225::IOProcess::(_processLogs) (542221) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:58,742::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) (542222) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) (542222) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) (542222) Building response >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) (542222) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:39:58,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) (542223) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) (542223) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) (542223) Building response >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) (542223) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:58,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) (542224) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:39:58,745::__init__::225::IOProcess::(_processLogs) (542224) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:39:58,746::__init__::225::IOProcess::(_processLogs) DEBUG|(542224) Building response >Thread-19::DEBUG::2014-08-11 17:39:58,746::__init__::225::IOProcess::(_processLogs) (542224) Queuing response >Thread-19::DEBUG::2014-08-11 17:39:58,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:39:58,746::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:39:58,944::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:39:59,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132353 s, 77.4 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:39:59,604::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:40:00,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:00,846::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:00,846::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:01,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:01,095::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121573 s, 84.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:01,514::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:01,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:01,515::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:40:02,327::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:40:03,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:03,197::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124879 s, 82.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:03,897::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) (542225) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:03,898::__init__::225::IOProcess::(_processLogs) (542225) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:03,899::__init__::225::IOProcess::(_processLogs) DEBUG|(542225) Building response >Thread-19::DEBUG::2014-08-11 17:40:03,899::__init__::225::IOProcess::(_processLogs) (542225) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:03,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:03,899::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:40:03,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:40:03,961::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00109997 s, 333 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:03,962::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:03,962::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:03,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:03,962::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:03,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:03,963::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:03,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:03,963::__init__::225::IOProcess::(_processLogs) (542226) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:03,963::__init__::225::IOProcess::(_processLogs) (542226) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:03,963::__init__::225::IOProcess::(_processLogs) DEBUG|(542226) Building response >Thread-19::DEBUG::2014-08-11 17:40:03,964::__init__::225::IOProcess::(_processLogs) (542226) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:03,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:03,964::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:40:05,209::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:05,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0387554 s, 26.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:40:05,849::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:05,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:05,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:06,521::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:06,521::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:06,521::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:07,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:07,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122585 s, 83.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:40:07,467::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:40:07,467::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ecb8834-abbc-4d28-a78e-d6595f27cc8c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:07,467::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:40:07,511::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:07,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ecb8834-abbc-4d28-a78e-d6595f27cc8c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:07,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ecb8834-abbc-4d28-a78e-d6595f27cc8c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:07,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:07,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:07,511::task::993::Storage.TaskManager.Task::(_decref) Task=`7ecb8834-abbc-4d28-a78e-d6595f27cc8c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:40:07,519::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:40:07,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`492121d7-47d1-48d4-897c-5a45f86f3271`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:40:07,520::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:40:07,520::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`73e74450-bf05-48ed-a745-c9baa123ba24`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:40:07,520::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:40:07,520::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:40:07,520::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`73e74450-bf05-48ed-a745-c9baa123ba24`::Granted request >Thread-10197::DEBUG::2014-08-11 17:40:07,521::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`492121d7-47d1-48d4-897c-5a45f86f3271`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:40:07,521::task::993::Storage.TaskManager.Task::(_decref) Task=`492121d7-47d1-48d4-897c-5a45f86f3271`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:40:07,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:07,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`492121d7-47d1-48d4-897c-5a45f86f3271`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:07,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`492121d7-47d1-48d4-897c-5a45f86f3271`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:40:07,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:40:07,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:40:07,538::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:40:07,538::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:40:07,538::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:40:07,538::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:40:07,538::task::993::Storage.TaskManager.Task::(_decref) Task=`492121d7-47d1-48d4-897c-5a45f86f3271`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:40:08,747::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:08,747::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:08,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:08,747::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:08,747::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:08,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:40:08,748::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:08,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:08,806::__init__::225::IOProcess::(_processLogs) (542227) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:08,807::__init__::225::IOProcess::(_processLogs) (542227) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:08,807::__init__::225::IOProcess::(_processLogs) (542227) Building response >Thread-19::DEBUG::2014-08-11 17:40:08,807::__init__::225::IOProcess::(_processLogs) (542227) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:08,807::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:08,807::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:40:08,807::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00079994 s, 619 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:08,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:08,808::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:08,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:08,808::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:08,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:08,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:08,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:08,809::__init__::225::IOProcess::(_processLogs) (542228) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:08,809::__init__::225::IOProcess::(_processLogs) (542228) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:08,809::__init__::225::IOProcess::(_processLogs) DEBUG|(542228) Building response >Thread-19::DEBUG::2014-08-11 17:40:08,809::__init__::225::IOProcess::(_processLogs) (542228) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:08,809::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) (542229) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:08,810::__init__::225::IOProcess::(_processLogs) (542229) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:08,813::__init__::225::IOProcess::(_processLogs) DEBUG|(542229) Building response >Thread-19::DEBUG::2014-08-11 17:40:08,813::__init__::225::IOProcess::(_processLogs) (542229) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:08,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:08,813::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:08,814::__init__::225::IOProcess::(_processLogs) (542230) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:08,815::__init__::225::IOProcess::(_processLogs) (542230) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:08,821::__init__::225::IOProcess::(_processLogs) DEBUG|(542230) Building response >Thread-19::DEBUG::2014-08-11 17:40:08,821::__init__::225::IOProcess::(_processLogs) (542230) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:08,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:08,822::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:08,822::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:08,822::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:40:08,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) (542231) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) (542231) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:08,823::__init__::225::IOProcess::(_processLogs) (542231) Building response >Thread-19::DEBUG::2014-08-11 17:40:08,824::__init__::225::IOProcess::(_processLogs) (542231) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:08,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:08,824::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:40:09,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:09,514::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0584033 s, 17.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:40:09,617::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:40:10,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce4bbc3-b277-467f-bf39-2aececc73ba4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:10,386::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:40:10,386::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109997', 'lastCheck': '6.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079994', 'lastCheck': '1.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:10,386::task::1191::Storage.TaskManager.Task::(prepare) Task=`dce4bbc3-b277-467f-bf39-2aececc73ba4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109997', 'lastCheck': '6.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00079994', 'lastCheck': '1.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:10,386::task::595::Storage.TaskManager.Task::(_updateState) Task=`dce4bbc3-b277-467f-bf39-2aececc73ba4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:10,386::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:10,386::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:10,387::task::993::Storage.TaskManager.Task::(_decref) Task=`dce4bbc3-b277-467f-bf39-2aececc73ba4`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:40:10,404::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:10,404::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:10,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:10,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:10,856::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:11,523::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:11,583::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:11,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:11,591::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:11,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626309 s, 16.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:40:13,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:13,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0529901 s, 19.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) (542232) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:13,965::__init__::225::IOProcess::(_processLogs) (542232) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:13,968::__init__::225::IOProcess::(_processLogs) DEBUG|(542232) Building response >Thread-19::DEBUG::2014-08-11 17:40:13,968::__init__::225::IOProcess::(_processLogs) (542232) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:13,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:13,968::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:40:13,968::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:40:14,027::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00044447 s, 823 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:14,028::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:14,028::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:14,028::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:14,028::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:14,028::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:14,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:14,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:14,029::__init__::225::IOProcess::(_processLogs) (542233) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:14,029::__init__::225::IOProcess::(_processLogs) (542233) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:14,030::__init__::225::IOProcess::(_processLogs) (542233) Building response >Thread-19::DEBUG::2014-08-11 17:40:14,030::__init__::225::IOProcess::(_processLogs) (542233) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:14,030::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:14,030::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:40:14,612::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:40:15,788::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:40:15,862::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:15,863::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:15,863::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:15,902::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055278 s, 18.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:16,598::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:16,598::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:16,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:17,592::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:40:17,592::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4a94996-9b32-4978-b3ec-1893b14a0f79`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:17,593::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:40:17,606::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:17,606::task::1191::Storage.TaskManager.Task::(prepare) Task=`a4a94996-9b32-4978-b3ec-1893b14a0f79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:17,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`a4a94996-9b32-4978-b3ec-1893b14a0f79`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:17,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:17,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:17,606::task::993::Storage.TaskManager.Task::(_decref) Task=`a4a94996-9b32-4978-b3ec-1893b14a0f79`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:40:17,617::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:40:17,617::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e8dbc13-d2c6-4213-afb9-30ac4840b021`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:40:17,618::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:40:17,618::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`97194d6c-2a53-43b1-9650-abeea4b76496`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:40:17,618::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:40:17,618::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:40:17,618::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`97194d6c-2a53-43b1-9650-abeea4b76496`::Granted request >Thread-10197::DEBUG::2014-08-11 17:40:17,618::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5e8dbc13-d2c6-4213-afb9-30ac4840b021`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:40:17,618::task::993::Storage.TaskManager.Task::(_decref) Task=`5e8dbc13-d2c6-4213-afb9-30ac4840b021`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:40:17,635::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:17,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`5e8dbc13-d2c6-4213-afb9-30ac4840b021`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:17,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`5e8dbc13-d2c6-4213-afb9-30ac4840b021`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:40:17,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:40:17,635::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:40:17,635::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:40:17,635::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:40:17,635::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:40:17,635::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:40:17,636::task::993::Storage.TaskManager.Task::(_decref) Task=`5e8dbc13-d2c6-4213-afb9-30ac4840b021`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:40:17,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:17,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0286707 s, 35.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:18,823::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) (542234) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) (542234) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:18,824::__init__::225::IOProcess::(_processLogs) (542234) Queuing response >Thread-28::DEBUG::2014-08-11 17:40:18,825::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:18,825::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:18,884::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:40:18,886::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00123446 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) (542235) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:18,887::__init__::225::IOProcess::(_processLogs) (542235) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:18,888::__init__::225::IOProcess::(_processLogs) (542235) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:18,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:18,888::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:40:18,888::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) (542236) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) (542236) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) (542236) Building response >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) (542236) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:18,889::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) (542237) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:18,890::__init__::225::IOProcess::(_processLogs) (542237) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) (542237) Building response >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) (542237) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:18,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) (542238) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) (542238) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) (542238) Building response >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) (542238) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:18,892::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:40:20,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:20,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0797142 s, 12.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:40:20,404::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:40:20,868::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:20,868::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:20,868::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:21,604::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:21,605::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:21,605::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:22,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:22,225::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124998 s, 81.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) (542239) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) (542239) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:24,030::__init__::225::IOProcess::(_processLogs) (542239) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:24,031::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:40:24,031::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:40:24,101::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0016519 s, 222 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:24,101::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:24,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:24,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:24,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:24,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:24,102::__init__::225::IOProcess::(_processLogs) (542240) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:24,102::__init__::225::IOProcess::(_processLogs) (542240) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:24,102::__init__::225::IOProcess::(_processLogs) (542240) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:24,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:24,103::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:40:24,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:24,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131852 s, 77.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:40:24,618::task::595::Storage.TaskManager.Task::(_updateState) Task=`65106455-5067-4f81-aa4e-17e9bb7975f2`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:40:24,619::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:40:24,619::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:40:24,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:24,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:24,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:24,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:24,620::__init__::225::IOProcess::(_processLogs) (542241) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:40:24,620::__init__::225::IOProcess::(_processLogs) (542241) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:40:24,624::__init__::225::IOProcess::(_processLogs) (542241) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:24,624::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:40:24,624::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:40:24,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:24,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:24,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:24,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::INFO::2014-08-11 17:40:24,625::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:40:24,626::__init__::225::IOProcess::(_processLogs) (542242) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:40:24,626::task::1191::Storage.TaskManager.Task::(prepare) Task=`65106455-5067-4f81-aa4e-17e9bb7975f2`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:40:24,626::__init__::225::IOProcess::(_processLogs) (542242) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:40:24,626::task::595::Storage.TaskManager.Task::(_updateState) Task=`65106455-5067-4f81-aa4e-17e9bb7975f2`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:40:24,627::__init__::225::IOProcess::(_processLogs) (542242) Building response >Thread-10017::DEBUG::2014-08-11 17:40:24,627::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:40:24,627::__init__::225::IOProcess::(_processLogs) (542242) Queuing response >Thread-10017::DEBUG::2014-08-11 17:40:24,627::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:40:24,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:40:24,628::task::993::Storage.TaskManager.Task::(_decref) Task=`65106455-5067-4f81-aa4e-17e9bb7975f2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:40:24,628::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:40:24,648::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:40:25,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b4e1462-32a5-4871-ad2e-0759d84ae4f5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:25,608::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:40:25,608::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0016519', 'lastCheck': '1.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123446', 'lastCheck': '6.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:25,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b4e1462-32a5-4871-ad2e-0759d84ae4f5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0016519', 'lastCheck': '1.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123446', 'lastCheck': '6.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:25,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b4e1462-32a5-4871-ad2e-0759d84ae4f5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:25,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:25,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:25,608::task::993::Storage.TaskManager.Task::(_decref) Task=`0b4e1462-32a5-4871-ad2e-0759d84ae4f5`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:40:25,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:25,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:25,874::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:25,874::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:25,875::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:26,313::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:26,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123438 s, 83.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:26,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:26,611::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:26,612::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:27,735::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:40:27,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`553cf670-3938-482d-b22c-e245d9191a7b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:27,736::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:40:27,757::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:27,757::task::1191::Storage.TaskManager.Task::(prepare) Task=`553cf670-3938-482d-b22c-e245d9191a7b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:27,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`553cf670-3938-482d-b22c-e245d9191a7b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:27,757::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:27,757::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:27,757::task::993::Storage.TaskManager.Task::(_decref) Task=`553cf670-3938-482d-b22c-e245d9191a7b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:40:27,769::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:40:27,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`309bb848-e944-420e-b0fc-a8fdcf5b63a3`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:40:27,769::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:40:27,769::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cc8e9863-5e07-4487-b147-092ca527a184`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:40:27,769::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:40:27,770::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:40:27,770::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cc8e9863-5e07-4487-b147-092ca527a184`::Granted request >Thread-10197::DEBUG::2014-08-11 17:40:27,770::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`309bb848-e944-420e-b0fc-a8fdcf5b63a3`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:40:27,770::task::993::Storage.TaskManager.Task::(_decref) Task=`309bb848-e944-420e-b0fc-a8fdcf5b63a3`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:40:27,815::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:27,815::task::1191::Storage.TaskManager.Task::(prepare) Task=`309bb848-e944-420e-b0fc-a8fdcf5b63a3`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:27,815::task::595::Storage.TaskManager.Task::(_updateState) Task=`309bb848-e944-420e-b0fc-a8fdcf5b63a3`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:40:27,815::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:40:27,816::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:40:27,816::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:40:27,816::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:40:27,816::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:40:27,816::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:40:27,816::task::993::Storage.TaskManager.Task::(_decref) Task=`309bb848-e944-420e-b0fc-a8fdcf5b63a3`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:40:28,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:28,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0392923 s, 26.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:28,892::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:28,892::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) (542243) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) (542243) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) (542243) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:28,893::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:40:28,894::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:40:28,969::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00525633 s, 94.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:28,970::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:28,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:28,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:28,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:28,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:28,971::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:28,971::__init__::225::IOProcess::(_processLogs) (542244) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:28,971::__init__::225::IOProcess::(_processLogs) (542244) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:28,971::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542244) Building response >Thread-19::DEBUG::2014-08-11 17:40:28,971::__init__::225::IOProcess::(_processLogs) (542244) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:28,972::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:40:28,972::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:40:28,972::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) (542245) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:28,973::__init__::225::IOProcess::(_processLogs) (542245) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) (542245) Building response >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) (542245) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:28,974::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) (542246) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) (542246) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) (542246) Building response >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) (542246) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:28,975::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:28,976::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:40:28,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:28,976::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:28,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:28,976::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:28,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:28,977::__init__::225::IOProcess::(_processLogs) (542247) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:28,977::__init__::225::IOProcess::(_processLogs) (542247) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:28,977::__init__::225::IOProcess::(_processLogs) (542247) Building response >Thread-19::DEBUG::2014-08-11 17:40:28,977::__init__::225::IOProcess::(_processLogs) (542247) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:28,977::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:28,977::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:40:29,620::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:40:30,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:30,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508252 s, 20.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:40:30,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:30,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:30,881::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:31,617::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:31,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:31,618::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:40:32,455::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:40:32,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:32,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0157838 s, 64.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:34,103::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) (542248) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:34,104::__init__::225::IOProcess::(_processLogs) (542248) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:34,105::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542248) Building response >Thread-19::DEBUG::2014-08-11 17:40:34,105::__init__::225::IOProcess::(_processLogs) (542248) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:34,105::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:40:34,106::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:40:34,106::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:40:34,168::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00157733 s, 232 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:34,168::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:34,168::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:34,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:34,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:34,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:34,169::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:34,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:34,169::__init__::225::IOProcess::(_processLogs) (542249) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:34,169::__init__::225::IOProcess::(_processLogs) (542249) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:34,170::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542249) Building response >Thread-19::DEBUG::2014-08-11 17:40:34,170::__init__::225::IOProcess::(_processLogs) (542249) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:34,170::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:40:34,170::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:40:34,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:34,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0138235 s, 74.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:40:35,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:35,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:35,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:36,624::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:36,624::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:36,625::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:36,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:36,915::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0719847 s, 14.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:40:37,876::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:40:37,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`052f2a5b-c5e0-47a5-897b-072620e113bb`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:37,877::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Detector thread::DEBUG::2014-08-11 17:40:37,894::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.1.234:46060 >Detector thread::DEBUG::2014-08-11 17:40:37,895::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.1.234:46060 >Detector thread::DEBUG::2014-08-11 17:40:37,895::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.1.234:46060 >Detector thread::DEBUG::2014-08-11 17:40:37,895::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.1.234', 46060) >Thread-10237::INFO::2014-08-11 17:40:37,897::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:37,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`052f2a5b-c5e0-47a5-897b-072620e113bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:37,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`052f2a5b-c5e0-47a5-897b-072620e113bb`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:37,897::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:37,897::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:37,897::task::993::Storage.TaskManager.Task::(_decref) Task=`052f2a5b-c5e0-47a5-897b-072620e113bb`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:40:37,903::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:40:37,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`a377f4df-6a34-4a1f-9ae8-8fd2ba77e5df`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:40:37,904::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:40:37,904::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`28d3c300-36b6-4d15-bde6-4c2a9195b03a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:40:37,904::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:40:37,904::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:40:37,904::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`28d3c300-36b6-4d15-bde6-4c2a9195b03a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:40:37,904::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a377f4df-6a34-4a1f-9ae8-8fd2ba77e5df`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:40:37,904::task::993::Storage.TaskManager.Task::(_decref) Task=`a377f4df-6a34-4a1f-9ae8-8fd2ba77e5df`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:40:37,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:37,923::task::1191::Storage.TaskManager.Task::(prepare) Task=`a377f4df-6a34-4a1f-9ae8-8fd2ba77e5df`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:37,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`a377f4df-6a34-4a1f-9ae8-8fd2ba77e5df`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:40:37,923::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:40:37,923::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:40:37,924::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:40:37,924::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:40:37,924::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:40:37,924::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:40:37,924::task::993::Storage.TaskManager.Task::(_decref) Task=`a377f4df-6a34-4a1f-9ae8-8fd2ba77e5df`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:40:38,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:38,982::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:38,982::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:38,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:38,982::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:38,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:38,983::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:38,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-28::DEBUG::2014-08-11 17:40:38,983::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:38,984::__init__::225::IOProcess::(_processLogs) (542250) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:39,043::__init__::225::IOProcess::(_processLogs) (542250) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:39,044::__init__::225::IOProcess::(_processLogs) (542250) Building response >Thread-19::DEBUG::2014-08-11 17:40:39,044::__init__::225::IOProcess::(_processLogs) (542250) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:39,045::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:39,045::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:40:39,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0645581 s, 15.9 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:40:39,048::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00262404 s, 189 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:39,049::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:39,050::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:39,050::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:39,051::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:39,051::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:39,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:39,053::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:39,054::__init__::225::IOProcess::(_processLogs) (542251) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:39,054::__init__::225::IOProcess::(_processLogs) (542251) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:39,055::__init__::225::IOProcess::(_processLogs) (542251) Building response >Thread-19::DEBUG::2014-08-11 17:40:39,055::__init__::225::IOProcess::(_processLogs) (542251) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:39,056::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:39,056::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:40:39,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:39,057::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:40:39,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:39,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:39,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:39,060::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:39,060::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:39,061::__init__::225::IOProcess::(_processLogs) (542252) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:39,061::__init__::225::IOProcess::(_processLogs) (542252) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:39,062::__init__::225::IOProcess::(_processLogs) (542252) Building response >Thread-19::DEBUG::2014-08-11 17:40:39,062::__init__::225::IOProcess::(_processLogs) (542252) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:39,063::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:39,063::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:39,064::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:39,065::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:40:39,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:39,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:39,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:39,066::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:39,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:39,067::__init__::225::IOProcess::(_processLogs) (542253) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:39,068::__init__::225::IOProcess::(_processLogs) (542253) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:39,069::__init__::225::IOProcess::(_processLogs) (542253) Building response >Thread-19::DEBUG::2014-08-11 17:40:39,069::__init__::225::IOProcess::(_processLogs) (542253) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:39,070::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:39,070::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:39,071::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:39,071::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:40:39,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:39,072::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:39,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:39,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:39,074::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:39,074::__init__::225::IOProcess::(_processLogs) (542254) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:39,074::__init__::225::IOProcess::(_processLogs) (542254) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:39,075::__init__::225::IOProcess::(_processLogs) (542254) Building response >Thread-19::DEBUG::2014-08-11 17:40:39,075::__init__::225::IOProcess::(_processLogs) (542254) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:39,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:39,077::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:40:39,686::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:40:40,887::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:40,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:40,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:40,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4f48656-2951-4c89-8dd0-5b4a4ea29127`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:40,906::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:40:40,906::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157733', 'lastCheck': '6.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00262404', 'lastCheck': '1.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:40,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`e4f48656-2951-4c89-8dd0-5b4a4ea29127`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00157733', 'lastCheck': '6.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00262404', 'lastCheck': '1.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:40,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`e4f48656-2951-4c89-8dd0-5b4a4ea29127`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:40,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:40,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:40,906::task::993::Storage.TaskManager.Task::(_decref) Task=`e4f48656-2951-4c89-8dd0-5b4a4ea29127`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:40:40,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:40,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:41,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:41,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0648066 s, 15.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:41,630::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:41,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:41,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:43,214::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:43,362::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0243782 s, 42.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:44,171::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:44,171::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:44,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) (542255) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) (542255) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542255) Building response >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) (542255) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:44,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:44,173::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:40:44,173::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:40:44,232::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000622038 s, 588 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:44,233::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:44,233::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:44,233::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:44,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:44,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:44,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:44,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:44,234::__init__::225::IOProcess::(_processLogs) (542256) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:44,234::__init__::225::IOProcess::(_processLogs) (542256) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:44,234::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542256) Building response >Thread-19::DEBUG::2014-08-11 17:40:44,234::__init__::225::IOProcess::(_processLogs) (542256) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:44,235::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:44,235::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:40:44,681::task::595::Storage.TaskManager.Task::(_updateState) Task=`a960deeb-04a8-4603-9fae-bd6118f17868`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:40:44,681::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:40:44,681::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) (542257) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:40:44,682::__init__::225::IOProcess::(_processLogs) (542257) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:40:44,683::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542257) Building response >Thread-19::DEBUG::2014-08-11 17:40:44,683::__init__::225::IOProcess::(_processLogs) (542257) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:44,683::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:40:44,684::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:40:44,684::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:44,685::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:40:44,685::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Marshaling message... >Thread-10102::INFO::2014-08-11 17:40:44,685::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:40:44,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:40:44,686::task::1191::Storage.TaskManager.Task::(prepare) Task=`a960deeb-04a8-4603-9fae-bd6118f17868`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:40:44,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:40:44,686::task::595::Storage.TaskManager.Task::(_updateState) Task=`a960deeb-04a8-4603-9fae-bd6118f17868`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:40:44,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:40:44,687::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10102::DEBUG::2014-08-11 17:40:44,687::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:40:44,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:40:44,688::task::993::Storage.TaskManager.Task::(_decref) Task=`a960deeb-04a8-4603-9fae-bd6118f17868`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:40:44,688::__init__::225::IOProcess::(_processLogs) (542258) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:40:44,688::__init__::225::IOProcess::(_processLogs) (542258) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:40:44,688::__init__::225::IOProcess::(_processLogs) (542258) Building response >Thread-19::DEBUG::2014-08-11 17:40:44,689::__init__::225::IOProcess::(_processLogs) (542258) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:44,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:44,689::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:40:44,707::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:40:45,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:45,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0231914 s, 44.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:40:45,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:45,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:45,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:46,637::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:46,637::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:46,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:47,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:47,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130783 s, 78.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:40:47,972::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:40:47,972::task::595::Storage.TaskManager.Task::(_updateState) Task=`aee3cc4d-c1d3-4308-b4a2-291e6397e3e7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:47,972::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:40:48,046::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:48,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`aee3cc4d-c1d3-4308-b4a2-291e6397e3e7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:48,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`aee3cc4d-c1d3-4308-b4a2-291e6397e3e7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:48,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:48,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:48,047::task::993::Storage.TaskManager.Task::(_decref) Task=`aee3cc4d-c1d3-4308-b4a2-291e6397e3e7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:40:48,058::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:40:48,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`24452265-33ee-407d-805a-4983f6a1208e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:40:48,058::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:40:48,059::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`787bd4eb-5a16-4e24-b6a1-eb0cc708877e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:40:48,059::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:40:48,059::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:40:48,059::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`787bd4eb-5a16-4e24-b6a1-eb0cc708877e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:40:48,059::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`24452265-33ee-407d-805a-4983f6a1208e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:40:48,059::task::993::Storage.TaskManager.Task::(_decref) Task=`24452265-33ee-407d-805a-4983f6a1208e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:40:48,075::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:48,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`24452265-33ee-407d-805a-4983f6a1208e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:48,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`24452265-33ee-407d-805a-4983f6a1208e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:40:48,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:40:48,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:40:48,076::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:40:48,076::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:40:48,076::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:40:48,076::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:40:48,076::task::993::Storage.TaskManager.Task::(_decref) Task=`24452265-33ee-407d-805a-4983f6a1208e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) (542259) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:49,078::__init__::225::IOProcess::(_processLogs) (542259) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:49,079::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542259) Building response >Thread-28::DEBUG::2014-08-11 17:40:49,079::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:49,079::__init__::225::IOProcess::(_processLogs) (542259) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:49,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:49,138::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:40:49,139::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000808283 s, 612 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:49,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:49,141::__init__::225::IOProcess::(_processLogs) (542260) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:49,141::__init__::225::IOProcess::(_processLogs) (542260) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:49,141::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542260) Building response >Thread-19::DEBUG::2014-08-11 17:40:49,141::__init__::225::IOProcess::(_processLogs) (542260) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:49,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) (542261) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) (542261) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) (542261) Building response >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) (542261) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:49,143::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) (542262) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) (542262) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:49,144::__init__::225::IOProcess::(_processLogs) (542262) Building response >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) (542262) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:49,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) (542263) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) (542263) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) (542263) Building response >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) (542263) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:49,146::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:40:49,539::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:49,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0223466 s, 45.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:40:50,519::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:40:50,897::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:50,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:50,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:51,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:51,687::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:51,690::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:51,692::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:51,698::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123085 s, 83.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:40:53,706::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:53,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0817511 s, 12.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:54,235::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) (542264) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) (542264) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:54,236::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542264) Building response >Thread-19::DEBUG::2014-08-11 17:40:54,237::__init__::225::IOProcess::(_processLogs) (542264) Queuing response >Thread-27::DEBUG::2014-08-11 17:40:54,237::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:54,237::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:54,296::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:40:54,297::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000650233 s, 563 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) (542265) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) (542265) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:54,298::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542265) Building response >Thread-19::DEBUG::2014-08-11 17:40:54,299::__init__::225::IOProcess::(_processLogs) (542265) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:54,299::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:40:54,299::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:40:54,694::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:40:55,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:40:55,914::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:55,915::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:40:55,915::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:55,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549876 s, 18.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:40:56,140::task::595::Storage.TaskManager.Task::(_updateState) Task=`49a6cc55-1f44-4e2d-93b4-a9155e707f81`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:56,140::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:40:56,141::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650233', 'lastCheck': '1.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808283', 'lastCheck': '7.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:56,141::task::1191::Storage.TaskManager.Task::(prepare) Task=`49a6cc55-1f44-4e2d-93b4-a9155e707f81`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000650233', 'lastCheck': '1.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000808283', 'lastCheck': '7.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:40:56,141::task::595::Storage.TaskManager.Task::(_updateState) Task=`49a6cc55-1f44-4e2d-93b4-a9155e707f81`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:56,141::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:56,141::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:56,141::task::993::Storage.TaskManager.Task::(_decref) Task=`49a6cc55-1f44-4e2d-93b4-a9155e707f81`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:40:56,357::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:40:56,358::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:56,698::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:56,698::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:40:56,699::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:40:57,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:40:58,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0577048 s, 17.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:40:58,137::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:40:58,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9739a3d-99eb-4fad-8e72-134742357d19`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:40:58,137::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:40:58,151::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:58,151::task::1191::Storage.TaskManager.Task::(prepare) Task=`b9739a3d-99eb-4fad-8e72-134742357d19`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:40:58,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`b9739a3d-99eb-4fad-8e72-134742357d19`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:40:58,151::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:40:58,151::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:40:58,152::task::993::Storage.TaskManager.Task::(_decref) Task=`b9739a3d-99eb-4fad-8e72-134742357d19`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:40:58,162::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:40:58,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`70f7deb3-4d0e-4680-9293-f57f505a93e2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:40:58,162::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:40:58,162::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8ef12bf8-17f8-47f2-88da-2fc65d241203`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:40:58,162::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:40:58,163::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:40:58,163::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8ef12bf8-17f8-47f2-88da-2fc65d241203`::Granted request >Thread-10197::DEBUG::2014-08-11 17:40:58,163::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`70f7deb3-4d0e-4680-9293-f57f505a93e2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:40:58,163::task::993::Storage.TaskManager.Task::(_decref) Task=`70f7deb3-4d0e-4680-9293-f57f505a93e2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:40:58,179::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:58,179::task::1191::Storage.TaskManager.Task::(prepare) Task=`70f7deb3-4d0e-4680-9293-f57f505a93e2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:40:58,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`70f7deb3-4d0e-4680-9293-f57f505a93e2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:40:58,180::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:40:58,180::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:40:58,180::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:40:58,180::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:40:58,180::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:40:58,180::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:40:58,180::task::993::Storage.TaskManager.Task::(_decref) Task=`70f7deb3-4d0e-4680-9293-f57f505a93e2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:40:59,146::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:59,146::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) (542266) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:59,147::__init__::225::IOProcess::(_processLogs) (542266) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:59,150::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|(542266) Building response >Thread-19::DEBUG::2014-08-11 17:40:59,150::__init__::225::IOProcess::(_processLogs) (542266) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:59,150::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:40:59,151::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:40:59,151::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:40:59,211::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000385163 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) (542253) Building responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) (542267) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:40:59,212::__init__::225::IOProcess::(_processLogs) (542267) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:40:59,213::__init__::225::IOProcess::(_processLogs) (542267) Building response >Thread-19::DEBUG::2014-08-11 17:40:59,213::__init__::225::IOProcess::(_processLogs) (542267) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:59,213::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:59,213::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:40:59,214::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:59,214::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:40:59,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:59,214::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:59,214::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) (542268) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) (542268) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) (542268) Building response >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) (542268) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:59,215::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:40:59,216::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:59,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:59,216::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:59,216::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:59,216::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:59,216::__init__::225::IOProcess::(_processLogs) (542269) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) (542269) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) (542269) Building response >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) (542269) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:40:59,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:40:59,218::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:40:59,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:40:59,218::__init__::225::IOProcess::(_processLogs) (542270) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:40:59,219::__init__::225::IOProcess::(_processLogs) (542270) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:40:59,219::__init__::225::IOProcess::(_processLogs) (542270) Building response >Thread-19::DEBUG::2014-08-11 17:40:59,219::__init__::225::IOProcess::(_processLogs) (542270) Queuing response >Thread-19::DEBUG::2014-08-11 17:40:59,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:40:59,219::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:40:59,739::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:41:00,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:00,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0415449 s, 24.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:00,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:00,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:00,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:01,705::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:01,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:01,710::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:02,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:02,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0670078 s, 15.3 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:41:02,544::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-27::DEBUG::2014-08-11 17:41:04,300::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:41:04,301::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,301::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) DEBUG|(542271) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) (542271) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) (542271) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) (542271) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:04,302::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,303::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,304::__init__::225::IOProcess::(_processLogs) (542272) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:41:04,304::__init__::225::IOProcess::(_processLogs) (542272) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:41:04,304::__init__::225::IOProcess::(_processLogs) DEBUG|(542272) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,304::__init__::225::IOProcess::(_processLogs) (542272) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:04,306::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:41:04,309::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) (542273) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:41:04,310::__init__::225::IOProcess::(_processLogs) (542273) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:41:04,321::__init__::225::IOProcess::(_processLogs) DEBUG|(542273) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,321::__init__::225::IOProcess::(_processLogs) (542273) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,322::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:41:04,322::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:41:04,322::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) (542274) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:41:04,323::__init__::225::IOProcess::(_processLogs) (542274) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:41:04,325::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542274) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,325::__init__::225::IOProcess::(_processLogs) (542274) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,325::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:41:04,325::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:41:04,326::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-19::DEBUG::2014-08-11 17:41:04,326::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,326::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) (542275) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:04,327::__init__::225::IOProcess::(_processLogs) (542275) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) (542275) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) (542275) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,329::__init__::225::IOProcess::(_processLogs) (542276) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:41:04,329::__init__::225::IOProcess::(_processLogs) (542276) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:41:04,332::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542276) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,332::__init__::225::IOProcess::(_processLogs) (542276) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,333::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:04,333::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-27::DEBUG::2014-08-11 17:41:04,333::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-27::INFO::2014-08-11 17:41:04,333::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-27::INFO::2014-08-11 17:41:04,333::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:41:04,333::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,333::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:04,333::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) (542277) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) (542277) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:04,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542277) Building response >Thread-27::DEBUG::2014-08-11 17:41:04,335::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:41:04,335::__init__::225::IOProcess::(_processLogs) (542277) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:04,393::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:41:04,395::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000769227 s, 476 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:04,396::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:04,396::__init__::225::IOProcess::(_processLogs) Message size is 182 >Dummy-51::DEBUG::2014-08-11 17:41:04,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:41:04,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:04,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:04,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:04,457::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:04,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:04,457::__init__::225::IOProcess::(_processLogs) (542278) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:04,458::__init__::225::IOProcess::(_processLogs) (542278) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:04,458::__init__::225::IOProcess::(_processLogs) (542278) Building response >Thread-19::DEBUG::2014-08-11 17:41:04,458::__init__::225::IOProcess::(_processLogs) (542278) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:04,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:04,458::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:41:04,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126519 s, 80.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:05,926::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:05,927::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:05,927::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:06,505::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:06,576::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128229 s, 79.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:06,718::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:06,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:06,719::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:08,240::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:41:08,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`165b77ff-5260-4369-9ea6-ab4c4535e213`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:08,242::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:41:08,282::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:08,282::task::1191::Storage.TaskManager.Task::(prepare) Task=`165b77ff-5260-4369-9ea6-ab4c4535e213`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:08,282::task::595::Storage.TaskManager.Task::(_updateState) Task=`165b77ff-5260-4369-9ea6-ab4c4535e213`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:08,282::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:08,282::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:08,282::task::993::Storage.TaskManager.Task::(_decref) Task=`165b77ff-5260-4369-9ea6-ab4c4535e213`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:41:08,288::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:41:08,289::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e131d39-2a6a-44d0-bcb5-80cb8c79b45e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:41:08,289::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:41:08,289::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5c708b2b-5116-4594-bb5d-4e4e840e2636`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:41:08,289::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:41:08,289::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:41:08,289::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5c708b2b-5116-4594-bb5d-4e4e840e2636`::Granted request >Thread-10197::DEBUG::2014-08-11 17:41:08,290::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7e131d39-2a6a-44d0-bcb5-80cb8c79b45e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:41:08,290::task::993::Storage.TaskManager.Task::(_decref) Task=`7e131d39-2a6a-44d0-bcb5-80cb8c79b45e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:41:08,306::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:08,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`7e131d39-2a6a-44d0-bcb5-80cb8c79b45e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:08,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`7e131d39-2a6a-44d0-bcb5-80cb8c79b45e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:41:08,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:41:08,306::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:41:08,306::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:41:08,306::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:41:08,307::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:41:08,307::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:41:08,307::task::993::Storage.TaskManager.Task::(_decref) Task=`7e131d39-2a6a-44d0-bcb5-80cb8c79b45e`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:41:08,584::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:08,692::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049768 s, 20.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:09,219::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:09,219::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:09,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:09,219::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:09,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:09,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:09,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:09,220::__init__::225::IOProcess::(_processLogs) (542279) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:09,220::__init__::225::IOProcess::(_processLogs) (542279) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:09,220::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542279) Building response >Thread-28::DEBUG::2014-08-11 17:41:09,221::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:41:09,221::__init__::225::IOProcess::(_processLogs) (542279) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:09,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:09,280::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:41:09,281::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000389519 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:09,281::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:09,281::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:09,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:09,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:09,281::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:09,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:09,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:09,282::__init__::225::IOProcess::(_processLogs) (542280) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:09,282::__init__::225::IOProcess::(_processLogs) (542280) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:09,282::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542280) Building response >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) (542280) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:09,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) (542281) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) (542281) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) (542281) Building response >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) (542281) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:09,284::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) (542282) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:09,285::__init__::225::IOProcess::(_processLogs) (542282) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:09,286::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542282) Building response >Thread-19::DEBUG::2014-08-11 17:41:09,286::__init__::225::IOProcess::(_processLogs) (542282) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:09,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:09,286::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:09,286::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:09,286::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:41:09,287::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:09,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:09,287::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) (542283) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) (542283) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) (542283) Building response >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) (542283) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:09,288::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:41:09,702::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:41:10,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:10,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143529 s, 71.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:10,929::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:10,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:10,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:11,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a5fc808-ae09-431f-83dd-4dcf66b81549`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:11,537::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:41:11,537::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769227', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389519', 'lastCheck': '2.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:11,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`7a5fc808-ae09-431f-83dd-4dcf66b81549`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000769227', 'lastCheck': '7.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000389519', 'lastCheck': '2.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:11,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`7a5fc808-ae09-431f-83dd-4dcf66b81549`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:11,537::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:11,537::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:11,537::task::993::Storage.TaskManager.Task::(_decref) Task=`7a5fc808-ae09-431f-83dd-4dcf66b81549`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:41:11,551::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:11,551::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:11,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:11,725::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:11,726::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:12,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:12,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0547706 s, 18.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:14,458::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:14,458::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:14,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:14,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:14,458::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:14,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:14,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:14,459::__init__::225::IOProcess::(_processLogs) (542284) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:14,459::__init__::225::IOProcess::(_processLogs) (542284) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:14,460::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542284) Building response >Thread-19::DEBUG::2014-08-11 17:41:14,460::__init__::225::IOProcess::(_processLogs) (542284) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:14,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:14,460::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:41:14,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:41:14,521::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00134317 s, 272 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) (542285) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:14,522::__init__::225::IOProcess::(_processLogs) (542285) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:14,523::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542285) Building response >Thread-19::DEBUG::2014-08-11 17:41:14,523::__init__::225::IOProcess::(_processLogs) (542285) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:14,524::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:14,524::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:41:14,765::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:41:14,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:15,001::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038974 s, 26.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:15,936::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:15,937::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:15,937::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:16,731::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:16,732::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:16,732::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:17,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:17,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128412 s, 79.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:41:18,355::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:41:18,356::task::595::Storage.TaskManager.Task::(_updateState) Task=`eed3437c-39c2-43e8-99d8-764999f0f8a8`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:18,356::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:41:18,370::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:18,370::task::1191::Storage.TaskManager.Task::(prepare) Task=`eed3437c-39c2-43e8-99d8-764999f0f8a8`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:18,370::task::595::Storage.TaskManager.Task::(_updateState) Task=`eed3437c-39c2-43e8-99d8-764999f0f8a8`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:18,370::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:18,370::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:18,371::task::993::Storage.TaskManager.Task::(_decref) Task=`eed3437c-39c2-43e8-99d8-764999f0f8a8`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:41:18,382::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:41:18,382::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fc2da9f-26a8-4b85-8758-2167340fd7f1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:41:18,382::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:41:18,382::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c68adad5-3af6-4d04-bc45-ae7e6ff6ad65`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:41:18,382::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:41:18,383::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:41:18,383::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c68adad5-3af6-4d04-bc45-ae7e6ff6ad65`::Granted request >Thread-10197::DEBUG::2014-08-11 17:41:18,383::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6fc2da9f-26a8-4b85-8758-2167340fd7f1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:41:18,383::task::993::Storage.TaskManager.Task::(_decref) Task=`6fc2da9f-26a8-4b85-8758-2167340fd7f1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:41:18,400::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:18,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`6fc2da9f-26a8-4b85-8758-2167340fd7f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:18,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`6fc2da9f-26a8-4b85-8758-2167340fd7f1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:41:18,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:41:18,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:41:18,400::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:41:18,400::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:41:18,401::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:41:18,401::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:41:18,401::task::993::Storage.TaskManager.Task::(_decref) Task=`6fc2da9f-26a8-4b85-8758-2167340fd7f1`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:41:19,089::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:19,210::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.061661 s, 16.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:19,289::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:19,289::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:19,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:19,289::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:19,289::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:19,289::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:19,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:19,290::__init__::225::IOProcess::(_processLogs) (542286) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:19,290::__init__::225::IOProcess::(_processLogs) (542286) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:19,290::__init__::225::IOProcess::(_processLogs) (542286) Queuing response >Thread-28::DEBUG::2014-08-11 17:41:19,291::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:41:19,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:19,407::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:41:19,409::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000851566 s, 581 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:19,409::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:19,409::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:19,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:19,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:19,410::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:19,410::__init__::225::IOProcess::(_processLogs) (542287) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:19,410::__init__::225::IOProcess::(_processLogs) (542287) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:19,410::__init__::225::IOProcess::(_processLogs) (542287) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:19,410::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:41:19,411::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:41:19,411::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:19,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:19,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:19,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:19,411::__init__::225::IOProcess::(_processLogs) (542288) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) (542288) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) (542288) Building response >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) (542288) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:19,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) (542289) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) (542289) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) (542289) Building response >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) (542289) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:19,413::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:19,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:19,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:19,414::__init__::225::IOProcess::(_processLogs) (542290) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:19,414::__init__::225::IOProcess::(_processLogs) (542290) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:19,414::__init__::225::IOProcess::(_processLogs) (542290) Building response >Thread-19::DEBUG::2014-08-11 17:41:19,414::__init__::225::IOProcess::(_processLogs) (542290) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:19,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:19,415::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:41:20,576::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:41:20,941::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:20,941::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:20,942::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:21,218::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:21,293::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0164034 s, 62.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:21,738::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:21,738::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:21,739::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:23,301::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:23,393::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0323344 s, 31.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) (542291) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:24,525::__init__::225::IOProcess::(_processLogs) (542291) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:24,527::__init__::225::IOProcess::(_processLogs) (542291) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:24,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:41:24,527::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:41:24,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00626163 s, 58.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:24,671::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:24,672::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:24,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:24,672::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:24,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:24,672::__init__::225::IOProcess::(_processLogs) (542292) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:24,672::__init__::225::IOProcess::(_processLogs) (542292) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:24,687::__init__::225::IOProcess::(_processLogs) (542292) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:24,688::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:41:24,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a8ce4d9-d80f-48b6-a231-61c3fc1c9e7f`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:41:24,761::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) (542293) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:41:24,762::__init__::225::IOProcess::(_processLogs) (542293) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:41:24,786::__init__::225::IOProcess::(_processLogs) (542293) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:24,787::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:24,787::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:41:24,787::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:41:24,787::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:24,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:24,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:24,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::INFO::2014-08-11 17:41:24,788::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:41:24,788::__init__::225::IOProcess::(_processLogs) (542294) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:41:24,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a8ce4d9-d80f-48b6-a231-61c3fc1c9e7f`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:41:24,789::__init__::225::IOProcess::(_processLogs) (542294) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:41:24,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a8ce4d9-d80f-48b6-a231-61c3fc1c9e7f`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:41:24,789::__init__::225::IOProcess::(_processLogs) (542294) Building response >Thread-10017::DEBUG::2014-08-11 17:41:24,790::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:41:24,790::__init__::225::IOProcess::(_processLogs) (542294) Queuing response >Thread-10017::DEBUG::2014-08-11 17:41:24,790::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:41:24,790::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10017::DEBUG::2014-08-11 17:41:24,791::task::993::Storage.TaskManager.Task::(_decref) Task=`1a8ce4d9-d80f-48b6-a231-61c3fc1c9e7f`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:41:24,791::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:41:24,811::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:41:25,401::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:25,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132657 s, 77.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:25,947::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:25,948::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:25,948::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:26,744::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:26,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:26,745::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:26,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd054ccc-15e0-4f76-ba4a-7b6dd5d62ae4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:26,821::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:41:26,821::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00626163', 'lastCheck': '2.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000851566', 'lastCheck': '7.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:26,822::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd054ccc-15e0-4f76-ba4a-7b6dd5d62ae4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00626163', 'lastCheck': '2.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000851566', 'lastCheck': '7.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:26,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd054ccc-15e0-4f76-ba4a-7b6dd5d62ae4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:26,822::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:26,822::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:26,822::task::993::Storage.TaskManager.Task::(_decref) Task=`cd054ccc-15e0-4f76-ba4a-7b6dd5d62ae4`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:41:26,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:26,836::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:27,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:27,552::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142384 s, 71.9 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:41:28,493::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:41:28,493::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a03fc64-a8dc-4aae-b686-c990f5cf723e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:28,493::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:41:28,518::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:28,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a03fc64-a8dc-4aae-b686-c990f5cf723e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:28,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a03fc64-a8dc-4aae-b686-c990f5cf723e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:28,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:28,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:28,519::task::993::Storage.TaskManager.Task::(_decref) Task=`9a03fc64-a8dc-4aae-b686-c990f5cf723e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:41:28,525::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:41:28,525::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcb903aa-d21b-4271-af4b-fa49413ca262`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:41:28,525::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:41:28,526::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c633a043-ee48-4e67-bea0-143f9995631b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:41:28,526::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:41:28,526::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:41:28,526::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c633a043-ee48-4e67-bea0-143f9995631b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:41:28,526::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bcb903aa-d21b-4271-af4b-fa49413ca262`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:41:28,526::task::993::Storage.TaskManager.Task::(_decref) Task=`bcb903aa-d21b-4271-af4b-fa49413ca262`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:41:28,543::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:28,544::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcb903aa-d21b-4271-af4b-fa49413ca262`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:28,544::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcb903aa-d21b-4271-af4b-fa49413ca262`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:41:28,544::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:41:28,544::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:41:28,544::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:41:28,544::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:41:28,544::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:41:28,544::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:41:28,544::task::993::Storage.TaskManager.Task::(_decref) Task=`bcb903aa-d21b-4271-af4b-fa49413ca262`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) (542295) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:29,415::__init__::225::IOProcess::(_processLogs) (542295) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:29,417::__init__::225::IOProcess::(_processLogs) (542295) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:29,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:41:29,417::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:41:29,478::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000943665 s, 525 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) (542296) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:29,479::__init__::225::IOProcess::(_processLogs) (542296) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:29,480::__init__::225::IOProcess::(_processLogs) (542296) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:29,480::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:29,480::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:41:29,480::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:29,480::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:29,480::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) (542297) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) (542297) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) (542297) Building response >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) (542297) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:29,481::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:29,482::__init__::225::IOProcess::(_processLogs) (542298) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) (542298) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) (542298) Building response >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) (542298) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:29,483::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:29,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:29,484::__init__::225::IOProcess::(_processLogs) (542299) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:29,484::__init__::225::IOProcess::(_processLogs) (542299) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:29,484::__init__::225::IOProcess::(_processLogs) DEBUG|(542299) Building response >Thread-19::DEBUG::2014-08-11 17:41:29,484::__init__::225::IOProcess::(_processLogs) (542299) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:29,485::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:29,485::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:41:29,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:29,680::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0610029 s, 16.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:41:29,774::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:41:30,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:30,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:30,955::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:31,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:31,752::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:31,754::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:31,756::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:31,808::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0597666 s, 17.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:41:32,651::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:41:33,862::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:33,962::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0412034 s, 24.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) (542300) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) (542300) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:34,689::__init__::225::IOProcess::(_processLogs) DEBUG|(542300) Building response >Thread-19::DEBUG::2014-08-11 17:41:34,690::__init__::225::IOProcess::(_processLogs) (542300) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:34,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:34,690::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:41:34,690::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:41:34,751::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000806406 s, 454 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) (542301) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:34,752::__init__::225::IOProcess::(_processLogs) (542301) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:34,753::__init__::225::IOProcess::(_processLogs) DEBUG|(542301) Building response >Thread-19::DEBUG::2014-08-11 17:41:34,753::__init__::225::IOProcess::(_processLogs) (542301) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:34,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:34,753::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:35,961::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:35,961::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:35,962::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:35,970::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:36,041::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131571 s, 77.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:36,762::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:36,763::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:36,763::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:38,049::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:38,121::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133951 s, 76.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:41:38,576::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:41:38,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`87e9d7e9-b410-4b14-94f4-2fe3430c0efa`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:38,577::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:41:38,674::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:38,674::task::1191::Storage.TaskManager.Task::(prepare) Task=`87e9d7e9-b410-4b14-94f4-2fe3430c0efa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:38,674::task::595::Storage.TaskManager.Task::(_updateState) Task=`87e9d7e9-b410-4b14-94f4-2fe3430c0efa`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:38,675::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:38,675::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:38,675::task::993::Storage.TaskManager.Task::(_decref) Task=`87e9d7e9-b410-4b14-94f4-2fe3430c0efa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:41:38,687::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:41:38,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`662fd1f6-0553-4e2a-b673-0810ca513b41`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:41:38,687::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:41:38,687::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e512cbbf-0ebd-462c-9fae-a785b50e33e8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:41:38,687::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:41:38,688::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:41:38,688::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e512cbbf-0ebd-462c-9fae-a785b50e33e8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:41:38,688::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`662fd1f6-0553-4e2a-b673-0810ca513b41`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:41:38,688::task::993::Storage.TaskManager.Task::(_decref) Task=`662fd1f6-0553-4e2a-b673-0810ca513b41`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:41:38,746::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:38,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`662fd1f6-0553-4e2a-b673-0810ca513b41`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:38,747::task::595::Storage.TaskManager.Task::(_updateState) Task=`662fd1f6-0553-4e2a-b673-0810ca513b41`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:41:38,747::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:41:38,747::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:41:38,747::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:41:38,747::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:41:38,747::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:41:38,747::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:41:38,747::task::993::Storage.TaskManager.Task::(_decref) Task=`662fd1f6-0553-4e2a-b673-0810ca513b41`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:39,485::__init__::225::IOProcess::(_processLogs) (542302) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:39,486::__init__::225::IOProcess::(_processLogs) (542302) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:39,487::__init__::225::IOProcess::(_processLogs) (542302) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:39,487::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:41:39,488::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:41:39,548::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000945876 s, 523 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:39,548::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:39,548::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) (542303) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) (542303) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) (542303) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:39,549::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:39,550::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:41:39,550::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:39,550::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) (542304) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:39,551::__init__::225::IOProcess::(_processLogs) (542304) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) (542304) Building response >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) (542304) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:41:39,552::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) (542305) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) (542305) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) (542305) Building response >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) (542305) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:39,553::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:39,554::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:39,554::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:41:39,554::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:39,554::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) (542306) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) (542306) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) (542306) Building response >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) (542306) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:39,555::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:41:39,824::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:41:40,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:40,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458544 s, 22.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:40,967::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:40,968::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:40,968::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:41,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:41,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:41,769::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:42,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a12b11d-1f6c-41fd-8fec-9afa0e50f325`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:42,054::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:41:42,054::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806406', 'lastCheck': '7.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945876', 'lastCheck': '2.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:42,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`5a12b11d-1f6c-41fd-8fec-9afa0e50f325`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000806406', 'lastCheck': '7.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000945876', 'lastCheck': '2.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:42,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`5a12b11d-1f6c-41fd-8fec-9afa0e50f325`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:42,055::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:42,055::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:42,055::task::993::Storage.TaskManager.Task::(_decref) Task=`5a12b11d-1f6c-41fd-8fec-9afa0e50f325`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:41:42,072::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:42,072::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:42,242::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:42,386::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0834351 s, 12.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:41:44,394::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:44,465::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132628 s, 77.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) (542307) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:44,754::__init__::225::IOProcess::(_processLogs) (542307) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:44,755::__init__::225::IOProcess::(_processLogs) DEBUG|(542307) Building response >Thread-19::DEBUG::2014-08-11 17:41:44,755::__init__::225::IOProcess::(_processLogs) (542307) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:44,755::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:44,756::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:41:44,756::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10102::DEBUG::2014-08-11 17:41:44,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`d97dcbe4-a94e-48e2-8f1f-f8228fe664d5`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:41:44,817::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-27::DEBUG::2014-08-11 17:41:44,818::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000904304 s, 405 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:44,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:44,820::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:41:44,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:44,821::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:44,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:44,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:44,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:44,823::__init__::225::IOProcess::(_processLogs) (542308) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:41:44,823::__init__::225::IOProcess::(_processLogs) (542308) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:41:44,824::__init__::225::IOProcess::(_processLogs) DEBUG|(542308) Building response >Thread-19::DEBUG::2014-08-11 17:41:44,824::__init__::225::IOProcess::(_processLogs) (542308) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:44,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:44,824::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:44,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:44,826::__init__::225::IOProcess::(_processLogs) (542309) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:44,826::__init__::225::IOProcess::(_processLogs) (542309) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:44,826::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10102::INFO::2014-08-11 17:41:44,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:41:44,826::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-10102::DEBUG::2014-08-11 17:41:44,827::task::1191::Storage.TaskManager.Task::(prepare) Task=`d97dcbe4-a94e-48e2-8f1f-f8228fe664d5`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:41:44,827::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10102::DEBUG::2014-08-11 17:41:44,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`d97dcbe4-a94e-48e2-8f1f-f8228fe664d5`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:41:44,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10102::DEBUG::2014-08-11 17:41:44,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:41:44,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::DEBUG::2014-08-11 17:41:44,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:41:44,829::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:41:44,829::task::993::Storage.TaskManager.Task::(_decref) Task=`d97dcbe4-a94e-48e2-8f1f-f8228fe664d5`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:41:44,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:44,829::__init__::225::IOProcess::(_processLogs) (542310) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) (542310) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) (542310) Building response >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) (542310) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) (542309) Building response >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) (542309) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:44,830::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10102::DEBUG::2014-08-11 17:41:44,851::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:41:45,974::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:45,974::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:45,975::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:46,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:46,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.05296 s, 19.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:46,775::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:46,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:46,776::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:48,593::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:48,694::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413685 s, 24.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:41:48,882::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:41:48,882::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0c77f95-40da-4a75-979d-ddde4a22cfa9`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:48,883::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:41:48,912::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:48,912::task::1191::Storage.TaskManager.Task::(prepare) Task=`a0c77f95-40da-4a75-979d-ddde4a22cfa9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:48,912::task::595::Storage.TaskManager.Task::(_updateState) Task=`a0c77f95-40da-4a75-979d-ddde4a22cfa9`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:48,912::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:48,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:48,912::task::993::Storage.TaskManager.Task::(_decref) Task=`a0c77f95-40da-4a75-979d-ddde4a22cfa9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:41:48,923::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:41:48,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`88a91ab3-5c2b-4b5a-86fd-e18a7c055468`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:41:48,923::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:41:48,924::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cec5ae84-f94e-45dc-8a31-a5ecd79d9930`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:41:48,924::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:41:48,924::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:41:48,924::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cec5ae84-f94e-45dc-8a31-a5ecd79d9930`::Granted request >Thread-10197::DEBUG::2014-08-11 17:41:48,924::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`88a91ab3-5c2b-4b5a-86fd-e18a7c055468`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:41:48,924::task::993::Storage.TaskManager.Task::(_decref) Task=`88a91ab3-5c2b-4b5a-86fd-e18a7c055468`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:41:48,940::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:48,941::task::1191::Storage.TaskManager.Task::(prepare) Task=`88a91ab3-5c2b-4b5a-86fd-e18a7c055468`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:48,941::task::595::Storage.TaskManager.Task::(_updateState) Task=`88a91ab3-5c2b-4b5a-86fd-e18a7c055468`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:41:48,941::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:41:48,941::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:41:48,941::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:41:48,941::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:41:48,941::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:41:48,941::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:41:48,941::task::993::Storage.TaskManager.Task::(_decref) Task=`88a91ab3-5c2b-4b5a-86fd-e18a7c055468`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:41:49,555::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:49,555::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:49,555::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:49,555::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:49,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:49,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:49,556::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:49,556::__init__::225::IOProcess::(_processLogs) (542311) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:49,556::__init__::225::IOProcess::(_processLogs) (542311) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:49,557::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(542311) Building response >Thread-19::DEBUG::2014-08-11 17:41:49,557::__init__::225::IOProcess::(_processLogs) (542311) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:49,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:49,558::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:41:49,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:41:49,619::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00132821 s, 373 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:49,619::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:49,619::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:49,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) (542312) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) (542312) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:49,620::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(542312) Building response >Thread-19::DEBUG::2014-08-11 17:41:49,621::__init__::225::IOProcess::(_processLogs) (542312) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:49,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:49,621::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:41:49,621::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:49,621::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) (542313) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) (542313) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) (542313) Building response >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) (542313) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:49,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:49,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) (542314) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) (542314) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) (542314) Building response >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) (542314) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:41:49,624::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) (542315) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) (542315) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:49,625::__init__::225::IOProcess::(_processLogs) (542315) Building response >Thread-19::DEBUG::2014-08-11 17:41:49,626::__init__::225::IOProcess::(_processLogs) (542315) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:49,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:49,626::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:41:50,669::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >Dummy-51::DEBUG::2014-08-11 17:41:50,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:50,804::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0430918 s, 23.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:50,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:50,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:50,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:51,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:51,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:51,782::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:52,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:52,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0644504 s, 15.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:54,831::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:54,831::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) (542316) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) (542316) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(542316) Building response >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) (542316) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:54,832::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:41:54,833::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:41:54,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:41:54,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000773692 s, 473 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:54,894::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:41:54,894::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:54,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:54,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:54,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:54,896::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:54,896::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:54,896::__init__::225::IOProcess::(_processLogs) (542317) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:54,896::__init__::225::IOProcess::(_processLogs) (542317) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:54,896::__init__::225::IOProcess::(_processLogs) (542317) Building response >Thread-19::DEBUG::2014-08-11 17:41:54,897::__init__::225::IOProcess::(_processLogs) (542317) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:54,897::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:54,897::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:41:54,899::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:41:54,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:55,027::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.024967 s, 41.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:41:55,985::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:55,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:41:55,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:56,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:56,788::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:41:56,789::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:41:57,035::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:57,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0601756 s, 17.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:41:57,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`459ab966-452c-4dba-a075-b385d843e3b2`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:57,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:41:57,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773692', 'lastCheck': '2.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132821', 'lastCheck': '7.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:57,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`459ab966-452c-4dba-a075-b385d843e3b2`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000773692', 'lastCheck': '2.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132821', 'lastCheck': '7.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:41:57,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`459ab966-452c-4dba-a075-b385d843e3b2`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:57,271::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:57,271::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:57,271::task::993::Storage.TaskManager.Task::(_decref) Task=`459ab966-452c-4dba-a075-b385d843e3b2`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:41:57,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:57,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:41:58,993::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:41:58,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd26d16c-9bde-4f19-8e92-0e88c6a74a9b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:41:58,993::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:41:59,053::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:59,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`dd26d16c-9bde-4f19-8e92-0e88c6a74a9b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:41:59,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`dd26d16c-9bde-4f19-8e92-0e88c6a74a9b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:41:59,054::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:41:59,054::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:41:59,054::task::993::Storage.TaskManager.Task::(_decref) Task=`dd26d16c-9bde-4f19-8e92-0e88c6a74a9b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:41:59,060::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:41:59,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eed659e-18d8-4dae-ad99-68f05159aff6`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:41:59,061::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:41:59,061::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8a899f0f-196c-43ca-9d91-53afe09deab3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:41:59,061::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:41:59,061::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:41:59,061::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8a899f0f-196c-43ca-9d91-53afe09deab3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:41:59,062::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6eed659e-18d8-4dae-ad99-68f05159aff6`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:41:59,062::task::993::Storage.TaskManager.Task::(_decref) Task=`6eed659e-18d8-4dae-ad99-68f05159aff6`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:41:59,078::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:59,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`6eed659e-18d8-4dae-ad99-68f05159aff6`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:41:59,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`6eed659e-18d8-4dae-ad99-68f05159aff6`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:41:59,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:41:59,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:41:59,079::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:41:59,079::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:41:59,079::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:41:59,079::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:41:59,079::task::993::Storage.TaskManager.Task::(_decref) Task=`6eed659e-18d8-4dae-ad99-68f05159aff6`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:41:59,162::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:41:59,342::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.119467 s, 8.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:59,625::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) (542318) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) (542318) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) (542318) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:59,626::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:41:59,627::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:41:59,687::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00111571 s, 444 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:41:59,688::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:41:59,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:59,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:59,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:59,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:59,688::__init__::225::IOProcess::(_processLogs) (542319) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:41:59,689::__init__::225::IOProcess::(_processLogs) (542319) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:41:59,689::__init__::225::IOProcess::(_processLogs) (542319) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:59,689::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:41:59,690::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:41:59,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:59,690::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:59,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:59,690::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) (542320) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) (542320) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) (542320) Building response >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) (542320) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:59,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) (542321) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) (542321) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) (542321) Building response >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) (542321) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:41:59,692::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) (542322) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) (542322) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) (542322) Building response >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) (542322) Queuing response >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:41:59,693::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10102::DEBUG::2014-08-11 17:41:59,899::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm::DEBUG::2014-08-11 17:42:00,992::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:00,992::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:00,993::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:01,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:01,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598657 s, 17.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:01,795::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:01,797::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:01,799::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:42:02,689::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:42:03,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:03,559::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0154014 s, 66.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:04,896::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:04,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:04,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:04,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:04,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:04,897::__init__::225::IOProcess::(_processLogs) (542323) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:04,897::__init__::225::IOProcess::(_processLogs) (542323) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:04,898::__init__::225::IOProcess::(_processLogs) (542323) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:04,898::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:42:04,898::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:42:04,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00507124 s, 72.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) (542324) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:04,964::__init__::225::IOProcess::(_processLogs) (542324) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:04,967::__init__::225::IOProcess::(_processLogs) (542324) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:04,967::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:42:05,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:05,655::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0289526 s, 35.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:05,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:05,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:05,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:06,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:06,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:06,807::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:07,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:07,771::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0510957 s, 20.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:09,114::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:42:09,115::task::595::Storage.TaskManager.Task::(_updateState) Task=`f918531a-c117-4dda-93bd-5a761f4e6923`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:09,115::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:42:09,145::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:09,145::task::1191::Storage.TaskManager.Task::(prepare) Task=`f918531a-c117-4dda-93bd-5a761f4e6923`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:09,145::task::595::Storage.TaskManager.Task::(_updateState) Task=`f918531a-c117-4dda-93bd-5a761f4e6923`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:09,145::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:09,145::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:09,145::task::993::Storage.TaskManager.Task::(_decref) Task=`f918531a-c117-4dda-93bd-5a761f4e6923`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:42:09,157::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:42:09,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`b659c6e4-8bd4-478e-927b-3d1f55ac070d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:42:09,158::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:42:09,158::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`85a8331d-b4c3-4f5c-bd88-0d29fde35635`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:42:09,158::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:42:09,158::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:42:09,158::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`85a8331d-b4c3-4f5c-bd88-0d29fde35635`::Granted request >Thread-10197::DEBUG::2014-08-11 17:42:09,158::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`b659c6e4-8bd4-478e-927b-3d1f55ac070d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:42:09,158::task::993::Storage.TaskManager.Task::(_decref) Task=`b659c6e4-8bd4-478e-927b-3d1f55ac070d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:42:09,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:09,176::task::1191::Storage.TaskManager.Task::(prepare) Task=`b659c6e4-8bd4-478e-927b-3d1f55ac070d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:09,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`b659c6e4-8bd4-478e-927b-3d1f55ac070d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:42:09,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:42:09,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:42:09,176::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:42:09,176::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:42:09,176::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:42:09,176::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:42:09,177::task::993::Storage.TaskManager.Task::(_decref) Task=`b659c6e4-8bd4-478e-927b-3d1f55ac070d`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:42:09,694::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:09,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:09,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:09,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:09,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:09,695::__init__::225::IOProcess::(_processLogs) (542325) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:09,695::__init__::225::IOProcess::(_processLogs) (542325) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:09,695::__init__::225::IOProcess::(_processLogs) (542325) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:09,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:42:09,695::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:09,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:42:09,965::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-28::DEBUG::2014-08-11 17:42:10,077::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00188477 s, 263 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) (542326) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:10,078::__init__::225::IOProcess::(_processLogs) (542326) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:10,130::__init__::225::IOProcess::(_processLogs) (542326) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:10,132::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:42:10,133::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:42:10,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:10,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:10,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:10,137::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:10,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:10,138::__init__::225::IOProcess::(_processLogs) (542327) Finding callback 'access'... >Dummy-51::DEBUG::2014-08-11 17:42:10,139::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0626394 s, 16.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:10,139::__init__::225::IOProcess::(_processLogs) (542327) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:10,141::__init__::225::IOProcess::(_processLogs) (542327) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:10,141::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:10,142::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:10,143::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:42:10,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:10,144::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:10,144::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:10,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:10,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:10,146::__init__::225::IOProcess::(_processLogs) (542328) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:10,147::__init__::225::IOProcess::(_processLogs) (542328) Building response >Thread-19::DEBUG::2014-08-11 17:42:10,147::__init__::225::IOProcess::(_processLogs) (542328) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:10,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:10,148::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:10,148::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:42:10,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:10,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:10,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:10,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:10,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:10,150::__init__::225::IOProcess::(_processLogs) (542329) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:10,151::__init__::225::IOProcess::(_processLogs) (542329) Building response >Thread-19::DEBUG::2014-08-11 17:42:10,152::__init__::225::IOProcess::(_processLogs) (542329) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:10,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:10,152::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:11,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:11,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:11,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:11,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:11,812::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:11,813::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:12,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:12,244::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0225098 s, 45.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:12,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`92b8c45d-6753-4a41-be8e-e1c5549fd515`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:12,461::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:42:12,461::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507124', 'lastCheck': '7.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00188477', 'lastCheck': '2.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:12,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`92b8c45d-6753-4a41-be8e-e1c5549fd515`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00507124', 'lastCheck': '7.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00188477', 'lastCheck': '2.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:12,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`92b8c45d-6753-4a41-be8e-e1c5549fd515`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:12,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:12,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:12,461::task::993::Storage.TaskManager.Task::(_decref) Task=`92b8c45d-6753-4a41-be8e-e1c5549fd515`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:42:12,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:42:12,476::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:14,252::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:14,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125219 s, 81.8 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:42:14,965::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) (542330) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:14,968::__init__::225::IOProcess::(_processLogs) (542330) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:14,969::__init__::225::IOProcess::(_processLogs) (542330) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:14,969::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:42:14,970::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:42:15,030::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000862521 s, 424 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:15,030::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) (542331) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) (542331) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:15,031::__init__::225::IOProcess::(_processLogs) (542331) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:15,032::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:15,033::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:16,030::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:16,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:16,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:16,331::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:16,406::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0169757 s, 60.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:16,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:16,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:16,819::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:18,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:18,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0191819 s, 53.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:19,209::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:42:19,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f19efd7-72a9-4912-8a3e-23f1a961ba0f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:19,210::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:42:19,275::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:19,275::task::1191::Storage.TaskManager.Task::(prepare) Task=`2f19efd7-72a9-4912-8a3e-23f1a961ba0f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:19,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`2f19efd7-72a9-4912-8a3e-23f1a961ba0f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:19,275::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:19,275::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:19,275::task::993::Storage.TaskManager.Task::(_decref) Task=`2f19efd7-72a9-4912-8a3e-23f1a961ba0f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:42:19,287::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:42:19,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a5e54f-6efe-441d-8520-ce435307ebcb`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:42:19,287::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:42:19,288::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a98d67e2-1e46-412a-89fe-a25f0031e90a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:42:19,288::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:42:19,288::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:42:19,288::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a98d67e2-1e46-412a-89fe-a25f0031e90a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:42:19,289::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`12a5e54f-6efe-441d-8520-ce435307ebcb`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:42:19,289::task::993::Storage.TaskManager.Task::(_decref) Task=`12a5e54f-6efe-441d-8520-ce435307ebcb`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:42:19,346::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:19,346::task::1191::Storage.TaskManager.Task::(prepare) Task=`12a5e54f-6efe-441d-8520-ce435307ebcb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:19,346::task::595::Storage.TaskManager.Task::(_updateState) Task=`12a5e54f-6efe-441d-8520-ce435307ebcb`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:42:19,346::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:42:19,346::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:42:19,346::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:42:19,346::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:42:19,346::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:42:19,346::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:42:19,347::task::993::Storage.TaskManager.Task::(_decref) Task=`12a5e54f-6efe-441d-8520-ce435307ebcb`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:42:20,151::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:20,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:20,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:20,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:20,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:20,152::__init__::225::IOProcess::(_processLogs) (542332) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:20,152::__init__::225::IOProcess::(_processLogs) (542332) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:20,153::__init__::225::IOProcess::(_processLogs) (542332) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:20,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:20,153::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:42:20,154::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:42:20,216::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000920686 s, 538 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:20,216::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:20,216::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:20,216::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:20,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:20,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:20,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:20,217::__init__::225::IOProcess::(_processLogs) (542333) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:20,217::__init__::225::IOProcess::(_processLogs) (542333) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:20,217::__init__::225::IOProcess::(_processLogs) DEBUG|(542333) Building response >Thread-19::DEBUG::2014-08-11 17:42:20,218::__init__::225::IOProcess::(_processLogs) (542333) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:20,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:20,218::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:42:20,218::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:20,218::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:42:20,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:20,219::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:20,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:20,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:20,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:20,219::__init__::225::IOProcess::(_processLogs) (542334) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) (542334) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) (542334) Building response >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) (542334) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:42:20,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) (542335) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) (542335) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) (542335) Building response >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) (542335) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:20,221::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:20,222::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:20,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:20,222::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:42:20,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:20,222::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) (542336) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) (542336) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) (542336) Building response >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) (542336) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:20,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:20,224::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:42:20,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:20,622::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0301506 s, 34.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:42:20,765::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:42:21,038::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:21,038::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:21,038::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:21,825::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:21,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:21,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:22,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:22,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0589132 s, 17.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:42:24,757::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:24,844::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213965 s, 47.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:42:24,966::task::595::Storage.TaskManager.Task::(_updateState) Task=`460ec868-de70-440a-9332-ac3a0b814116`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:42:24,967::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:42:24,967::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:24,967::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:42:24,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:24,967::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:24,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:24,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:24,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:24,968::__init__::225::IOProcess::(_processLogs) (542337) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:42:24,968::__init__::225::IOProcess::(_processLogs) (542337) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:42:24,972::__init__::225::IOProcess::(_processLogs) DEBUG|(542337) Building response >Thread-19::DEBUG::2014-08-11 17:42:24,972::__init__::225::IOProcess::(_processLogs) (542337) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:24,972::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:24,972::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:42:24,972::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:24,973::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:42:24,973::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:24,973::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:42:24,973::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:42:24,973::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:42:24,974::task::1191::Storage.TaskManager.Task::(prepare) Task=`460ec868-de70-440a-9332-ac3a0b814116`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:42:24,974::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:42:24,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`460ec868-de70-440a-9332-ac3a0b814116`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:42:24,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:42:24,975::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:42:24,975::__init__::225::IOProcess::(_processLogs) (542338) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:42:24,975::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:42:24,976::__init__::225::IOProcess::(_processLogs) (542338) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:42:24,976::task::993::Storage.TaskManager.Task::(_decref) Task=`460ec868-de70-440a-9332-ac3a0b814116`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:42:24,976::__init__::225::IOProcess::(_processLogs) (542338) Building response >Thread-19::DEBUG::2014-08-11 17:42:24,976::__init__::225::IOProcess::(_processLogs) (542338) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:24,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:24,977::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:42:24,996::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:25,033::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:25,034::__init__::225::IOProcess::(_processLogs) (542339) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:25,034::__init__::225::IOProcess::(_processLogs) (542339) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:25,034::__init__::225::IOProcess::(_processLogs) DEBUG|(542339) Building response >Thread-27::DEBUG::2014-08-11 17:42:25,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:42:25,035::__init__::225::IOProcess::(_processLogs) (542339) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:25,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:25,093::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:42:25,095::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000962246 s, 380 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) (542340) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:25,096::__init__::225::IOProcess::(_processLogs) (542340) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:25,097::__init__::225::IOProcess::(_processLogs) DEBUG|(542340) Building response >Thread-19::DEBUG::2014-08-11 17:42:25,097::__init__::225::IOProcess::(_processLogs) (542340) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:25,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:25,098::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:26,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:26,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:26,042::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:26,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:26,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:26,833::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:26,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:26,940::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0241667 s, 42.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:27,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`711794c6-1e02-4027-a9ab-22805d23a696`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:27,901::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:42:27,901::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000962246', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000920686', 'lastCheck': '7.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:27,901::task::1191::Storage.TaskManager.Task::(prepare) Task=`711794c6-1e02-4027-a9ab-22805d23a696`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000962246', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000920686', 'lastCheck': '7.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:27,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`711794c6-1e02-4027-a9ab-22805d23a696`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:27,901::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:27,901::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:27,902::task::993::Storage.TaskManager.Task::(_decref) Task=`711794c6-1e02-4027-a9ab-22805d23a696`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:42:27,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:42:27,920::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:28,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:29,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334355 s, 30.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:29,386::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:42:29,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`369ee607-b7b0-494a-9ed8-072d8d9732f4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:29,387::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:42:29,400::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:29,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`369ee607-b7b0-494a-9ed8-072d8d9732f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:29,400::task::595::Storage.TaskManager.Task::(_updateState) Task=`369ee607-b7b0-494a-9ed8-072d8d9732f4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:29,400::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:29,400::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:29,400::task::993::Storage.TaskManager.Task::(_decref) Task=`369ee607-b7b0-494a-9ed8-072d8d9732f4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:42:29,412::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:42:29,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`02dcca5a-0b39-47ef-bc7f-5134265714a9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:42:29,412::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:42:29,412::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e5819b5d-e1d3-43b4-b14d-acc733544b9c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:42:29,413::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:42:29,413::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:42:29,413::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e5819b5d-e1d3-43b4-b14d-acc733544b9c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:42:29,413::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`02dcca5a-0b39-47ef-bc7f-5134265714a9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:42:29,413::task::993::Storage.TaskManager.Task::(_decref) Task=`02dcca5a-0b39-47ef-bc7f-5134265714a9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:42:29,450::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:29,450::task::1191::Storage.TaskManager.Task::(prepare) Task=`02dcca5a-0b39-47ef-bc7f-5134265714a9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:29,450::task::595::Storage.TaskManager.Task::(_updateState) Task=`02dcca5a-0b39-47ef-bc7f-5134265714a9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:42:29,450::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:42:29,450::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:42:29,451::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:42:29,451::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:42:29,451::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:42:29,451::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:42:29,451::task::993::Storage.TaskManager.Task::(_decref) Task=`02dcca5a-0b39-47ef-bc7f-5134265714a9`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:42:30,012::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:42:30,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:30,223::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:30,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:30,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:30,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:30,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:30,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:30,224::__init__::225::IOProcess::(_processLogs) (542341) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:30,224::__init__::225::IOProcess::(_processLogs) (542341) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:30,230::__init__::225::IOProcess::(_processLogs) DEBUG|(542341) Building response >Thread-19::DEBUG::2014-08-11 17:42:30,230::__init__::225::IOProcess::(_processLogs) (542341) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:30,231::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:42:30,231::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:42:30,231::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:42:30,293::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00114377 s, 433 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:30,293::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) (542342) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) (542342) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:30,294::__init__::225::IOProcess::(_processLogs) DEBUG|(542342) Building response >Thread-19::DEBUG::2014-08-11 17:42:30,295::__init__::225::IOProcess::(_processLogs) (542342) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:30,295::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:30,295::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:42:30,295::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:30,295::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) (542343) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) (542343) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:30,296::__init__::225::IOProcess::(_processLogs) (542343) Building response >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) (542343) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:30,297::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) (542344) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) (542344) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) (542344) Building response >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) (542344) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:42:30,298::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) (542345) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) (542345) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) DEBUG|(542345) Building response >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) (542345) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:30,299::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:42:30,300::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:31,047::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:31,048::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:31,048::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:31,054::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:31,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153506 s, 66.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:31,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:31,842::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:31,843::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:42:32,822::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:42:33,137::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:33,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049953 s, 20.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:35,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:35,099::__init__::225::IOProcess::(_processLogs) (542346) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:35,099::__init__::225::IOProcess::(_processLogs) (542346) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:35,099::__init__::225::IOProcess::(_processLogs) DEBUG|(542346) Building response >Thread-27::DEBUG::2014-08-11 17:42:35,099::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:42:35,100::__init__::225::IOProcess::(_processLogs) (542346) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:35,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:35,159::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:42:35,160::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000501979 s, 729 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:35,160::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:35,160::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:35,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:35,160::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:35,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:35,161::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:35,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:35,161::__init__::225::IOProcess::(_processLogs) (542347) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:35,161::__init__::225::IOProcess::(_processLogs) (542347) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:35,161::__init__::225::IOProcess::(_processLogs) DEBUG|(542347) Building response >Thread-19::DEBUG::2014-08-11 17:42:35,162::__init__::225::IOProcess::(_processLogs) (542347) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:35,162::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:35,163::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:42:35,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:35,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0714148 s, 14.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:36,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:36,054::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:36,055::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:36,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:36,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:36,851::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:37,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:37,477::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135748 s, 75.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:42:39,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:42:39,542::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:42:39,542::task::595::Storage.TaskManager.Task::(_updateState) Task=`d51b644f-bc86-4cea-b36e-acc2813affc2`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:39,543::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:42:39,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200212 s, 51.1 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:42:39,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:39,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`d51b644f-bc86-4cea-b36e-acc2813affc2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:39,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`d51b644f-bc86-4cea-b36e-acc2813affc2`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:39,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:39,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:39,575::task::993::Storage.TaskManager.Task::(_decref) Task=`d51b644f-bc86-4cea-b36e-acc2813affc2`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:42:39,584::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:42:39,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`183ef77a-15bb-4ac2-8e41-851b1621ebc9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:42:39,584::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:42:39,584::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`917c7b05-9e4d-4f3c-836b-1698990ed625`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:42:39,585::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:42:39,585::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:42:39,585::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`917c7b05-9e4d-4f3c-836b-1698990ed625`::Granted request >Thread-10197::DEBUG::2014-08-11 17:42:39,585::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`183ef77a-15bb-4ac2-8e41-851b1621ebc9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:42:39,585::task::993::Storage.TaskManager.Task::(_decref) Task=`183ef77a-15bb-4ac2-8e41-851b1621ebc9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:42:39,601::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:39,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`183ef77a-15bb-4ac2-8e41-851b1621ebc9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:39,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`183ef77a-15bb-4ac2-8e41-851b1621ebc9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:42:39,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:42:39,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:42:39,602::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:42:39,602::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:42:39,602::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:42:39,602::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:42:39,602::task::993::Storage.TaskManager.Task::(_decref) Task=`183ef77a-15bb-4ac2-8e41-851b1621ebc9`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:42:40,013::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:42:40,300::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:40,300::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:40,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) (542348) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) (542348) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:40,301::__init__::225::IOProcess::(_processLogs) DEBUG|(542348) Building response >Thread-28::DEBUG::2014-08-11 17:42:40,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:42:40,302::__init__::225::IOProcess::(_processLogs) (542348) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:40,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:40,361::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:42:40,361::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000425496 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:40,362::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:40,362::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:40,362::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:40,362::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:40,362::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) (542349) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) (542349) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) (542349) Building response >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) (542349) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:40,363::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:40,364::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) (542350) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) (542350) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) (542350) Building response >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) (542350) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:40,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) (542351) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) (542351) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) (542351) Building response >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) (542351) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:40,366::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:42:40,367::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:40,367::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:40,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:40,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:40,367::__init__::225::IOProcess::(_processLogs) (542352) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:40,367::__init__::225::IOProcess::(_processLogs) (542352) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:40,368::__init__::225::IOProcess::(_processLogs) (542352) Building response >Thread-19::DEBUG::2014-08-11 17:42:40,368::__init__::225::IOProcess::(_processLogs) (542352) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:40,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:40,368::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:41,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:41,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:41,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:41,570::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:41,672::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0422773 s, 24.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:41,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:41,857::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:41,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:42:43,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dae932f-6212-49e6-98c4-68ee8ecd1261`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:43,159::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:42:43,159::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501979', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425496', 'lastCheck': '2.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:43,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`7dae932f-6212-49e6-98c4-68ee8ecd1261`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000501979', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425496', 'lastCheck': '2.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:43,160::task::595::Storage.TaskManager.Task::(_updateState) Task=`7dae932f-6212-49e6-98c4-68ee8ecd1261`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:43,160::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:43,160::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:43,160::task::993::Storage.TaskManager.Task::(_decref) Task=`7dae932f-6212-49e6-98c4-68ee8ecd1261`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:42:43,179::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:42:43,179::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:43,681::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:43,753::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126824 s, 80.7 MB/s\n'; <rc> = 0 >Thread-10102::DEBUG::2014-08-11 17:42:45,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`6382539c-1de5-425d-ad90-4141a1f2e53a`::moving from state init -> state preparing >Thread-10102::INFO::2014-08-11 17:42:45,015::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:42:45,015::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:42:45,015::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:45,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:45,016::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:45,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:45,016::__init__::225::IOProcess::(_processLogs) (542353) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:42:45,016::__init__::225::IOProcess::(_processLogs) (542353) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:42:45,018::__init__::225::IOProcess::(_processLogs) (542353) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:45,018::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:42:45,018::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:42:45,019::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:45,019::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10102::INFO::2014-08-11 17:42:45,019::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:42:45,019::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10102::DEBUG::2014-08-11 17:42:45,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`6382539c-1de5-425d-ad90-4141a1f2e53a`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:42:45,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10102::DEBUG::2014-08-11 17:42:45,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`6382539c-1de5-425d-ad90-4141a1f2e53a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:42:45,020::__init__::225::IOProcess::(_processLogs) (542354) Finding callback 'stat'... >Thread-10102::DEBUG::2014-08-11 17:42:45,021::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:42:45,021::__init__::225::IOProcess::(_processLogs) (542354) Got request for method 'stat' >Thread-10102::DEBUG::2014-08-11 17:42:45,021::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:42:45,021::__init__::225::IOProcess::(_processLogs) (542354) Building response >Thread-10102::DEBUG::2014-08-11 17:42:45,022::task::993::Storage.TaskManager.Task::(_decref) Task=`6382539c-1de5-425d-ad90-4141a1f2e53a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:42:45,022::__init__::225::IOProcess::(_processLogs) (542354) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:45,022::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:45,022::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10102::DEBUG::2014-08-11 17:42:45,043::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) (542355) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:45,163::__init__::225::IOProcess::(_processLogs) (542355) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:45,165::__init__::225::IOProcess::(_processLogs) (542355) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:45,165::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:42:45,166::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:42:45,226::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00117178 s, 312 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) (542356) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) (542356) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:45,227::__init__::225::IOProcess::(_processLogs) (542356) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:45,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:45,228::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:42:45,761::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:45,871::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507268 s, 20.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:46,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:46,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:46,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:46,864::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:46,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:46,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:47,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:47,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.029083 s, 35.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:49,664::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:42:49,665::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccb7f866-56f7-4857-8c90-75a412cfeb8b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:49,665::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:42:49,688::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:49,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`ccb7f866-56f7-4857-8c90-75a412cfeb8b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:49,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccb7f866-56f7-4857-8c90-75a412cfeb8b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:49,689::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:49,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:49,689::task::993::Storage.TaskManager.Task::(_decref) Task=`ccb7f866-56f7-4857-8c90-75a412cfeb8b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:42:49,701::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:42:49,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`df23d388-1611-44ac-82db-0343dc6cd63c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:42:49,701::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:42:49,701::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`37f1ab0d-bdb8-4a00-8bd0-5c15517fdbf2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:42:49,701::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:42:49,701::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:42:49,701::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`37f1ab0d-bdb8-4a00-8bd0-5c15517fdbf2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:42:49,702::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`df23d388-1611-44ac-82db-0343dc6cd63c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:42:49,702::task::993::Storage.TaskManager.Task::(_decref) Task=`df23d388-1611-44ac-82db-0343dc6cd63c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:42:49,719::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:49,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`df23d388-1611-44ac-82db-0343dc6cd63c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:49,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`df23d388-1611-44ac-82db-0343dc6cd63c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:42:49,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:42:49,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:42:49,720::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:42:49,720::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:42:49,720::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:42:49,720::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:42:49,720::task::993::Storage.TaskManager.Task::(_decref) Task=`df23d388-1611-44ac-82db-0343dc6cd63c`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:42:49,976::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:50,047::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126247 s, 81.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) (542357) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:50,368::__init__::225::IOProcess::(_processLogs) (542357) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:50,369::__init__::225::IOProcess::(_processLogs) (542357) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:50,369::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:42:50,369::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:42:50,428::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000782278 s, 633 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) (542358) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) (542358) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:50,429::__init__::225::IOProcess::(_processLogs) (542358) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:50,430::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:42:50,430::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:42:50,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:50,430::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) (542359) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) (542359) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) (542359) Building response >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) (542359) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:50,431::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) (542360) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:50,432::__init__::225::IOProcess::(_processLogs) (542360) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) (542360) Building response >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) (542360) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:50,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) (542361) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) (542361) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) (542361) Building response >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) (542361) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:50,434::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:42:50,861::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:42:51,069::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:51,070::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:51,070::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:51,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:51,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:51,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:52,055::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:52,129::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0159613 s, 64.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:42:54,138::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:54,223::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269312 s, 38.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:42:55,021::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) (542362) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:55,229::__init__::225::IOProcess::(_processLogs) (542362) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:55,230::__init__::225::IOProcess::(_processLogs) DEBUG|(542362) Building response >Thread-19::DEBUG::2014-08-11 17:42:55,230::__init__::225::IOProcess::(_processLogs) (542362) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:55,230::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:42:55,230::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:42:55,231::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:42:55,290::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000654496 s, 559 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:42:55,290::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:42:55,290::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) (542363) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) (542363) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:42:55,291::__init__::225::IOProcess::(_processLogs) DEBUG|(542363) Building response >Thread-19::DEBUG::2014-08-11 17:42:55,292::__init__::225::IOProcess::(_processLogs) (542363) Queuing response >Thread-19::DEBUG::2014-08-11 17:42:55,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:42:55,292::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:42:56,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:56,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:42:56,077::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:56,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:42:56,341::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0493284 s, 20.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:56,877::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:56,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:42:56,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:58,349::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:42:58,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`9858f7f7-0ea9-4063-bee1-76821e3ada09`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:58,410::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:42:58,411::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654496', 'lastCheck': '3.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000782278', 'lastCheck': '8.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:58,411::task::1191::Storage.TaskManager.Task::(prepare) Task=`9858f7f7-0ea9-4063-bee1-76821e3ada09`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000654496', 'lastCheck': '3.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000782278', 'lastCheck': '8.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:42:58,411::task::595::Storage.TaskManager.Task::(_updateState) Task=`9858f7f7-0ea9-4063-bee1-76821e3ada09`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:58,411::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:58,411::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:58,411::task::993::Storage.TaskManager.Task::(_decref) Task=`9858f7f7-0ea9-4063-bee1-76821e3ada09`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:42:58,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:42:58,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:42:58,443::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0334484 s, 30.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:42:59,785::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:42:59,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e82cc4a-0abc-44df-99a5-703a56e7e59e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:42:59,786::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:42:59,835::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:59,836::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e82cc4a-0abc-44df-99a5-703a56e7e59e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:42:59,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e82cc4a-0abc-44df-99a5-703a56e7e59e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:42:59,836::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:42:59,836::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:42:59,836::task::993::Storage.TaskManager.Task::(_decref) Task=`3e82cc4a-0abc-44df-99a5-703a56e7e59e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:42:59,843::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:42:59,844::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6e57462-049a-4ae5-ac4a-559e34f6016c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:42:59,844::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:42:59,844::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4dbe2df5-d952-4877-8c37-731ae67c9559`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:42:59,844::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:42:59,844::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:42:59,844::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4dbe2df5-d952-4877-8c37-731ae67c9559`::Granted request >Thread-10197::DEBUG::2014-08-11 17:42:59,844::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c6e57462-049a-4ae5-ac4a-559e34f6016c`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:42:59,845::task::993::Storage.TaskManager.Task::(_decref) Task=`c6e57462-049a-4ae5-ac4a-559e34f6016c`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:42:59,868::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:59,868::task::1191::Storage.TaskManager.Task::(prepare) Task=`c6e57462-049a-4ae5-ac4a-559e34f6016c`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:42:59,868::task::595::Storage.TaskManager.Task::(_updateState) Task=`c6e57462-049a-4ae5-ac4a-559e34f6016c`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:42:59,868::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:42:59,868::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:42:59,868::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:42:59,868::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:42:59,868::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:42:59,869::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:42:59,869::task::993::Storage.TaskManager.Task::(_decref) Task=`c6e57462-049a-4ae5-ac4a-559e34f6016c`::ref 0 aborting False >Thread-10102::DEBUG::2014-08-11 17:43:00,071::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:43:00,434::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:00,434::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:00,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:00,434::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:00,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:00,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:00,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:00,435::__init__::225::IOProcess::(_processLogs) (542364) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:00,435::__init__::225::IOProcess::(_processLogs) (542364) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:00,442::__init__::225::IOProcess::(_processLogs) DEBUG|(542364) Building response >Thread-19::DEBUG::2014-08-11 17:43:00,442::__init__::225::IOProcess::(_processLogs) (542364) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:00,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:00,442::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:43:00,443::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:00,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:43:00,617::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000862297 s, 574 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:00,617::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:00,617::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:00,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:00,618::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:00,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) (542365) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) (542365) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) (542365) Building response >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) (542365) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:43:00,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) (542366) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) (542366) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) (542366) Building response >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) (542366) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:00,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:00,621::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) (542367) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) (542367) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) (542367) Building response >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) (542367) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:43:00,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:00,623::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:00,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:00,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:00,623::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:00,624::__init__::225::IOProcess::(_processLogs) (542368) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:00,624::__init__::225::IOProcess::(_processLogs) (542368) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:00,624::__init__::225::IOProcess::(_processLogs) (542368) Building response >Thread-19::DEBUG::2014-08-11 17:43:00,624::__init__::225::IOProcess::(_processLogs) (542368) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:00,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:00,624::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:43:00,630::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128818 s, 79.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:43:01,081::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:01,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:01,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:01,884::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:01,886::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:01,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:02,638::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:02,742::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300114 s, 34.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:43:02,874::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:43:04,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:04,822::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132423 s, 77.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) (542369) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) (542369) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:05,293::__init__::225::IOProcess::(_processLogs) DEBUG|(542369) Building response >Thread-19::DEBUG::2014-08-11 17:43:05,294::__init__::225::IOProcess::(_processLogs) (542369) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:05,294::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:43:05,294::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:05,295::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:43:05,355::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000875586 s, 418 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:05,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:05,355::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) (542370) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) (542370) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:05,356::__init__::225::IOProcess::(_processLogs) DEBUG|(542370) Building response >Thread-19::DEBUG::2014-08-11 17:43:05,357::__init__::225::IOProcess::(_processLogs) (542370) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:05,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:05,357::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:43:06,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:06,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:06,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:06,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:06,895::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:06,895::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:06,896::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:06,901::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124337 s, 82.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:43:08,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:09,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0364614 s, 28.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:09,891::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:09,891::task::595::Storage.TaskManager.Task::(_updateState) Task=`7665c64c-34e6-4460-8d47-8794d7f27f9b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:09,891::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:43:09,918::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:09,919::task::1191::Storage.TaskManager.Task::(prepare) Task=`7665c64c-34e6-4460-8d47-8794d7f27f9b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:09,919::task::595::Storage.TaskManager.Task::(_updateState) Task=`7665c64c-34e6-4460-8d47-8794d7f27f9b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:09,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:09,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:09,919::task::993::Storage.TaskManager.Task::(_decref) Task=`7665c64c-34e6-4460-8d47-8794d7f27f9b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:43:09,926::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:43:09,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`609513bf-7164-4ef8-8f24-21d71f5538b2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:43:09,926::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:43:09,926::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`27c9a606-db02-4ea3-857d-80bd422272b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:43:09,926::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:43:09,927::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:43:09,927::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`27c9a606-db02-4ea3-857d-80bd422272b6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:43:09,927::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`609513bf-7164-4ef8-8f24-21d71f5538b2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:43:09,927::task::993::Storage.TaskManager.Task::(_decref) Task=`609513bf-7164-4ef8-8f24-21d71f5538b2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:43:09,943::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:09,943::task::1191::Storage.TaskManager.Task::(prepare) Task=`609513bf-7164-4ef8-8f24-21d71f5538b2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:09,943::task::595::Storage.TaskManager.Task::(_updateState) Task=`609513bf-7164-4ef8-8f24-21d71f5538b2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:43:09,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:43:09,943::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:43:09,944::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:43:09,944::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:43:09,944::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:43:09,944::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:43:09,944::task::993::Storage.TaskManager.Task::(_decref) Task=`609513bf-7164-4ef8-8f24-21d71f5538b2`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:43:10,029::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-28::DEBUG::2014-08-11 17:43:10,623::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,625::__init__::225::IOProcess::(_processLogs) (542371) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:10,626::__init__::225::IOProcess::(_processLogs) (542371) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:43:10,626::__init__::225::IOProcess::(_processLogs) DEBUG|(542371) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,627::__init__::225::IOProcess::(_processLogs) (542371) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,628::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:43:10,629::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,630::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:43:10,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,631::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,636::__init__::225::IOProcess::(_processLogs) (542372) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:10,637::__init__::225::IOProcess::(_processLogs) (542372) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:43:10,638::__init__::225::IOProcess::(_processLogs) DEBUG|(542372) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,639::__init__::225::IOProcess::(_processLogs) (542372) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,640::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,641::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-28::DEBUG::2014-08-11 17:43:10,643::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,643::__init__::225::IOProcess::(_processLogs) (542373) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:43:10,644::__init__::225::IOProcess::(_processLogs) (542373) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:43:10,662::__init__::225::IOProcess::(_processLogs) DEBUG|(542373) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,662::__init__::225::IOProcess::(_processLogs) (542373) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,662::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:43:10,662::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:43:10,663::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:10,663::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,663::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) (542374) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) (542374) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) DEBUG|(542374) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,664::__init__::225::IOProcess::(_processLogs) (542374) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,665::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:43:10,665::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:43:10,665::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-19::DEBUG::2014-08-11 17:43:10,666::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,666::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:43:10,666::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) (542375) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) (542375) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) (542375) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) (542375) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,667::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) (542376) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) (542376) Got request for method 'glob' >Thread-28::DEBUG::2014-08-11 17:43:10,668::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:43:10,668::__init__::225::IOProcess::(_processLogs) DEBUG|(542376) Building response >Thread-28::INFO::2014-08-11 17:43:10,669::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-28::INFO::2014-08-11 17:43:10,669::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:43:10,669::__init__::225::IOProcess::(_processLogs) (542376) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,671::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,671::__init__::225::IOProcess::(_processLogs) (542377) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:10,671::__init__::225::IOProcess::(_processLogs) (542377) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:10,671::__init__::225::IOProcess::(_processLogs) DEBUG|(542377) Building response >Thread-28::DEBUG::2014-08-11 17:43:10,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:10,672::__init__::225::IOProcess::(_processLogs) (542377) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,730::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,730::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:43:10,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00110775 s, 447 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) (542378) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:10,733::__init__::225::IOProcess::(_processLogs) (542378) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:10,734::__init__::225::IOProcess::(_processLogs) DEBUG|(542378) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,734::__init__::225::IOProcess::(_processLogs) (542378) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,734::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) (542379) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) (542379) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:10,735::__init__::225::IOProcess::(_processLogs) DEBUG|(542379) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) (542379) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) (542380) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) (542380) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) DEBUG|(542380) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) (542380) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,737::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:10,738::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:10,739::__init__::225::IOProcess::(_processLogs) (542381) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:10,739::__init__::225::IOProcess::(_processLogs) (542381) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:10,739::__init__::225::IOProcess::(_processLogs) (542381) Building response >Thread-19::DEBUG::2014-08-11 17:43:10,739::__init__::225::IOProcess::(_processLogs) (542381) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:10,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:10,739::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:43:11,013::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:11,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144943 s, 70.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:43:11,094::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:11,095::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:11,095::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:11,901::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:11,902::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:11,902::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:13,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:13,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0564833 s, 18.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:13,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be2a781-cf54-4259-9c90-b70b5c6c74a3`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:13,651::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:43:13,651::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000875586', 'lastCheck': '8.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110775', 'lastCheck': '2.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:13,651::task::1191::Storage.TaskManager.Task::(prepare) Task=`6be2a781-cf54-4259-9c90-b70b5c6c74a3`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000875586', 'lastCheck': '8.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110775', 'lastCheck': '2.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:13,651::task::595::Storage.TaskManager.Task::(_updateState) Task=`6be2a781-cf54-4259-9c90-b70b5c6c74a3`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:13,651::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:13,652::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:13,652::task::993::Storage.TaskManager.Task::(_decref) Task=`6be2a781-cf54-4259-9c90-b70b5c6c74a3`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:13,671::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:43:13,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10102::DEBUG::2014-08-11 17:43:15,079::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:43:15,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:15,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0512279 s, 20.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) (542382) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:15,358::__init__::225::IOProcess::(_processLogs) (542382) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:15,359::__init__::225::IOProcess::(_processLogs) DEBUG|(542382) Building response >Thread-19::DEBUG::2014-08-11 17:43:15,359::__init__::225::IOProcess::(_processLogs) (542382) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:15,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:15,359::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:43:15,360::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:43:15,420::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.001147 s, 319 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) (542383) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:15,421::__init__::225::IOProcess::(_processLogs) (542383) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:15,422::__init__::225::IOProcess::(_processLogs) DEBUG|(542383) Building response >Thread-19::DEBUG::2014-08-11 17:43:15,422::__init__::225::IOProcess::(_processLogs) (542383) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:15,422::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:15,423::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:43:16,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:16,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:16,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:43:16,098::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [49207b88] >Thread-10197::DEBUG::2014-08-11 17:43:16,099::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:43:16,099::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', size='1350565888', volFormat=5, preallocate=2, diskType=2, volUUID='041ad999-7aa9-4dcf-a3b1-bf962cc75c25', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-10197::DEBUG::2014-08-11 17:43:16,099::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`9a3de86b-a513-4eb3-8896-2a9c9ad1ad6a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-10197::DEBUG::2014-08-11 17:43:16,099::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:43:16,099::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:43:16,099::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`9a3de86b-a513-4eb3-8896-2a9c9ad1ad6a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:43:16,100::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10197::DEBUG::2014-08-11 17:43:16,100::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:43:16,100::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,100::__init__::225::IOProcess::(_processLogs) Message size is 73 >Thread-19::DEBUG::2014-08-11 17:43:16,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) (542384) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) (542384) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) (542384) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) (542384) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) Message size is 77 >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) (542385) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,102::__init__::225::IOProcess::(_processLogs) (542385) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) (542385) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) (542385) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Message size is 89 >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) (542386) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) (542386) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) (542386) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) (542386) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,104::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) (542387) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) (542387) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) (542387) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,105::__init__::225::IOProcess::(_processLogs) (542387) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Message size is 135 >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,106::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) (542388) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) (542388) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) (542388) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) (542388) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) (542389) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) (542389) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) DEBUG|(542389) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,108::__init__::225::IOProcess::(_processLogs) (542389) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,109::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) (542390) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) (542390) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) DEBUG|(542390) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) (542390) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,110::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) Message size is 185 >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) (542391) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,111::__init__::225::IOProcess::(_processLogs) (542391) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,146::__init__::225::IOProcess::(_processLogs) DEBUG|(542391) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,146::__init__::225::IOProcess::(_processLogs) (542391) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,146::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,147::__init__::225::IOProcess::(_processLogs) (542392) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,148::__init__::225::IOProcess::(_processLogs) (542392) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,148::__init__::225::IOProcess::(_processLogs) DEBUG|(542392) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,148::__init__::225::IOProcess::(_processLogs) (542392) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,148::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:16,148::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:16,149::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,149::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) (542393) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) (542393) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542393) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) (542393) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,150::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) (542394) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) (542394) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) (542394) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) (542394) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,152::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,153::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,153::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,153::__init__::225::IOProcess::(_processLogs) (542395) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,153::__init__::225::IOProcess::(_processLogs) (542395) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,166::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542395) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,166::__init__::225::IOProcess::(_processLogs) (542395) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,166::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,167::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,167::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,167::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,167::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,168::__init__::225::IOProcess::(_processLogs) (542396) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,168::__init__::225::IOProcess::(_processLogs) (542396) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,191::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542396) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,191::__init__::225::IOProcess::(_processLogs) (542396) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,191::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,192::__init__::225::IOProcess::(_processLogs) (542397) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,193::__init__::225::IOProcess::(_processLogs) (542397) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,193::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542397) Building response >Thread-10197::WARNING::2014-08-11 17:43:16,193::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,193::__init__::225::IOProcess::(_processLogs) (542397) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,195::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,195::__init__::225::IOProcess::(_processLogs) (542398) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,195::__init__::225::IOProcess::(_processLogs) (542398) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,211::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542398) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,211::__init__::225::IOProcess::(_processLogs) (542398) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,211::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::WARNING::2014-08-11 17:43:16,211::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,212::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,212::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,212::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,212::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,213::__init__::225::IOProcess::(_processLogs) (542399) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,213::__init__::225::IOProcess::(_processLogs) (542399) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,227::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542399) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,227::__init__::225::IOProcess::(_processLogs) (542399) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,227::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) (542400) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,228::__init__::225::IOProcess::(_processLogs) (542400) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,263::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542400) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,263::__init__::225::IOProcess::(_processLogs) (542400) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,263::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,264::__init__::225::IOProcess::(_processLogs) (542401) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,265::__init__::225::IOProcess::(_processLogs) (542401) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:16,272::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542401) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,272::__init__::225::IOProcess::(_processLogs) (542401) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,272::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,273::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,273::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,273::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:16,273::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,273::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::DEBUG::2014-08-11 17:43:16,273::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a >Thread-19::DEBUG::2014-08-11 17:43:16,274::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10197::INFO::2014-08-11 17:43:16,274::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-19::DEBUG::2014-08-11 17:43:16,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10197::DEBUG::2014-08-11 17:43:16,274::task::1183::Storage.TaskManager.Task::(prepare) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::Prepare: 1 jobs exist, move to acquiring >Thread-19::DEBUG::2014-08-11 17:43:16,275::__init__::225::IOProcess::(_processLogs) (542402) Finding callback 'lexists'... >Thread-10197::DEBUG::2014-08-11 17:43:16,275::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-08-11 17:43:16,275::__init__::225::IOProcess::(_processLogs) (542402) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) (542402) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) (542402) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,277::__init__::225::IOProcess::(_processLogs) (542403) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,277::__init__::225::IOProcess::(_processLogs) (542403) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,277::__init__::225::IOProcess::(_processLogs) (542403) Queuing response >Thread-10197::DEBUG::2014-08-11 17:43:16,277::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:16,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) (542404) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) (542404) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) (542404) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,278::__init__::225::IOProcess::(_processLogs) (542404) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,279::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,279::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,279::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,279::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,279::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) (542405) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) (542405) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) (542405) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) (542405) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,281::__init__::225::IOProcess::(_processLogs) (542406) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,281::__init__::225::IOProcess::(_processLogs) (542406) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,286::__init__::225::IOProcess::(_processLogs) (542406) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,286::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) (542407) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,287::__init__::225::IOProcess::(_processLogs) (542407) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,307::__init__::225::IOProcess::(_processLogs) (542407) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,307::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) (542408) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,308::__init__::225::IOProcess::(_processLogs) (542408) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,333::__init__::225::IOProcess::(_processLogs) (542408) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,333::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,334::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::WARNING::2014-08-11 17:43:16,334::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,334::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) (542409) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) (542409) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) (542409) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) (542409) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,335::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) (542410) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,336::__init__::225::IOProcess::(_processLogs) (542410) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,343::__init__::225::IOProcess::(_processLogs) DEBUG|(542410) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,344::__init__::225::IOProcess::(_processLogs) (542410) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,344::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::WARNING::2014-08-11 17:43:16,344::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,344::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,345::__init__::225::IOProcess::(_processLogs) (542411) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,346::__init__::225::IOProcess::(_processLogs) (542411) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,355::__init__::225::IOProcess::(_processLogs) DEBUG|(542411) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,355::__init__::225::IOProcess::(_processLogs) (542411) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,355::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,355::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,355::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,355::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) (542412) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,356::__init__::225::IOProcess::(_processLogs) (542412) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,358::__init__::225::IOProcess::(_processLogs) DEBUG|(542412) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,358::__init__::225::IOProcess::(_processLogs) (542412) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,358::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,358::__init__::225::IOProcess::(_processLogs) Sending response sized 99 >Thread-19::DEBUG::2014-08-11 17:43:16,358::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,359::__init__::225::IOProcess::(_processLogs) (542413) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) (542413) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) (542413) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) (542413) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,360::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,361::__init__::225::IOProcess::(_processLogs) (542414) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,361::__init__::225::IOProcess::(_processLogs) (542414) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,371::__init__::225::IOProcess::(_processLogs) DEBUG|(542414) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,371::__init__::225::IOProcess::(_processLogs) (542414) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,371::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,371::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) (542415) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,372::__init__::225::IOProcess::(_processLogs) (542415) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:16,387::__init__::225::IOProcess::(_processLogs) DEBUG|(542415) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,387::__init__::225::IOProcess::(_processLogs) (542415) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,387::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,387::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) (542416) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:16,388::__init__::225::IOProcess::(_processLogs) (542416) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:16,389::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542416) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,389::__init__::225::IOProcess::(_processLogs) (542416) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,390::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:16,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-08-11 17:43:16,390::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) (542417) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,391::__init__::225::IOProcess::(_processLogs) (542417) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,392::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542417) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,392::__init__::225::IOProcess::(_processLogs) (542417) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,392::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:16,392::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:16,393::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,393::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,393::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,394::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,394::__init__::225::IOProcess::(_processLogs) (542418) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,394::__init__::225::IOProcess::(_processLogs) (542418) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,396::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542418) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,396::__init__::225::IOProcess::(_processLogs) (542418) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,396::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,397::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,397::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) (542419) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) (542419) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) (542419) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) (542419) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,399::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,399::__init__::225::IOProcess::(_processLogs) (542420) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,399::__init__::225::IOProcess::(_processLogs) (542420) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,420::__init__::225::IOProcess::(_processLogs) (542420) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,420::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) (542421) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,421::__init__::225::IOProcess::(_processLogs) (542421) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,450::__init__::225::IOProcess::(_processLogs) (542421) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,450::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,450::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:16,451::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,451::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,451::__init__::225::IOProcess::(_processLogs) (542422) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,451::__init__::225::IOProcess::(_processLogs) (542422) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,468::__init__::225::IOProcess::(_processLogs) (542422) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,468::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,468::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,468::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::WARNING::2014-08-11 17:43:16,469::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) (542423) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) (542423) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) (542423) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) (542423) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,471::__init__::225::IOProcess::(_processLogs) (542424) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,471::__init__::225::IOProcess::(_processLogs) (542424) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,480::__init__::225::IOProcess::(_processLogs) (542424) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,480::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:43:16,480::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,480::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,481::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,481::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,481::__init__::225::IOProcess::(_processLogs) (542425) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,481::__init__::225::IOProcess::(_processLogs) (542425) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,490::__init__::225::IOProcess::(_processLogs) (542425) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,490::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) (542426) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,491::__init__::225::IOProcess::(_processLogs) (542426) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,492::__init__::225::IOProcess::(_processLogs) (542426) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,492::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:43:16,492::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:16,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) (542427) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) (542427) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) (542427) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) (542427) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,493::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) (542428) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,494::__init__::225::IOProcess::(_processLogs) (542428) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,503::__init__::225::IOProcess::(_processLogs) (542428) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,503::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,503::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:16,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) (542429) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) (542429) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) (542429) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) (542429) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,504::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:16,505::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,505::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,505::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,505::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,505::__init__::225::IOProcess::(_processLogs) (542430) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,505::__init__::225::IOProcess::(_processLogs) (542430) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,509::__init__::225::IOProcess::(_processLogs) (542430) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,509::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) (542431) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,510::__init__::225::IOProcess::(_processLogs) (542431) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:16,521::__init__::225::IOProcess::(_processLogs) (542431) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) (542432) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:16,522::__init__::225::IOProcess::(_processLogs) (542432) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:16,523::__init__::225::IOProcess::(_processLogs) (542432) Queuing response >Thread-10197::DEBUG::2014-08-11 17:43:16,523::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a >Thread-19::DEBUG::2014-08-11 17:43:16,523::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:16,523::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a >fd387023-cd7f-4ba1-9d20-6d42f853109f::DEBUG::2014-08-11 17:43:16,523::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-19::DEBUG::2014-08-11 17:43:16,524::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:43:16,524::task::1188::Storage.TaskManager.Task::(prepare) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::returning >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,524::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a running: <bound method Task.commit of <storage.task.Task instance at 0x7f2c786b6560>> with: None >Thread-10197::DEBUG::2014-08-11 17:43:16,525::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::ref 0 aborting False >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,525::task::1200::Storage.TaskManager.Task::(commit) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::committing task: 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::moving from state queued -> state running >Thread-19::DEBUG::2014-08-11 17:43:16,526::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,526::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,526::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,526::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,526::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,527::__init__::225::IOProcess::(_processLogs) (542433) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,527::__init__::225::IOProcess::(_processLogs) (542433) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,527::__init__::225::IOProcess::(_processLogs) (542433) Queuing response >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,527::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:16,527::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) (542434) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) (542434) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,528::__init__::225::IOProcess::(_processLogs) (542434) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,529::__init__::225::IOProcess::(_processLogs) (542435) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) (542435) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) (542435) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) (542435) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,531::__init__::225::IOProcess::(_processLogs) (542436) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,531::__init__::225::IOProcess::(_processLogs) (542436) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,540::__init__::225::IOProcess::(_processLogs) (542436) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,541::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,541::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,542::__init__::225::IOProcess::(_processLogs) (542437) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,542::__init__::225::IOProcess::(_processLogs) (542437) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,565::__init__::225::IOProcess::(_processLogs) (542437) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,565::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) (542438) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,566::__init__::225::IOProcess::(_processLogs) (542438) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,590::__init__::225::IOProcess::(_processLogs) (542438) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,590::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) (542439) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) (542439) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) (542439) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) (542439) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,591::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:16,591::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) (542440) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,592::__init__::225::IOProcess::(_processLogs) (542440) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,603::__init__::225::IOProcess::(_processLogs) (542440) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,603::__init__::225::IOProcess::(_processLogs) Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:16,603::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,603::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,603::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,604::__init__::225::IOProcess::(_processLogs) (542441) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,604::__init__::225::IOProcess::(_processLogs) (542441) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,615::__init__::225::IOProcess::(_processLogs) (542441) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) (542442) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,616::__init__::225::IOProcess::(_processLogs) (542442) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,618::__init__::225::IOProcess::(_processLogs) (542442) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,619::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:16,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,619::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) (542443) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) (542443) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) (542443) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) (542443) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,621::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,621::__init__::225::IOProcess::(_processLogs) (542444) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,621::__init__::225::IOProcess::(_processLogs) (542444) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,631::__init__::225::IOProcess::(_processLogs) (542444) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,631::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,631::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:16,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,631::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) (542445) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) (542445) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) (542445) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) (542445) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,632::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:16,633::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,633::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,633::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,633::__init__::225::IOProcess::(_processLogs) (542446) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,633::__init__::225::IOProcess::(_processLogs) (542446) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,640::__init__::225::IOProcess::(_processLogs) (542446) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,640::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,640::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,640::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,641::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,641::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,641::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,641::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,641::__init__::225::IOProcess::(_processLogs) (542447) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,641::__init__::225::IOProcess::(_processLogs) (542447) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:16,654::__init__::225::IOProcess::(_processLogs) (542447) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,654::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) (542448) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) (542448) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) (542448) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,655::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,656::task::905::Storage.TaskManager.Task::(_runJobs) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', 2637824, 5, 2, 2, '041ad999-7aa9-4dcf-a3b1-bf962cc75c25', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,656::task::331::Storage.TaskManager.Task::(run) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', 2637824, 5, 2, 2, '041ad999-7aa9-4dcf-a3b1-bf962cc75c25', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,656::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856`ReqID=`2764592b-9074-4cf7-99ee-248181199467`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1792' at 'createVolume' >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,656::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856' for lock type 'exclusive' >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) (542449) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:16,657::__init__::225::IOProcess::(_processLogs) (542449) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:43:16,658::__init__::225::IOProcess::(_processLogs) (542449) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,658::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,658::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 does not exist in domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,658::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856' is free. Now locking as 'exclusive' (1 active user) >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,658::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856`ReqID=`2764592b-9074-4cf7-99ee-248181199467`::Granted request >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::INFO::2014-08-11 17:43:16,659::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 for image's volumes >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) (542450) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,659::__init__::225::IOProcess::(_processLogs) (542450) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,660::__init__::225::IOProcess::(_processLogs) DEBUG|(542450) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,660::__init__::225::IOProcess::(_processLogs) (542450) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,660::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,660::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:16,660::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) (542451) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,661::__init__::225::IOProcess::(_processLogs) (542451) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,662::__init__::225::IOProcess::(_processLogs) DEBUG|(542451) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,662::__init__::225::IOProcess::(_processLogs) (542451) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,663::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-10197::DEBUG::2014-08-11 17:43:16,663::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [49207b88] >Thread-19::DEBUG::2014-08-11 17:43:16,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10197::DEBUG::2014-08-11 17:43:16,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:43:16,665::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-10197::INFO::2014-08-11 17:43:16,665::logUtils::44::dispatcher::(wrapper) Run and protect: createVolume(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', size='10240', volFormat=4, preallocate=2, diskType=2, volUUID='cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', desc='', srcImgUUID='00000000-0000-0000-0000-000000000000', srcVolUUID='00000000-0000-0000-0000-000000000000') >Thread-19::DEBUG::2014-08-11 17:43:16,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,666::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::DEBUG::2014-08-11 17:43:16,667::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`02b3b62b-ed9f-46f6-918b-7665f237b8a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1458' at 'createVolume' >Thread-10197::DEBUG::2014-08-11 17:43:16,667::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-19::DEBUG::2014-08-11 17:43:16,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10197::DEBUG::2014-08-11 17:43:16,668::resourceManager::566::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-19::DEBUG::2014-08-11 17:43:16,668::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10197::DEBUG::2014-08-11 17:43:16,668::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`02b3b62b-ed9f-46f6-918b-7665f237b8a5`::Granted request >Thread-19::DEBUG::2014-08-11 17:43:16,669::__init__::225::IOProcess::(_processLogs) (542452) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,669::__init__::225::IOProcess::(_processLogs) (542452) Got request for method 'access' >Thread-10197::DEBUG::2014-08-11 17:43:16,669::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-19::DEBUG::2014-08-11 17:43:16,670::__init__::225::IOProcess::(_processLogs) (542452) Building response >Thread-10197::DEBUG::2014-08-11 17:43:16,670::task::993::Storage.TaskManager.Task::(_decref) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:43:16,670::__init__::225::IOProcess::(_processLogs) (542452) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,671::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,671::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,671::__init__::225::IOProcess::(_processLogs) Message size is 73 >Thread-19::DEBUG::2014-08-11 17:43:16,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,671::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) (542453) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) (542453) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) (542453) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) (542453) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,672::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) (542454) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) (542454) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,673::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) Message size is 77 >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) (542455) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,674::__init__::225::IOProcess::(_processLogs) (542455) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) (542455) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) (542455) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) Message size is 89 >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,675::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) (542456) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) (542456) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) (542456) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) (542456) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,676::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) (542457) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) (542457) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) (542457) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,677::__init__::225::IOProcess::(_processLogs) (542457) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) Message size is 135 >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,678::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) (542458) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) (542458) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) (542458) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) (542458) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,679::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) (542459) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) (542459) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) DEBUG|(542459) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) (542459) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,680::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) (542460) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) (542460) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,681::__init__::225::IOProcess::(_processLogs) DEBUG|(542460) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) (542460) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) Message size is 185 >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,682::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,683::__init__::225::IOProcess::(_processLogs) (542461) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,683::__init__::225::IOProcess::(_processLogs) (542461) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,684::__init__::225::IOProcess::(_processLogs) DEBUG|(542454) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,684::__init__::225::IOProcess::(_processLogs) (542454) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,684::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,685::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,685::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,685::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,686::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,686::__init__::225::IOProcess::(_processLogs) (542462) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,686::__init__::225::IOProcess::(_processLogs) (542462) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,727::__init__::225::IOProcess::(_processLogs) DEBUG|(542461) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,727::__init__::225::IOProcess::(_processLogs) (542461) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,728::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,729::__init__::225::IOProcess::(_processLogs) (542463) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,729::__init__::225::IOProcess::(_processLogs) (542463) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,729::__init__::225::IOProcess::(_processLogs) DEBUG|(542463) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,729::__init__::225::IOProcess::(_processLogs) (542463) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,729::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:16,730::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:16,730::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,730::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,730::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,730::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) (542464) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) (542464) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) DEBUG|(542464) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) (542464) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,732::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) (542465) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) (542465) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) (542465) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) (542465) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,733::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,734::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,734::__init__::225::IOProcess::(_processLogs) (542466) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,734::__init__::225::IOProcess::(_processLogs) (542466) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,738::__init__::225::IOProcess::(_processLogs) DEBUG|(542462) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,738::__init__::225::IOProcess::(_processLogs) (542462) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,738::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,738::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,738::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) (542467) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,739::__init__::225::IOProcess::(_processLogs) (542467) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,749::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,749::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,750::__init__::225::IOProcess::(_processLogs) (542468) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,750::__init__::225::IOProcess::(_processLogs) (542468) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,788::__init__::225::IOProcess::(_processLogs) DEBUG|(542467) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,788::__init__::225::IOProcess::(_processLogs) (542467) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,788::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) (542469) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,789::__init__::225::IOProcess::(_processLogs) (542469) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) DEBUG|(542468) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) (542468) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,794::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,795::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,795::__init__::225::IOProcess::(_processLogs) (542470) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,795::__init__::225::IOProcess::(_processLogs) (542470) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,795::__init__::225::IOProcess::(_processLogs) DEBUG|(542470) Building response >Thread-10197::WARNING::2014-08-11 17:43:16,795::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,796::__init__::225::IOProcess::(_processLogs) (542470) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,796::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,796::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:16,796::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,796::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) (542471) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,797::__init__::225::IOProcess::(_processLogs) (542471) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,807::__init__::225::IOProcess::(_processLogs) DEBUG|(542471) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,807::__init__::225::IOProcess::(_processLogs) (542471) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,807::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::WARNING::2014-08-11 17:43:16,807::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,809::__init__::225::IOProcess::(_processLogs) (542472) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,809::__init__::225::IOProcess::(_processLogs) (542472) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,813::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542469) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,813::__init__::225::IOProcess::(_processLogs) (542469) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,813::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,813::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,813::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) (542473) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,814::__init__::225::IOProcess::(_processLogs) (542473) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,817::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542472) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,817::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542472) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,817::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:16,818::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,818::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542473) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,818::__init__::225::IOProcess::(_processLogs) (542473) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) (542474) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,819::__init__::225::IOProcess::(_processLogs) (542474) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) (542475) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,820::__init__::225::IOProcess::(_processLogs) (542475) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,823::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542474) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,823::__init__::225::IOProcess::(_processLogs) (542474) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,823::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,823::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,823::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) (542476) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,824::__init__::225::IOProcess::(_processLogs) (542476) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:16,832::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542475) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,832::__init__::225::IOProcess::(_processLogs) (542475) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,832::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:16,832::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,832::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,833::__init__::225::IOProcess::(_processLogs) (542477) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,834::__init__::225::IOProcess::(_processLogs) (542477) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,846::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542476) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,846::__init__::225::IOProcess::(_processLogs) (542476) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,846::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,846::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,846::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) (542478) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) (542478) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542478) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,847::__init__::225::IOProcess::(_processLogs) (542478) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,848::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:16,848::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job createVolume for task d1919e29-2350-4faa-8241-34d8964ddb72 >Thread-19::DEBUG::2014-08-11 17:43:16,848::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::INFO::2014-08-11 17:43:16,848::logUtils::47::dispatcher::(wrapper) Run and protect: createVolume, Return response: None >Thread-10197::DEBUG::2014-08-11 17:43:16,849::task::1183::Storage.TaskManager.Task::(prepare) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::Prepare: 1 jobs exist, move to acquiring >Thread-10197::DEBUG::2014-08-11 17:43:16,849::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,850::__init__::225::IOProcess::(_processLogs) (542479) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,850::__init__::225::IOProcess::(_processLogs) (542479) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,850::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542479) Building response >Thread-10197::DEBUG::2014-08-11 17:43:16,850::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:16,850::__init__::225::IOProcess::(_processLogs) (542479) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,851::__init__::225::IOProcess::(_processLogs) (542480) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,852::__init__::225::IOProcess::(_processLogs) (542480) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,854::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542477) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,854::__init__::225::IOProcess::(_processLogs) (542477) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,855::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,855::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,855::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542480) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,855::__init__::225::IOProcess::(_processLogs) (542480) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) (542481) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,856::__init__::225::IOProcess::(_processLogs) (542481) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,857::__init__::225::IOProcess::(_processLogs) (542482) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) (542482) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) (542482) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) (542482) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542481) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) (542481) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,858::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) (542483) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) (542483) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,859::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) (542484) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,860::__init__::225::IOProcess::(_processLogs) (542484) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) (542484) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) (542484) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,861::__init__::225::IOProcess::(_processLogs) (542485) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,862::__init__::225::IOProcess::(_processLogs) (542485) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,870::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542483) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,870::__init__::225::IOProcess::(_processLogs) (542483) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,870::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,872::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,872::__init__::225::IOProcess::(_processLogs) (542486) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,872::__init__::225::IOProcess::(_processLogs) (542486) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542485) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,877::__init__::225::IOProcess::(_processLogs) (542485) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,877::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,877::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) (542487) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) (542487) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,878::__init__::225::IOProcess::(_processLogs) (542487) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) (542487) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) (542488) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,879::__init__::225::IOProcess::(_processLogs) (542488) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,896::__init__::225::IOProcess::(_processLogs) (542488) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,896::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) (542489) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,897::__init__::225::IOProcess::(_processLogs) (542489) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:16,904::__init__::225::IOProcess::(_processLogs) (542486) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,904::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) (542490) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,905::__init__::225::IOProcess::(_processLogs) (542490) Got request for method 'writefile' >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:16,908::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:16,908::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:16,909::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:43:16,915::__init__::225::IOProcess::(_processLogs) (542489) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,917::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,917::__init__::225::IOProcess::(_processLogs) (542491) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:16,917::__init__::225::IOProcess::(_processLogs) (542491) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:16,917::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|(542491) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,917::__init__::225::IOProcess::(_processLogs) (542491) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,918::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,918::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::INFO::2014-08-11 17:43:16,941::volume::415::Storage.Volume::(create) Creating volume 041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) (542492) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,942::__init__::225::IOProcess::(_processLogs) (542492) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,944::__init__::225::IOProcess::(_processLogs) (542489) Queuing responseDEBUG|(542492) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,944::__init__::225::IOProcess::(_processLogs) (542492) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,944::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:16,944::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) (542493) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) (542493) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,945::__init__::225::IOProcess::(_processLogs) (542493) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) (542490) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:16,946::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) (542494) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) (542494) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) (542494) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) (542494) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,948::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:16,948::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::WARNING::2014-08-11 17:43:16,948::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) (542495) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) (542495) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) (542495) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) (542495) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:16,949::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) (542496) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) (542496) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,950::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,951::__init__::225::IOProcess::(_processLogs) (542497) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,951::__init__::225::IOProcess::(_processLogs) (542497) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,957::__init__::225::IOProcess::(_processLogs) (542496) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,957::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) (542498) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,958::__init__::225::IOProcess::(_processLogs) (542498) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,962::__init__::225::IOProcess::(_processLogs) (542497) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,963::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:43:16,963::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:16,963::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:16,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,964::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,964::__init__::225::IOProcess::(_processLogs) (542499) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:16,964::__init__::225::IOProcess::(_processLogs) (542499) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:16,980::__init__::225::IOProcess::(_processLogs) (542499) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,980::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,980::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:16,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,981::__init__::225::IOProcess::(_processLogs) (542500) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,981::__init__::225::IOProcess::(_processLogs) (542500) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:16,982::__init__::225::IOProcess::(_processLogs) (542500) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,982::__init__::225::IOProcess::(_processLogs) Sending response sized 99 >Thread-19::DEBUG::2014-08-11 17:43:16,983::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:16,983::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,983::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,983::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,983::__init__::225::IOProcess::(_processLogs) (542501) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) (542501) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) (542501) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) (542501) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) (542502) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:16,984::__init__::225::IOProcess::(_processLogs) (542502) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:16,985::__init__::225::IOProcess::(_processLogs) (542498) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,985::__init__::225::IOProcess::(_processLogs) (542498) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) (542498) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) (542498) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) (542503) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:16,986::__init__::225::IOProcess::(_processLogs) (542503) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:16,993::__init__::225::IOProcess::(_processLogs) (542498) Queuing responseDEBUG|(542502) Building response >Thread-19::DEBUG::2014-08-11 17:43:16,993::__init__::225::IOProcess::(_processLogs) (542502) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:16,993::__init__::225::IOProcess::(_processLogs) (542498) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) (542498) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) (542504) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:16,994::__init__::225::IOProcess::(_processLogs) (542504) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:17,011::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542504) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,011::__init__::225::IOProcess::(_processLogs) (542504) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,012::__init__::225::IOProcess::(_processLogs) (542505) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:17,013::__init__::225::IOProcess::(_processLogs) (542505) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:17,013::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542505) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,013::__init__::225::IOProcess::(_processLogs) (542505) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,013::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:17,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,014::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,015::__init__::225::IOProcess::(_processLogs) (542506) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,015::__init__::225::IOProcess::(_processLogs) (542506) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,015::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542506) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,015::__init__::225::IOProcess::(_processLogs) (542506) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,015::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:17,015::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) (542507) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) (542507) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542507) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) (542507) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,017::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) (542508) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) (542508) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,018::__init__::225::IOProcess::(_processLogs) (542508) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,019::__init__::225::IOProcess::(_processLogs) (542508) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,019::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,019::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542503) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,019::__init__::225::IOProcess::(_processLogs) (542503) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,019::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) (542509) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) (542509) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:17,020::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) (542510) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,021::__init__::225::IOProcess::(_processLogs) (542510) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,030::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542509) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,031::__init__::225::IOProcess::(_processLogs) (542509) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,031::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,031::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) (542511) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,032::__init__::225::IOProcess::(_processLogs) (542511) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542510) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,057::__init__::225::IOProcess::(_processLogs) (542510) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,057::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,058::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,058::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,058::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:43:17,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,058::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,059::__init__::225::IOProcess::(_processLogs) (542512) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,059::__init__::225::IOProcess::(_processLogs) (542512) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,067::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542511) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,067::__init__::225::IOProcess::(_processLogs) (542511) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,067::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,068::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,068::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,068::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:17,068::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,068::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,068::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,069::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,069::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,069::__init__::225::IOProcess::(_processLogs) (542513) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,069::__init__::225::IOProcess::(_processLogs) (542513) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,098::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542512) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,098::__init__::225::IOProcess::(_processLogs) (542512) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,099::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,099::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,099::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,099::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,100::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:17,100::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) (542514) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) (542514) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) (542514) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) (542514) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,101::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,102::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,102::__init__::225::IOProcess::(_processLogs) (542515) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,102::__init__::225::IOProcess::(_processLogs) (542515) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,107::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542513) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,107::__init__::225::IOProcess::(_processLogs) (542513) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,107::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,108::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,108::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,108::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,108::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,108::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::WARNING::2014-08-11 17:43:17,108::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,109::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) (542516) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) (542516) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) (542516) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) (542516) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,111::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,111::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,111::__init__::225::IOProcess::(_processLogs) (542517) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,111::__init__::225::IOProcess::(_processLogs) (542517) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,113::__init__::225::IOProcess::(_processLogs) DEBUG|(542515) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,113::__init__::225::IOProcess::(_processLogs) (542515) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,113::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,113::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:17,113::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,114::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,114::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:17,114::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,114::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,115::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,115::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,115::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,115::__init__::225::IOProcess::(_processLogs) (542518) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,115::__init__::225::IOProcess::(_processLogs) (542518) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,215::__init__::225::IOProcess::(_processLogs) DEBUG|(542517) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,215::__init__::225::IOProcess::(_processLogs) (542517) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,216::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,216::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:43:17,216::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,216::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,216::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) (542519) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,217::__init__::225::IOProcess::(_processLogs) (542519) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,226::__init__::225::IOProcess::(_processLogs) DEBUG|(542518) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,226::__init__::225::IOProcess::(_processLogs) (542518) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,226::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,227::__init__::225::IOProcess::(_processLogs) (542520) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,228::__init__::225::IOProcess::(_processLogs) (542520) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,230::__init__::225::IOProcess::(_processLogs) DEBUG|(542520) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,230::__init__::225::IOProcess::(_processLogs) (542520) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,230::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,230::__init__::225::IOProcess::(_processLogs) Sending response sized 193 >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) (542521) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) (542521) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) (542521) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) (542521) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,233::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,233::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,233::__init__::225::IOProcess::(_processLogs) (542522) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,233::__init__::225::IOProcess::(_processLogs) (542522) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,237::__init__::225::IOProcess::(_processLogs) DEBUG|(542519) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,237::__init__::225::IOProcess::(_processLogs) (542519) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,237::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) (542523) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,238::__init__::225::IOProcess::(_processLogs) (542523) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,240::__init__::225::IOProcess::(_processLogs) DEBUG|(542523) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,240::__init__::225::IOProcess::(_processLogs) (542523) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,241::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,241::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:43:17,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,241::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:17,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,241::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) (542524) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) (542524) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) (542524) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) (542524) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,242::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) (542525) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,243::__init__::225::IOProcess::(_processLogs) (542525) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,246::__init__::225::IOProcess::(_processLogs) DEBUG|(542522) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,246::__init__::225::IOProcess::(_processLogs) (542522) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,247::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,247::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,247::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,247::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:17,247::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,247::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) (542526) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) (542526) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) (542526) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) (542526) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,248::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) (542527) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,249::__init__::225::IOProcess::(_processLogs) (542527) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,254::__init__::225::IOProcess::(_processLogs) DEBUG|(542525) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,254::__init__::225::IOProcess::(_processLogs) (542525) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,254::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,255::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) (542528) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) (542528) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) (542528) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) (542528) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,256::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,257::__init__::225::IOProcess::(_processLogs) (542529) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,257::__init__::225::IOProcess::(_processLogs) (542529) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,262::__init__::225::IOProcess::(_processLogs) DEBUG|(542527) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,262::__init__::225::IOProcess::(_processLogs) (542527) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,262::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,263::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) (542530) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) (542530) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) (542530) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) (542530) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,265::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,265::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,265::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,265::__init__::225::IOProcess::(_processLogs) (542531) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,265::__init__::225::IOProcess::(_processLogs) (542531) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,270::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542529) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,270::__init__::225::IOProcess::(_processLogs) (542529) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,272::__init__::225::IOProcess::(_processLogs) (542532) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,272::__init__::225::IOProcess::(_processLogs) (542532) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:17,280::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542531) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,280::__init__::225::IOProcess::(_processLogs) (542531) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,280::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,280::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,280::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,280::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) (542533) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,281::__init__::225::IOProcess::(_processLogs) (542533) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:17,290::__init__::225::IOProcess::(_processLogs) DEBUG|(542532) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,290::__init__::225::IOProcess::(_processLogs) (542532) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,290::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,292::__init__::225::IOProcess::(_processLogs) (542534) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:17,292::__init__::225::IOProcess::(_processLogs) (542534) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:17,304::__init__::225::IOProcess::(_processLogs) DEBUG|(542533) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,304::__init__::225::IOProcess::(_processLogs) (542533) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,305::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,306::__init__::225::IOProcess::(_processLogs) (542535) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:17,306::__init__::225::IOProcess::(_processLogs) (542535) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:17,318::__init__::225::IOProcess::(_processLogs) (542535) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,319::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,319::__init__::225::IOProcess::(_processLogs) (542534) Queuing response >Thread-10197::DEBUG::2014-08-11 17:43:17,319::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: d1919e29-2350-4faa-8241-34d8964ddb72 >Thread-19::DEBUG::2014-08-11 17:43:17,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:43:17,320::taskManager::64::Storage.TaskManager::(_queueTask) task queued: d1919e29-2350-4faa-8241-34d8964ddb72 >b62f0f6c-7613-42ee-ae47-8a7115f3459e::DEBUG::2014-08-11 17:43:17,320::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 2 >Thread-19::DEBUG::2014-08-11 17:43:17,321::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:43:17,321::task::1188::Storage.TaskManager.Task::(prepare) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::returning >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,321::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: d1919e29-2350-4faa-8241-34d8964ddb72 running: <bound method Task.commit of <storage.task.Task instance at 0x7f2dc016da28>> with: None >Thread-19::DEBUG::2014-08-11 17:43:17,322::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-10197::DEBUG::2014-08-11 17:43:17,322::task::993::Storage.TaskManager.Task::(_decref) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::ref 0 aborting False >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,322::task::1200::Storage.TaskManager.Task::(commit) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::committing task: d1919e29-2350-4faa-8241-34d8964ddb72 >Thread-19::DEBUG::2014-08-11 17:43:17,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,323::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::moving from state queued -> state running >Thread-19::DEBUG::2014-08-11 17:43:17,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) (542536) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) (542536) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,325::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,325::__init__::225::IOProcess::(_processLogs) (542537) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,325::__init__::225::IOProcess::(_processLogs) (542537) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,330::__init__::225::IOProcess::(_processLogs) (542536) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,330::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:17,330::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:17,330::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) (542538) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) (542538) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,331::__init__::225::IOProcess::(_processLogs) (542537) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,332::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,332::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:17,332::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,332::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,332::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,332::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,332::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,333::__init__::225::IOProcess::(_processLogs) (542539) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,333::__init__::225::IOProcess::(_processLogs) (542539) Got request for method 'access' >Dummy-51::DEBUG::2014-08-11 17:43:17,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:17,393::__init__::225::IOProcess::(_processLogs) (542538) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,393::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,393::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,393::__init__::225::IOProcess::(_processLogs) (542539) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,394::__init__::225::IOProcess::(_processLogs) (542539) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,394::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) (542540) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) (542540) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) (542540) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,395::__init__::225::IOProcess::(_processLogs) (542540) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) (542541) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) (542541) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) (542541) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) (542541) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,397::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) (542542) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) (542542) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,398::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,399::__init__::225::IOProcess::(_processLogs) (542543) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,399::__init__::225::IOProcess::(_processLogs) (542543) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:17,406::__init__::225::IOProcess::(_processLogs) (542542) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,407::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,407::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,409::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:17,410::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,410::__init__::225::IOProcess::(_processLogs) Queuing request... >Dummy-51::DEBUG::2014-08-11 17:43:17,411::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0164433 s, 62.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:17,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,412::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,412::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,413::__init__::225::IOProcess::(_processLogs) (542544) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,413::__init__::225::IOProcess::(_processLogs) (542544) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,414::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(542543) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,415::__init__::225::IOProcess::(_processLogs) (542543) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,416::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,417::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,417::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:17,418::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,419::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,419::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,420::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(542545) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,420::__init__::225::IOProcess::(_processLogs) (542545) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,437::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(542544) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,437::__init__::225::IOProcess::(_processLogs) (542544) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,437::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,437::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,437::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) (542546) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,438::__init__::225::IOProcess::(_processLogs) (542546) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,447::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|(542545) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,447::__init__::225::IOProcess::(_processLogs) (542545) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Extracting request information...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,449::__init__::225::IOProcess::(_processLogs) (542547) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,449::__init__::225::IOProcess::(_processLogs) (542547) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,510::__init__::225::IOProcess::(_processLogs) (542547) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,511::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,511::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:17,511::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,512::__init__::225::IOProcess::(_processLogs) (542548) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) (542548) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) (542548) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) (542548) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,513::__init__::225::IOProcess::(_processLogs) (542549) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,514::__init__::225::IOProcess::(_processLogs) (542549) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,519::__init__::225::IOProcess::(_processLogs) (542546) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,519::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,520::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:17,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,520::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,520::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,520::__init__::225::IOProcess::(_processLogs) (542550) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,521::__init__::225::IOProcess::(_processLogs) (542550) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,526::__init__::225::IOProcess::(_processLogs) (542549) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,527::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:17,527::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,527::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) (542551) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,528::__init__::225::IOProcess::(_processLogs) (542551) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,543::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542551) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,543::__init__::225::IOProcess::(_processLogs) (542551) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,543::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,543::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) (542552) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,544::__init__::225::IOProcess::(_processLogs) (542552) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,545::__init__::225::IOProcess::(_processLogs) (542552) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,545::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:43:17,545::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:17,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) (542553) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) (542553) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) (542553) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) (542553) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,546::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) (542554) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,547::__init__::225::IOProcess::(_processLogs) (542554) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,553::__init__::225::IOProcess::(_processLogs) (542550) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,553::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,553::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:43:17,553::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,554::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,554::__init__::225::IOProcess::(_processLogs) (542555) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,554::__init__::225::IOProcess::(_processLogs) (542555) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,561::__init__::225::IOProcess::(_processLogs) (542554) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,561::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,561::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) (542556) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) (542556) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,562::__init__::225::IOProcess::(_processLogs) (542556) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) (542556) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,563::__init__::225::IOProcess::(_processLogs) (542557) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,564::__init__::225::IOProcess::(_processLogs) (542557) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,603::__init__::225::IOProcess::(_processLogs) DEBUG|(542557) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,603::__init__::225::IOProcess::(_processLogs) (542557) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,603::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,603::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,603::__init__::225::IOProcess::(_processLogs) (542555) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,604::__init__::225::IOProcess::(_processLogs) (542555) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,604::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,606::__init__::225::IOProcess::(_processLogs) (542558) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) (542558) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) (542559) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,607::__init__::225::IOProcess::(_processLogs) (542559) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,613::__init__::225::IOProcess::(_processLogs) DEBUG|(542558) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,613::__init__::225::IOProcess::(_processLogs) (542558) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,614::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,614::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,614::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,614::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:17,614::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,615::task::905::Storage.TaskManager.Task::(_runJobs) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::Task.run: running job 0: createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', 20, 4, 2, 2, 'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) >Thread-19::DEBUG::2014-08-11 17:43:17,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,616::task::331::Storage.TaskManager.Task::(run) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::Job.run: running createVolume: <bound method StoragePool.createVolume of <storage.sp.StoragePool object at 0x7f2d94034a50>> (args: ('7158eae9-4886-4af7-af0b-d668ecee9e4f', '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', 20, 4, 2, 2, 'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', '', '00000000-0000-0000-0000-000000000000', '00000000-0000-0000-0000-000000000000') kwargs: {}) callback None >Thread-19::DEBUG::2014-08-11 17:43:17,616::__init__::225::IOProcess::(_processLogs) (542560) Finding callback 'lexists'... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,617::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f`ReqID=`c6cf2390-edc1-4932-8c75-bea889c3ba7c`::Request was made in '/usr/share/vdsm/storage/sp.py' line '1792' at 'createVolume' >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,618::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f' for lock type 'exclusive' >Thread-19::DEBUG::2014-08-11 17:43:17,617::__init__::225::IOProcess::(_processLogs) (542560) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:17,619::__init__::225::IOProcess::(_processLogs) (542560) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,619::__init__::225::IOProcess::(_processLogs) (542560) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,619::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) (542561) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:17,620::__init__::225::IOProcess::(_processLogs) (542561) Got request for method 'glob' >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,621::resourceFactories::125::Storage.ResourcesFactories::(__getResourceCandidatesList) Image 812042c3-6adc-4cf2-aaf4-e3f90efd5e5f does not exist in domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:43:17,621::__init__::225::IOProcess::(_processLogs) (542561) Queuing response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,621::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f' is free. Now locking as 'exclusive' (1 active user) >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,622::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f`ReqID=`c6cf2390-edc1-4932-8c75-bea889c3ba7c`::Granted request >Thread-19::DEBUG::2014-08-11 17:43:17,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,623::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >d1919e29-2350-4faa-8241-34d8964ddb72::INFO::2014-08-11 17:43:17,623::image::121::Storage.Image::(create) Create placeholder /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f for image's volumes >Thread-19::DEBUG::2014-08-11 17:43:17,624::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:17,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,624::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,625::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:17,625::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,625::__init__::225::IOProcess::(_processLogs) (542562) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,625::__init__::225::IOProcess::(_processLogs) (542562) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) (542562) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) (542562) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,626::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,627::__init__::225::IOProcess::(_processLogs) (542563) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,627::__init__::225::IOProcess::(_processLogs) (542563) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,627::__init__::225::IOProcess::(_processLogs) (542563) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,627::__init__::225::IOProcess::(_processLogs) (542563) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,628::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,628::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) (542564) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) (542564) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) (542564) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) (542564) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,629::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,630::__init__::225::IOProcess::(_processLogs) (542559) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,630::__init__::225::IOProcess::(_processLogs) (542559) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,630::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,630::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) (542565) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,631::__init__::225::IOProcess::(_processLogs) (542565) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:17,632::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,632::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:17,632::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,633::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,633::__init__::225::IOProcess::(_processLogs) (542566) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,633::__init__::225::IOProcess::(_processLogs) (542566) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,633::__init__::225::IOProcess::(_processLogs) (542566) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) (542566) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,634::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,635::__init__::225::IOProcess::(_processLogs) (542567) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,635::__init__::225::IOProcess::(_processLogs) (542567) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,639::__init__::225::IOProcess::(_processLogs) (542565) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,639::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:17,639::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,640::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,640::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,640::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,640::__init__::225::IOProcess::(_processLogs) (542568) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,640::__init__::225::IOProcess::(_processLogs) (542568) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,647::__init__::225::IOProcess::(_processLogs) (542567) Queuing response >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:17,647::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,647::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,648::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:17,648::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,649::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,649::__init__::225::IOProcess::(_processLogs) (542569) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,680::__init__::225::IOProcess::(_processLogs) (542569) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,681::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,681::__init__::225::IOProcess::(_processLogs) (542568) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,681::__init__::225::IOProcess::(_processLogs) (542568) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,681::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,683::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,683::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,683::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) (542570) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) (542570) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) (542571) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,684::__init__::225::IOProcess::(_processLogs) (542571) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,685::__init__::225::IOProcess::(_processLogs) (542570) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,685::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:17,685::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:17,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) (542572) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) (542572) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) (542572) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) (542572) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,686::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) (542573) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,687::__init__::225::IOProcess::(_processLogs) (542573) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,699::__init__::225::IOProcess::(_processLogs) (542573) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,700::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,700::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:17,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) (542574) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) (542574) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) (542574) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) (542574) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,701::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) (542575) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,702::__init__::225::IOProcess::(_processLogs) (542575) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,703::__init__::225::IOProcess::(_processLogs) (542571) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,703::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,704::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:17,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,705::__init__::225::IOProcess::(_processLogs) (542576) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,705::__init__::225::IOProcess::(_processLogs) (542576) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,715::__init__::225::IOProcess::(_processLogs) (542575) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,715::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) (542577) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,716::__init__::225::IOProcess::(_processLogs) (542577) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) (542577) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) (542577) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) (542578) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,717::__init__::225::IOProcess::(_processLogs) (542578) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,737::__init__::225::IOProcess::(_processLogs) (542578) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,737::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,737::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:17,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,738::__init__::225::IOProcess::(_processLogs) (542579) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,738::__init__::225::IOProcess::(_processLogs) (542579) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,738::__init__::225::IOProcess::(_processLogs) (542579) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,738::__init__::225::IOProcess::(_processLogs) (542579) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) (542580) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,739::__init__::225::IOProcess::(_processLogs) (542580) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) (542580) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,760::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,761::__init__::225::IOProcess::(_processLogs) (542581) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,761::__init__::225::IOProcess::(_processLogs) (542581) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:17,766::__init__::225::IOProcess::(_processLogs) (542576) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,766::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,766::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:17,767::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) (542582) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) (542582) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) (542582) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) (542582) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:17,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,769::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,769::__init__::225::IOProcess::(_processLogs) (542583) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,769::__init__::225::IOProcess::(_processLogs) (542583) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,773::__init__::225::IOProcess::(_processLogs) (542581) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,773::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,773::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:17,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) (542584) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) (542584) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) (542584) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) (542584) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,774::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) Message size is 281 >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) (542585) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:43:17,775::__init__::225::IOProcess::(_processLogs) (542585) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:43:17,783::__init__::225::IOProcess::(_processLogs) DEBUG|(542583) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,783::__init__::225::IOProcess::(_processLogs) (542583) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,783::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:17,783::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:17,783::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,784::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,784::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:17,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,784::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,785::__init__::225::IOProcess::(_processLogs) (542586) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:17,785::__init__::225::IOProcess::(_processLogs) (542586) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:17,799::__init__::225::IOProcess::(_processLogs) DEBUG|(542586) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,799::__init__::225::IOProcess::(_processLogs) (542586) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,799::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) (542587) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,800::__init__::225::IOProcess::(_processLogs) (542587) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:17,801::__init__::225::IOProcess::(_processLogs) DEBUG|(542587) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,801::__init__::225::IOProcess::(_processLogs) (542587) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,801::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,802::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) (542588) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) (542588) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) (542588) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) (542588) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,803::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,804::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,804::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,804::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,804::__init__::225::IOProcess::(_processLogs) (542589) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,804::__init__::225::IOProcess::(_processLogs) (542589) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,816::__init__::225::IOProcess::(_processLogs) DEBUG|(542589) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,816::__init__::225::IOProcess::(_processLogs) (542589) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,816::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,817::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,817::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:17,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,817::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) (542590) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) (542590) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) (542590) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) (542590) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,818::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) (542591) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:17,819::__init__::225::IOProcess::(_processLogs) (542591) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:17,825::__init__::225::IOProcess::(_processLogs) DEBUG|(542585) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,825::__init__::225::IOProcess::(_processLogs) (542585) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,825::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) (542592) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:43:17,826::__init__::225::IOProcess::(_processLogs) (542592) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:43:17,833::__init__::225::IOProcess::(_processLogs) (542591) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,833::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,833::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:17,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,834::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,834::__init__::225::IOProcess::(_processLogs) (542593) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,834::__init__::225::IOProcess::(_processLogs) (542593) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:17,842::__init__::225::IOProcess::(_processLogs) (542592) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,842::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::INFO::2014-08-11 17:43:17,842::fileVolume::133::Storage.Volume::(_create) Request to create RAW volume /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25 with size = 2637824 sectors >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) (542594) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:43:17,843::__init__::225::IOProcess::(_processLogs) (542594) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:43:17,852::__init__::225::IOProcess::(_processLogs) (542593) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,852::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) (542595) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:17,853::__init__::225::IOProcess::(_processLogs) (542595) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:17,854::__init__::225::IOProcess::(_processLogs) (542595) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,854::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,857::__init__::225::IOProcess::(_processLogs) (542594) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,857::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,857::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:43:17,858::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,858::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,858::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,858::__init__::225::IOProcess::(_processLogs) (542596) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) (542596) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) (542596) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) (542596) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,859::__init__::225::IOProcess::(_processLogs) (542597) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,860::__init__::225::IOProcess::(_processLogs) (542597) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,860::__init__::225::IOProcess::(_processLogs) (542597) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,860::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:17,860::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) (542598) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) (542598) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,861::__init__::225::IOProcess::(_processLogs) (542598) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) (542599) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) (542599) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) (542599) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) (542599) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,864::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,864::__init__::225::IOProcess::(_processLogs) (542600) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,864::__init__::225::IOProcess::(_processLogs) (542600) Got request for method 'mkdir' >d1919e29-2350-4faa-8241-34d8964ddb72::INFO::2014-08-11 17:43:17,877::volume::415::Storage.Volume::(create) Creating volume cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-19::DEBUG::2014-08-11 17:43:17,877::__init__::225::IOProcess::(_processLogs) (542600) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,878::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) (542601) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,879::__init__::225::IOProcess::(_processLogs) (542601) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,880::__init__::225::IOProcess::(_processLogs) (542601) Queuing response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:17,880::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:17,880::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,880::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,880::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:17,880::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) (542602) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) (542602) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) (542603) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) (542603) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) (542603) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,882::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,883::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:17,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,883::__init__::225::IOProcess::(_processLogs) (542604) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) (542604) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) (542604) Building response >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) (542604) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,885::__init__::225::IOProcess::(_processLogs) (542605) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:17,885::__init__::225::IOProcess::(_processLogs) (542605) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:17,900::__init__::225::IOProcess::(_processLogs) (542605) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,900::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) (542606) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,901::__init__::225::IOProcess::(_processLogs) (542606) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,908::__init__::225::IOProcess::(_processLogs) (542602) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,908::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,908::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:17,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,909::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,909::__init__::225::IOProcess::(_processLogs) (542607) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,909::__init__::225::IOProcess::(_processLogs) (542607) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,932::__init__::225::IOProcess::(_processLogs) (542606) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,932::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) (542608) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,933::__init__::225::IOProcess::(_processLogs) (542608) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,941::__init__::225::IOProcess::(_processLogs) (542607) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,941::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) (542609) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,942::__init__::225::IOProcess::(_processLogs) (542609) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,965::__init__::225::IOProcess::(_processLogs) (542608) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,965::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,966::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:17,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:17,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,967::__init__::225::IOProcess::(_processLogs) (542610) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,967::__init__::225::IOProcess::(_processLogs) (542610) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,974::__init__::225::IOProcess::(_processLogs) (542609) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,975::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:17,975::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:43:17,975::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:17,975::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:17,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:17,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:17,976::__init__::225::IOProcess::(_processLogs) (542611) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:17,976::__init__::225::IOProcess::(_processLogs) (542611) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:17,999::__init__::225::IOProcess::(_processLogs) (542610) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:17,999::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,001::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,002::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,002::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:43:18,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,002::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,003::__init__::225::IOProcess::(_processLogs) (542612) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,003::__init__::225::IOProcess::(_processLogs) (542612) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,008::__init__::225::IOProcess::(_processLogs) DEBUG|(542611) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,008::__init__::225::IOProcess::(_processLogs) DEBUG|(542611) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,009::__init__::225::IOProcess::(_processLogs) (542613) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,010::__init__::225::IOProcess::(_processLogs) (542613) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,032::__init__::225::IOProcess::(_processLogs) DEBUG|(542612) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,033::__init__::225::IOProcess::(_processLogs) (542612) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,033::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,033::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,033::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,033::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,033::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,034::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:18,034::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) (542614) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) (542614) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) (542614) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) (542614) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,035::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) (542615) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,036::__init__::225::IOProcess::(_processLogs) (542615) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,043::__init__::225::IOProcess::(_processLogs) DEBUG|(542613) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,043::__init__::225::IOProcess::(_processLogs) (542613) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,043::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) Message size is 665 >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,044::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,045::__init__::225::IOProcess::(_processLogs) (542616) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,045::__init__::225::IOProcess::(_processLogs) (542616) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,057::__init__::225::IOProcess::(_processLogs) DEBUG|(542615) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,057::__init__::225::IOProcess::(_processLogs) (542615) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,057::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:18,057::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,058::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,058::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,058::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:18,058::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,058::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,059::__init__::225::IOProcess::(_processLogs) (542617) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,059::__init__::225::IOProcess::(_processLogs) (542617) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,083::__init__::225::IOProcess::(_processLogs) DEBUG|(542617) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,083::__init__::225::IOProcess::(_processLogs) (542617) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,083::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) (542618) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,084::__init__::225::IOProcess::(_processLogs) (542618) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,092::__init__::225::IOProcess::(_processLogs) DEBUG|(542616) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,092::__init__::225::IOProcess::(_processLogs) (542616) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,092::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,092::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,093::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,093::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,093::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:18,093::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) (542619) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) (542619) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) (542619) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) (542619) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) (542620) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,095::__init__::225::IOProcess::(_processLogs) (542620) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,097::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542618) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,098::__init__::225::IOProcess::(_processLogs) (542618) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,098::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,098::__init__::225::IOProcess::(_processLogs) Sending response sized 193 >Thread-19::DEBUG::2014-08-11 17:43:18,098::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,098::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) (542621) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) (542621) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) (542621) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) (542621) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) (542622) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,100::__init__::225::IOProcess::(_processLogs) (542622) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,104::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542620) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,104::__init__::225::IOProcess::(_processLogs) (542620) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,104::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:18,104::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,105::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,105::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,105::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:18,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,106::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,106::__init__::225::IOProcess::(_processLogs) (542623) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,106::__init__::225::IOProcess::(_processLogs) (542623) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,110::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542622) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,111::__init__::225::IOProcess::(_processLogs) (542622) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,111::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,111::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,111::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,111::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,111::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) (542624) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) (542624) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) (542624) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) (542624) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) (542625) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,113::__init__::225::IOProcess::(_processLogs) (542625) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,115::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542623) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,115::__init__::225::IOProcess::(_processLogs) (542623) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,117::__init__::225::IOProcess::(_processLogs) (542626) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,117::__init__::225::IOProcess::(_processLogs) (542626) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,117::__init__::225::IOProcess::(_processLogs) (542626) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,117::__init__::225::IOProcess::(_processLogs) Sending response sized 291 >Thread-19::DEBUG::2014-08-11 17:43:18,118::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:18,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,118::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) (542627) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) (542627) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) (542627) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) (542627) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,119::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) (542628) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,120::__init__::225::IOProcess::(_processLogs) (542628) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,125::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542625) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,126::__init__::225::IOProcess::(_processLogs) (542625) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,126::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,126::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,126::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,126::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:18,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) (542629) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) (542629) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) (542629) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) (542629) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,127::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) (542630) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,128::__init__::225::IOProcess::(_processLogs) (542630) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,132::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542628) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,132::__init__::225::IOProcess::(_processLogs) (542628) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,133::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,133::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,133::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,133::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,133::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,133::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) (542631) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) (542631) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) (542631) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) (542631) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,134::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) (542632) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,135::__init__::225::IOProcess::(_processLogs) (542632) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,142::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542630) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,142::__init__::225::IOProcess::(_processLogs) (542630) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,142::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,142::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,142::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) (542633) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,143::__init__::225::IOProcess::(_processLogs) (542633) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:18,149::__init__::225::IOProcess::(_processLogs) DEBUG|(542632) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,149::__init__::225::IOProcess::(_processLogs) (542632) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,149::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,149::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,149::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,149::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) (542634) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) (542634) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,150::__init__::225::IOProcess::(_processLogs) (542634) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) (542634) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) (542635) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,151::__init__::225::IOProcess::(_processLogs) (542635) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,155::__init__::225::IOProcess::(_processLogs) DEBUG|(542633) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) (542633) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,157::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,157::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,157::__init__::225::IOProcess::(_processLogs) (542636) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:18,157::__init__::225::IOProcess::(_processLogs) (542636) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:18,157::__init__::225::IOProcess::(_processLogs) (542636) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) (542637) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,158::__init__::225::IOProcess::(_processLogs) (542637) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,159::__init__::225::IOProcess::(_processLogs) (542637) Queuing response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:18,159::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:18,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,159::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) (542638) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) (542638) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) (542638) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,160::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,161::__init__::225::IOProcess::(_processLogs) (542639) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) (542639) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) (542639) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) (542639) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) (542640) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,162::__init__::225::IOProcess::(_processLogs) (542640) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:18,163::__init__::225::IOProcess::(_processLogs) (542635) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,164::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,164::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,164::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) (542641) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) (542641) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) (542641) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) (542641) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,166::__init__::225::IOProcess::(_processLogs) (542642) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,166::__init__::225::IOProcess::(_processLogs) (542642) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,173::__init__::225::IOProcess::(_processLogs) (542640) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,174::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,174::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:18,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,175::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,175::__init__::225::IOProcess::(_processLogs) (542643) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,175::__init__::225::IOProcess::(_processLogs) (542643) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,182::__init__::225::IOProcess::(_processLogs) (542642) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,182::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,183::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,183::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) (542644) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) (542644) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) (542644) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) (542644) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,184::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,185::__init__::225::IOProcess::(_processLogs) (542645) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,185::__init__::225::IOProcess::(_processLogs) (542645) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,200::__init__::225::IOProcess::(_processLogs) (542645) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,200::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,200::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:18,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,201::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,201::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,201::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,201::__init__::225::IOProcess::(_processLogs) (542646) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,201::__init__::225::IOProcess::(_processLogs) (542646) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:18,207::__init__::225::IOProcess::(_processLogs) (542643) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,207::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) (542647) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,208::__init__::225::IOProcess::(_processLogs) (542647) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,216::__init__::225::IOProcess::(_processLogs) DEBUG|(542646) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,216::__init__::225::IOProcess::(_processLogs) (542646) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,216::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,216::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,216::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,216::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) (542648) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) (542648) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) DEBUG|(542648) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,217::__init__::225::IOProcess::(_processLogs) (542648) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,218::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,218::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,245::__init__::225::IOProcess::(_processLogs) DEBUG|(542647) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,245::__init__::225::IOProcess::(_processLogs) (542647) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,245::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,246::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,246::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:18,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,247::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,247::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,247::__init__::225::IOProcess::(_processLogs) (542649) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,247::__init__::225::IOProcess::(_processLogs) (542649) Got request for method 'writefile' >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:18,249::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,249::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,249::__init__::225::IOProcess::(_processLogs) Message size is 436 >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) (542650) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,250::__init__::225::IOProcess::(_processLogs) (542650) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,271::__init__::225::IOProcess::(_processLogs) DEBUG|(542650) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,271::__init__::225::IOProcess::(_processLogs) (542650) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,271::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,271::fileVolume::384::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=041ad999-7aa9-4dcf-a3b1-bf962cc75c25 sdUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f, metaId=(u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25',) >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) Message size is 280 >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,273::__init__::225::IOProcess::(_processLogs) (542651) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:43:18,273::__init__::225::IOProcess::(_processLogs) (542651) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:43:18,283::__init__::225::IOProcess::(_processLogs) DEBUG|(542649) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,283::__init__::225::IOProcess::(_processLogs) (542649) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,283::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) (542652) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,284::__init__::225::IOProcess::(_processLogs) (542652) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,315::__init__::225::IOProcess::(_processLogs) DEBUG|(542651) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,315::__init__::225::IOProcess::(_processLogs) (542651) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,315::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,315::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,315::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,315::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) (542653) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) (542653) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,316::__init__::225::IOProcess::(_processLogs) (542653) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) (542653) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Message size is 250 >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) (542654) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:43:18,317::__init__::225::IOProcess::(_processLogs) (542654) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:43:18,323::__init__::225::IOProcess::(_processLogs) DEBUG|(542652) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,323::__init__::225::IOProcess::(_processLogs) (542652) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,323::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,323::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) (542655) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,324::__init__::225::IOProcess::(_processLogs) (542655) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,334::__init__::225::IOProcess::(_processLogs) DEBUG|(542654) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,334::__init__::225::IOProcess::(_processLogs) (542654) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,335::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,335::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,376::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) (542656) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) (542656) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,377::__init__::225::IOProcess::(_processLogs) DEBUG|(542656) Building response >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,377::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:18,378::__init__::225::IOProcess::(_processLogs) (542656) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,378::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,378::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,378::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,378::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,378::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) (542657) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) (542657) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) DEBUG|(542657) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) (542657) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,379::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,380::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) (542658) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) (542658) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) (542658) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) (542658) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,381::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,382::__init__::225::IOProcess::(_processLogs) (542659) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,382::__init__::225::IOProcess::(_processLogs) (542659) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:18,386::__init__::225::IOProcess::(_processLogs) DEBUG|(542655) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,386::__init__::225::IOProcess::(_processLogs) (542655) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,387::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:18,388::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) (542660) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) (542660) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) (542660) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) (542660) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,389::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,390::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,390::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,390::__init__::225::IOProcess::(_processLogs) (542661) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,390::__init__::225::IOProcess::(_processLogs) (542661) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,395::__init__::225::IOProcess::(_processLogs) DEBUG|(542659) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,395::__init__::225::IOProcess::(_processLogs) (542659) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,395::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) (542662) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,396::__init__::225::IOProcess::(_processLogs) (542662) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,399::__init__::225::IOProcess::(_processLogs) DEBUG|(542661) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,399::__init__::225::IOProcess::(_processLogs) (542661) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,399::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:18,399::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,400::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,400::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:18,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,401::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,401::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,401::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,401::__init__::225::IOProcess::(_processLogs) (542663) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,401::__init__::225::IOProcess::(_processLogs) (542663) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) DEBUG|(542663) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) (542663) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,412::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,413::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,413::__init__::225::IOProcess::(_processLogs) (542664) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,413::__init__::225::IOProcess::(_processLogs) (542664) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,415::__init__::225::IOProcess::(_processLogs) DEBUG|(542664) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,415::__init__::225::IOProcess::(_processLogs) (542664) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,415::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) (542665) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) (542665) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) (542665) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) (542665) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,417::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,418::__init__::225::IOProcess::(_processLogs) (542666) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,418::__init__::225::IOProcess::(_processLogs) (542666) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,422::__init__::225::IOProcess::(_processLogs) DEBUG|(542662) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,422::__init__::225::IOProcess::(_processLogs) (542662) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,422::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) (542667) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,423::__init__::225::IOProcess::(_processLogs) (542667) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|(542666) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) (542666) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:18,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) (542668) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) (542668) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) (542668) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) (542668) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) (542669) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,435::__init__::225::IOProcess::(_processLogs) (542669) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,449::__init__::225::IOProcess::(_processLogs) (542669) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,449::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,450::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:18,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,450::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) (542670) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) (542670) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) (542670) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) (542670) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,451::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) (542671) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,452::__init__::225::IOProcess::(_processLogs) (542671) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,464::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542671) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,464::__init__::225::IOProcess::(_processLogs) (542671) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,464::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,465::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,465::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,465::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,465::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,465::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,465::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) (542672) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) (542672) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) (542672) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) (542672) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,466::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,467::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,467::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,467::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,467::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,467::__init__::225::IOProcess::(_processLogs) (542673) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,467::__init__::225::IOProcess::(_processLogs) (542673) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,475::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542667) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,476::__init__::225::IOProcess::(_processLogs) (542667) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,476::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,476::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,476::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) (542674) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,477::__init__::225::IOProcess::(_processLogs) (542674) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,483::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542673) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,483::__init__::225::IOProcess::(_processLogs) (542673) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,483::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,483::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) (542675) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,484::__init__::225::IOProcess::(_processLogs) (542675) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:18,507::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542675) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,507::__init__::225::IOProcess::(_processLogs) (542675) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,507::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,507::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,507::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,507::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:18,508::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,508::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) (542676) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) (542676) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) (542674) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) (542674) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) (542676) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) (542676) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,509::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) (542677) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,510::__init__::225::IOProcess::(_processLogs) (542677) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Message size is 272 >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) (542678) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:43:18,511::__init__::225::IOProcess::(_processLogs) (542678) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:43:18,541::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542677) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,541::__init__::225::IOProcess::(_processLogs) (542677) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,541::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,542::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,542::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,542::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,542::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,542::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:18,542::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,543::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,543::__init__::225::IOProcess::(_processLogs) (542679) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,543::__init__::225::IOProcess::(_processLogs) (542679) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,543::__init__::225::IOProcess::(_processLogs) (542679) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) (542679) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,544::__init__::225::IOProcess::(_processLogs) (542680) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,545::__init__::225::IOProcess::(_processLogs) (542680) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,548::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542678) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,548::__init__::225::IOProcess::(_processLogs) (542678) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,548::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,548::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) (542681) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:43:18,549::__init__::225::IOProcess::(_processLogs) (542681) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:43:18,555::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542680) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,556::__init__::225::IOProcess::(_processLogs) (542680) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,556::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:18,556::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:18,556::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) (542682) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:18,557::__init__::225::IOProcess::(_processLogs) (542682) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:18,561::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542681) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,561::__init__::225::IOProcess::(_processLogs) (542681) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,561::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::INFO::2014-08-11 17:43:18,562::fileVolume::133::Storage.Volume::(_create) Request to create COW volume /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff with size = 20 sectors >Thread-19::DEBUG::2014-08-11 17:43:18,562::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:18,562::utils::738::root::(execCmd) /usr/bin/qemu-img create -f qcow2 /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff 10240 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:18,621::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542682) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,622::__init__::225::IOProcess::(_processLogs) (542682) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,622::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,623::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,623::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:18,623::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,623::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,624::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,624::__init__::225::IOProcess::(_processLogs) (542683) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,624::__init__::225::IOProcess::(_processLogs) (542683) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:18,627::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542683) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,627::__init__::225::IOProcess::(_processLogs) (542683) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,627::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,627::__init__::225::IOProcess::(_processLogs) Sending response sized 340 >Thread-19::DEBUG::2014-08-11 17:43:18,628::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,628::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,628::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) (542684) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) (542684) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) (542684) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) (542684) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,629::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,630::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,630::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,630::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,630::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,631::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,631::__init__::225::IOProcess::(_processLogs) (542685) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,631::__init__::225::IOProcess::(_processLogs) (542685) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,642::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542685) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,642::__init__::225::IOProcess::(_processLogs) (542685) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,642::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,642::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,643::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) (542686) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) (542686) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) (542686) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) (542686) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,644::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,645::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,645::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,645::__init__::225::IOProcess::(_processLogs) (542687) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,645::__init__::225::IOProcess::(_processLogs) (542687) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,664::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542687) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,664::__init__::225::IOProcess::(_processLogs) (542687) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,664::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,665::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,665::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:18,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,665::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) (542688) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) (542688) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) (542688) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) (542688) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:18,666::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,667::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,667::__init__::225::IOProcess::(_processLogs) (542689) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,667::__init__::225::IOProcess::(_processLogs) (542689) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,675::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542689) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,675::__init__::225::IOProcess::(_processLogs) (542689) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,675::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,675::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,675::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) (542690) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,676::__init__::225::IOProcess::(_processLogs) (542690) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) (542690) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) (542690) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,678::__init__::225::IOProcess::(_processLogs) (542691) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,678::__init__::225::IOProcess::(_processLogs) (542691) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,691::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542691) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,691::__init__::225::IOProcess::(_processLogs) (542691) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,692::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,693::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,693::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,694::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:18,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,695::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,695::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,696::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,697::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,697::__init__::225::IOProcess::(_processLogs) (542692) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,698::__init__::225::IOProcess::(_processLogs) (542692) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,698::__init__::225::IOProcess::(_processLogs) (542692) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,699::__init__::225::IOProcess::(_processLogs) (542692) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,699::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,700::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,701::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,701::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:18,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,704::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,704::__init__::225::IOProcess::(_processLogs) (542693) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,705::__init__::225::IOProcess::(_processLogs) (542693) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:18,708::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542693) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,709::__init__::225::IOProcess::(_processLogs) (542693) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,709::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,710::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,711::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:18,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,714::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,715::__init__::225::IOProcess::(_processLogs) (542694) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:18,715::__init__::225::IOProcess::(_processLogs) (542694) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:18,716::__init__::225::IOProcess::(_processLogs) (542694) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,716::__init__::225::IOProcess::(_processLogs) (542694) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,717::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:18,718::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,719::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:18,719::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,720::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,720::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,721::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,721::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,722::__init__::225::IOProcess::(_processLogs) (542695) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:18,722::__init__::225::IOProcess::(_processLogs) (542695) Got request for method 'unlink' >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:18,728::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Message size is 244 >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) (542696) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:43:18,729::__init__::225::IOProcess::(_processLogs) (542696) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:43:18,736::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542695) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,736::__init__::225::IOProcess::(_processLogs) (542695) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,738::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,738::__init__::225::IOProcess::(_processLogs) (542697) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,738::__init__::225::IOProcess::(_processLogs) (542697) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:18,741::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542696) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,741::__init__::225::IOProcess::(_processLogs) (542696) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,742::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,742::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,742::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,742::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:18,742::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,742::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,743::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:18,743::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:18,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) (542698) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) (542698) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) (542698) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) (542698) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,744::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,745::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,745::__init__::225::IOProcess::(_processLogs) (542699) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,745::__init__::225::IOProcess::(_processLogs) (542699) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,751::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542697) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,751::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542697) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,751::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542699) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) (542699) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,752::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) (542700) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) (542700) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,753::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,754::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856' >Thread-19::DEBUG::2014-08-11 17:43:18,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,755::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856' (0 active users) >Thread-19::DEBUG::2014-08-11 17:43:18,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,755::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-08-11 17:43:18,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,756::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', Clearing records. >Thread-19::DEBUG::2014-08-11 17:43:18,756::__init__::225::IOProcess::(_processLogs) (542701) Finding callback 'access'... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::moving from state running -> state finished >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) (542701) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) (542700) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) (542700) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) (542701) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) (542701) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,757::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,759::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,759::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,759::__init__::225::IOProcess::(_processLogs) (542702) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,759::__init__::225::IOProcess::(_processLogs) (542702) Got request for method 'access' >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:18,759::task::752::Storage.TaskManager.Task::(_save) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/9c2a5d70-29fe-437b-b8a7-45f5efd4b79a.temp >Thread-19::DEBUG::2014-08-11 17:43:18,759::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542702) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) (542702) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) (542703) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,760::__init__::225::IOProcess::(_processLogs) (542703) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) (542704) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,761::__init__::225::IOProcess::(_processLogs) (542704) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,769::__init__::225::IOProcess::(_processLogs) DEBUG|(542703) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,769::__init__::225::IOProcess::(_processLogs) (542703) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,770::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,770::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) DEBUG|(542704) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) (542704) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) (542705) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) (542705) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:18,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) (542706) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) (542706) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) (542706) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) (542706) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:18,773::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) (542707) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:18,774::__init__::225::IOProcess::(_processLogs) (542707) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:18,784::__init__::225::IOProcess::(_processLogs) DEBUG|(542707) Building response >Thread-19::DEBUG::2014-08-11 17:43:18,784::__init__::225::IOProcess::(_processLogs) (542707) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,784::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,786::__init__::225::IOProcess::(_processLogs) (542708) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,786::__init__::225::IOProcess::(_processLogs) (542708) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,795::__init__::225::IOProcess::(_processLogs) (542705) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,796::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,796::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:18,796::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,796::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,796::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,796::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,797::__init__::225::IOProcess::(_processLogs) (542709) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,797::__init__::225::IOProcess::(_processLogs) (542709) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,830::__init__::225::IOProcess::(_processLogs) (542708) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) Message size is 398 >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) (542710) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,831::__init__::225::IOProcess::(_processLogs) (542710) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,843::__init__::225::IOProcess::(_processLogs) (542709) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) (542711) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,844::__init__::225::IOProcess::(_processLogs) (542711) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,894::__init__::225::IOProcess::(_processLogs) (542710) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,894::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) Message size is 741 >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) (542712) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,895::__init__::225::IOProcess::(_processLogs) (542712) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,904::__init__::225::IOProcess::(_processLogs) (542711) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,905::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,905::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:18,905::__init__::225::IOProcess::(_processLogs) Message size is 561 >Thread-19::DEBUG::2014-08-11 17:43:18,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,906::__init__::225::IOProcess::(_processLogs) (542713) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,906::__init__::225::IOProcess::(_processLogs) (542713) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,931::__init__::225::IOProcess::(_processLogs) (542712) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,931::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:18,931::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,932::__init__::225::IOProcess::(_processLogs) (542714) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,932::__init__::225::IOProcess::(_processLogs) (542714) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,941::__init__::225::IOProcess::(_processLogs) (542713) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,941::__init__::225::IOProcess::(_processLogs) Message size is 749 >Thread-19::DEBUG::2014-08-11 17:43:18,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,942::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,942::__init__::225::IOProcess::(_processLogs) (542715) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,942::__init__::225::IOProcess::(_processLogs) (542715) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) (542714) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,967::__init__::225::IOProcess::(_processLogs) (542716) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,967::__init__::225::IOProcess::(_processLogs) (542716) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:18,975::__init__::225::IOProcess::(_processLogs) (542715) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) Message size is 665 >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:18,976::__init__::225::IOProcess::(_processLogs) (542717) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:18,977::__init__::225::IOProcess::(_processLogs) (542717) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,012::__init__::225::IOProcess::(_processLogs) (542716) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,012::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,012::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,012::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,012::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:19,013::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,013::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) (542718) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) (542718) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) (542718) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) (542718) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,015::__init__::225::IOProcess::(_processLogs) (542719) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,015::__init__::225::IOProcess::(_processLogs) (542719) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,064::__init__::225::IOProcess::(_processLogs) (542717) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,065::__init__::225::IOProcess::(_processLogs) (542719) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,065::__init__::225::IOProcess::(_processLogs) (542719) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,065::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,066::__init__::225::IOProcess::(_processLogs) Message size is 181 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::WARNING::2014-08-11 17:43:19,066::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) (542720) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) (542720) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,068::__init__::225::IOProcess::(_processLogs) (542721) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,068::__init__::225::IOProcess::(_processLogs) (542721) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,075::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542720) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,075::__init__::225::IOProcess::(_processLogs) (542720) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,075::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,075::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,076::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:19,076::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,076::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:19,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,077::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,077::__init__::225::IOProcess::(_processLogs) (542722) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,077::__init__::225::IOProcess::(_processLogs) (542722) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,085::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542721) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,085::__init__::225::IOProcess::(_processLogs) (542721) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,085::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) (542723) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,086::__init__::225::IOProcess::(_processLogs) (542723) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,087::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542723) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,087::__init__::225::IOProcess::(_processLogs) (542723) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,087::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,087::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) (542724) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) (542724) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) (542724) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) (542724) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,090::__init__::225::IOProcess::(_processLogs) (542725) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,090::__init__::225::IOProcess::(_processLogs) (542725) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,090::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(542722) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,090::__init__::225::IOProcess::(_processLogs) (542722) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,091::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,091::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,091::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) (542726) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,092::__init__::225::IOProcess::(_processLogs) (542726) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,096::__init__::225::IOProcess::(_processLogs) DEBUG|(542725) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,096::__init__::225::IOProcess::(_processLogs) (542725) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,096::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,097::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) (542727) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) (542727) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) (542727) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) (542727) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,098::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) (542728) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,099::__init__::225::IOProcess::(_processLogs) (542728) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,106::__init__::225::IOProcess::(_processLogs) DEBUG|(542726) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,106::__init__::225::IOProcess::(_processLogs) (542726) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,106::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,106::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) (542729) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,107::__init__::225::IOProcess::(_processLogs) (542729) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,108::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,108::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,108::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) (542730) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) (542730) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) (542730) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) (542730) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,109::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,110::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,110::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,110::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,110::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,110::__init__::225::IOProcess::(_processLogs) (542731) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,110::__init__::225::IOProcess::(_processLogs) (542731) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,114::__init__::225::IOProcess::(_processLogs) (542728) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,115::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,115::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,115::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,115::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) (542732) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) (542732) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) (542732) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) (542732) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,116::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,117::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,117::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,117::__init__::225::IOProcess::(_processLogs) (542733) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,117::__init__::225::IOProcess::(_processLogs) (542733) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,124::__init__::225::IOProcess::(_processLogs) (542731) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,124::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,125::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,125::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:19,125::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,125::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) (542734) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) (542734) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) (542734) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) (542734) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,126::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,127::__init__::225::IOProcess::(_processLogs) (542735) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,127::__init__::225::IOProcess::(_processLogs) (542735) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,131::__init__::225::IOProcess::(_processLogs) (542733) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,131::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) (542736) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) (542736) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,132::__init__::225::IOProcess::(_processLogs) (542736) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) (542736) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) (542737) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,133::__init__::225::IOProcess::(_processLogs) (542737) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,140::__init__::225::IOProcess::(_processLogs) (542735) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,140::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) (542738) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) (542738) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) (542738) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,141::__init__::225::IOProcess::(_processLogs) (542738) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,142::__init__::225::IOProcess::(_processLogs) (542739) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,143::__init__::225::IOProcess::(_processLogs) (542739) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,148::__init__::225::IOProcess::(_processLogs) DEBUG|(542737) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,148::__init__::225::IOProcess::(_processLogs) (542737) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,148::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,148::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,148::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) (542740) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,149::__init__::225::IOProcess::(_processLogs) (542740) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:19,231::__init__::225::IOProcess::(_processLogs) DEBUG|(542739) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,231::__init__::225::IOProcess::(_processLogs) (542739) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,231::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,231::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,231::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,231::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) (542741) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) (542741) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,232::__init__::225::IOProcess::(_processLogs) (542741) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) (542741) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) (542742) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,233::__init__::225::IOProcess::(_processLogs) (542742) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,240::__init__::225::IOProcess::(_processLogs) DEBUG|(542740) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,240::__init__::225::IOProcess::(_processLogs) (542740) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,240::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,240::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,240::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,240::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) (542743) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) (542743) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) DEBUG|(542743) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,241::__init__::225::IOProcess::(_processLogs) (542743) Queuing response >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:43:19,242::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:43:19,242::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,243::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,243::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (1 active users) >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,243::task::916::Storage.TaskManager.Task::(_runJobs) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::Task.run: exit - success: result {'uuid': '041ad999-7aa9-4dcf-a3b1-bf962cc75c25'} >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,243::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2a5d70-29fe-437b-b8a7-45f5efd4b79a`::ref 0 aborting False >9c2a5d70-29fe-437b-b8a7-45f5efd4b79a::DEBUG::2014-08-11 17:43:19,243::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-19::DEBUG::2014-08-11 17:43:19,249::__init__::225::IOProcess::(_processLogs) DEBUG|(542742) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,249::__init__::225::IOProcess::(_processLogs) (542742) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,249::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,249::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,250::__init__::225::IOProcess::(_processLogs) (542744) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) (542744) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) (542744) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) (542744) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,252::__init__::225::IOProcess::(_processLogs) (542745) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,252::__init__::225::IOProcess::(_processLogs) (542745) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,259::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|(542745) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,259::__init__::225::IOProcess::(_processLogs) (542745) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,259::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) (542746) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,260::__init__::225::IOProcess::(_processLogs) (542746) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:19,271::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|(542746) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,271::__init__::225::IOProcess::(_processLogs) (542746) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,271::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) (542747) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:19,272::__init__::225::IOProcess::(_processLogs) (542747) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:19,273::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|(542747) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,273::__init__::225::IOProcess::(_processLogs) (542747) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,273::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,273::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,289::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,289::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) Message size is 436 >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) (542748) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,290::__init__::225::IOProcess::(_processLogs) (542748) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,301::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|(542748) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,301::__init__::225::IOProcess::(_processLogs) (542748) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,301::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,301::fileVolume::384::Storage.Volume::(newVolumeLease) Initializing volume lease volUUID=cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff sdUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f, metaId=(u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff',) >Thread-19::DEBUG::2014-08-11 17:43:19,301::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) DEBUGDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) Message size is 280 >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,302::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,303::__init__::225::IOProcess::(_processLogs) (542749) Finding callback 'truncate'... >Thread-19::DEBUG::2014-08-11 17:43:19,303::__init__::225::IOProcess::(_processLogs) (542749) Got request for method 'truncate' >Thread-19::DEBUG::2014-08-11 17:43:19,321::__init__::225::IOProcess::(_processLogs) (542749) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,321::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,321::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:43:19,321::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,321::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,321::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) (542750) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) (542750) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) (542750) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) (542750) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,322::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) Message size is 250 >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) (542751) Finding callback 'chmod'... >Thread-19::DEBUG::2014-08-11 17:43:19,323::__init__::225::IOProcess::(_processLogs) (542751) Got request for method 'chmod' >Thread-19::DEBUG::2014-08-11 17:43:19,331::__init__::225::IOProcess::(_processLogs) (542751) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,331::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) (542752) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:19,414::__init__::225::IOProcess::(_processLogs) (542752) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:19,415::__init__::225::IOProcess::(_processLogs) (542752) Queuing response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,415::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:19,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,415::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) (542753) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) (542753) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) (542753) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,416::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) (542754) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:19,417::__init__::225::IOProcess::(_processLogs) (542754) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) (542754) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) (542754) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) (542755) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,418::__init__::225::IOProcess::(_processLogs) (542755) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:19,427::__init__::225::IOProcess::(_processLogs) (542755) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,427::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:43:19,429::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:19,429::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:19,488::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,488::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,489::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,489::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,489::__init__::225::IOProcess::(_processLogs) (542756) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,489::__init__::225::IOProcess::(_processLogs) (542756) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,489::__init__::225::IOProcess::(_processLogs) (542756) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) (542757) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,490::__init__::225::IOProcess::(_processLogs) (542757) Got request for method 'writefile' >Dummy-51::DEBUG::2014-08-11 17:43:19,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125268 s, 81.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:19,520::__init__::225::IOProcess::(_processLogs) (542757) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,520::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,520::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:19,520::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,521::__init__::225::IOProcess::(_processLogs) (542758) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,521::__init__::225::IOProcess::(_processLogs) (542758) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,543::__init__::225::IOProcess::(_processLogs) (542758) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,543::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) (542759) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,544::__init__::225::IOProcess::(_processLogs) (542759) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,567::__init__::225::IOProcess::(_processLogs) (542759) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,567::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,568::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,568::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,568::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,569::__init__::225::IOProcess::(_processLogs) (542760) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) (542760) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) (542760) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) (542760) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,570::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,571::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,571::__init__::225::IOProcess::(_processLogs) (542761) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,571::__init__::225::IOProcess::(_processLogs) (542761) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,585::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542761) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,585::__init__::225::IOProcess::(_processLogs) (542761) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,585::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,585::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,585::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,586::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,586::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:19,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,586::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,587::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,587::__init__::225::IOProcess::(_processLogs) (542762) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,587::__init__::225::IOProcess::(_processLogs) (542762) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,593::__init__::225::IOProcess::(_processLogs) (542762) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,593::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,593::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,593::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,593::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,594::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,594::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,594::__init__::225::IOProcess::(_processLogs) (542763) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,594::__init__::225::IOProcess::(_processLogs) (542763) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,597::__init__::225::IOProcess::(_processLogs) (542763) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,597::__init__::225::IOProcess::(_processLogs) Sending response sized 340 >Thread-19::DEBUG::2014-08-11 17:43:19,597::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) (542764) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) (542764) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) (542764) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) (542764) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,598::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) (542765) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,599::__init__::225::IOProcess::(_processLogs) (542765) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,611::__init__::225::IOProcess::(_processLogs) (542765) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,611::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,611::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,611::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) (542766) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) (542766) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) (542766) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) (542766) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,612::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) (542767) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,613::__init__::225::IOProcess::(_processLogs) (542767) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,626::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542767) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,626::__init__::225::IOProcess::(_processLogs) (542767) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,626::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,626::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,626::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,626::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) (542768) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) (542768) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) (542768) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,627::__init__::225::IOProcess::(_processLogs) (542768) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) (542769) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,628::__init__::225::IOProcess::(_processLogs) (542769) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,650::__init__::225::IOProcess::(_processLogs) (542769) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,650::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,651::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,651::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,651::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,651::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,651::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) (542770) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) (542770) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) (542770) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) (542770) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,653::__init__::225::IOProcess::(_processLogs) (542771) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,653::__init__::225::IOProcess::(_processLogs) (542771) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,659::__init__::225::IOProcess::(_processLogs) (542771) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,659::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,660::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,660::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,660::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,660::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) (542772) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) (542772) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) (542772) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) (542772) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,661::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,662::__init__::225::IOProcess::(_processLogs) (542773) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,662::__init__::225::IOProcess::(_processLogs) (542773) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,669::__init__::225::IOProcess::(_processLogs) (542773) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,669::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,669::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:19,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,669::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) (542774) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) (542774) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) (542774) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) (542774) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,670::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) (542775) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,671::__init__::225::IOProcess::(_processLogs) (542775) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) (542775) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,677::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,678::__init__::225::IOProcess::(_processLogs) (542776) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,678::__init__::225::IOProcess::(_processLogs) (542776) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:19,685::__init__::225::IOProcess::(_processLogs) (542776) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,685::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,685::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:19,685::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,685::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) (542777) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) (542777) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) (542777) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) (542777) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,686::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,687::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f' >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,687::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f' (0 active users) >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,687::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f' is free, finding out if anyone is waiting for it. >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,687::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', Clearing records. >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,687::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::moving from state running -> state finished >Thread-19::DEBUG::2014-08-11 17:43:19,687::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) (542778) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) (542778) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:19,688::__init__::225::IOProcess::(_processLogs) (542778) Queuing response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,688::task::752::Storage.TaskManager.Task::(_save) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/d1919e29-2350-4faa-8241-34d8964ddb72.temp >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) (542779) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) (542779) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) (542779) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,690::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) (542780) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) (542780) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) (542780) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) (542780) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,691::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) (542781) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,692::__init__::225::IOProcess::(_processLogs) (542781) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:43:19,701::__init__::225::IOProcess::(_processLogs) (542781) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,701::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,702::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:43:19,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,703::__init__::225::IOProcess::(_processLogs) (542782) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,703::__init__::225::IOProcess::(_processLogs) (542782) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,715::__init__::225::IOProcess::(_processLogs) (542782) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,715::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) Message size is 398 >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) (542783) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,716::__init__::225::IOProcess::(_processLogs) (542783) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,735::__init__::225::IOProcess::(_processLogs) (542783) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,735::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,735::__init__::225::IOProcess::(_processLogs) Message size is 733 >Thread-19::DEBUG::2014-08-11 17:43:19,735::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,735::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,736::__init__::225::IOProcess::(_processLogs) (542784) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,736::__init__::225::IOProcess::(_processLogs) (542784) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,756::__init__::225::IOProcess::(_processLogs) (542784) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,756::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) Message size is 629 >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) (542785) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,757::__init__::225::IOProcess::(_processLogs) (542785) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,776::__init__::225::IOProcess::(_processLogs) (542785) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,776::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) Message size is 813 >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) (542786) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:43:19,777::__init__::225::IOProcess::(_processLogs) (542786) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:43:19,794::__init__::225::IOProcess::(_processLogs) (542786) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,795::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:43:19,795::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,795::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,795::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,796::__init__::225::IOProcess::(_processLogs) (542787) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,796::__init__::225::IOProcess::(_processLogs) (542787) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,796::__init__::225::IOProcess::(_processLogs) (542787) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) (542787) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) (542788) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,797::__init__::225::IOProcess::(_processLogs) (542788) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,808::__init__::225::IOProcess::(_processLogs) (542788) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,808::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::WARNING::2014-08-11 17:43:19,809::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:43:19,809::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:43:19,809::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,809::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,809::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,809::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,810::__init__::225::IOProcess::(_processLogs) (542789) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:43:19,810::__init__::225::IOProcess::(_processLogs) (542789) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:43:19,818::__init__::225::IOProcess::(_processLogs) (542789) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,818::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,818::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) (542790) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,819::__init__::225::IOProcess::(_processLogs) (542790) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:19,821::__init__::225::IOProcess::(_processLogs) (542790) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,821::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:19,822::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,822::__init__::225::IOProcess::(_processLogs) (542791) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) (542791) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) (542791) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) (542791) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,823::__init__::225::IOProcess::(_processLogs) (542792) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,824::__init__::225::IOProcess::(_processLogs) (542792) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,832::__init__::225::IOProcess::(_processLogs) (542792) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,832::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) (542793) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,833::__init__::225::IOProcess::(_processLogs) (542793) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) (542793) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) (542793) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,834::__init__::225::IOProcess::(_processLogs) (542794) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,835::__init__::225::IOProcess::(_processLogs) (542794) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,840::__init__::225::IOProcess::(_processLogs) DEBUG|(542794) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,840::__init__::225::IOProcess::(_processLogs) (542794) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,840::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,840::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,840::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) (542795) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) (542795) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,841::__init__::225::IOProcess::(_processLogs) (542795) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) (542795) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,842::__init__::225::IOProcess::(_processLogs) (542796) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,843::__init__::225::IOProcess::(_processLogs) (542796) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,852::__init__::225::IOProcess::(_processLogs) DEBUG|(542796) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,852::__init__::225::IOProcess::(_processLogs) (542796) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,852::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,852::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) Message size is 225 >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,853::__init__::225::IOProcess::(_processLogs) (542797) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) (542797) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) (542797) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) (542797) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) Message size is 227 >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,854::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,855::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,855::__init__::225::IOProcess::(_processLogs) (542798) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:19,855::__init__::225::IOProcess::(_processLogs) (542798) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:19,860::__init__::225::IOProcess::(_processLogs) DEBUG|(542798) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,860::__init__::225::IOProcess::(_processLogs) (542798) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,860::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,861::__init__::225::IOProcess::(_processLogs) (542799) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:19,862::__init__::225::IOProcess::(_processLogs) (542799) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:19,869::__init__::225::IOProcess::(_processLogs) DEBUG|(542799) Building response >Thread-19::DEBUG::2014-08-11 17:43:19,869::__init__::225::IOProcess::(_processLogs) (542799) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:19,869::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:19,869::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) (542800) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:43:19,870::__init__::225::IOProcess::(_processLogs) (542800) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:43:19,871::__init__::225::IOProcess::(_processLogs) DEBUG|(542800) Building response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,871::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:43:19,871::__init__::225::IOProcess::(_processLogs) (542800) Queuing response >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,871::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:43:19,872::__init__::225::IOProcess::(_processLogs) Generating json... >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,872::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-19::DEBUG::2014-08-11 17:43:19,872::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,873::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,873::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,873::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,873::task::916::Storage.TaskManager.Task::(_runJobs) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::Task.run: exit - success: result {'uuid': 'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff'} >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,873::task::993::Storage.TaskManager.Task::(_decref) Task=`d1919e29-2350-4faa-8241-34d8964ddb72`::ref 0 aborting False >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:43:19,873::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-10237::DEBUG::2014-08-11 17:43:19,997::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:19,997::task::595::Storage.TaskManager.Task::(_updateState) Task=`66fbe54a-b717-408b-bbf6-e6111bdfcf70`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:19,997::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:43:20,051::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:20,051::task::1191::Storage.TaskManager.Task::(prepare) Task=`66fbe54a-b717-408b-bbf6-e6111bdfcf70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:20,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`66fbe54a-b717-408b-bbf6-e6111bdfcf70`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:20,051::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:20,051::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:20,051::task::993::Storage.TaskManager.Task::(_decref) Task=`66fbe54a-b717-408b-bbf6-e6111bdfcf70`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:43:20,062::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:43:20,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d0859e-b37f-4df1-a796-e90c4456dd54`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:43:20,062::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:43:20,062::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6588cff5-43f7-4b7c-9de1-de433b4ae2f4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:43:20,062::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:43:20,063::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:43:20,063::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`6588cff5-43f7-4b7c-9de1-de433b4ae2f4`::Granted request >Thread-10197::DEBUG::2014-08-11 17:43:20,063::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`10d0859e-b37f-4df1-a796-e90c4456dd54`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:43:20,063::task::993::Storage.TaskManager.Task::(_decref) Task=`10d0859e-b37f-4df1-a796-e90c4456dd54`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:43:20,125::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:20,125::task::1191::Storage.TaskManager.Task::(prepare) Task=`10d0859e-b37f-4df1-a796-e90c4456dd54`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:20,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`10d0859e-b37f-4df1-a796-e90c4456dd54`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:43:20,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:43:20,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:43:20,125::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:43:20,125::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:43:20,125::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:43:20,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:43:20,126::task::993::Storage.TaskManager.Task::(_decref) Task=`10d0859e-b37f-4df1-a796-e90c4456dd54`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:43:20,739::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:20,739::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:20,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:20,739::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:20,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) (542801) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) (542801) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) DEBUG|(542801) Building response >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) (542801) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:20,740::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:43:20,741::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:43:20,810::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00165722 s, 299 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:20,811::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:20,812::__init__::225::IOProcess::(_processLogs) (542802) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:20,812::__init__::225::IOProcess::(_processLogs) (542802) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:20,812::__init__::225::IOProcess::(_processLogs) DEBUG|(542802) Building response >Thread-19::DEBUG::2014-08-11 17:43:20,812::__init__::225::IOProcess::(_processLogs) (542802) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:20,812::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:20,813::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) (542803) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) (542803) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) (542803) Building response >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) (542803) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:20,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) (542804) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) (542804) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) (542804) Building response >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) (542804) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:20,815::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:20,816::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:20,816::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:43:20,816::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:20,816::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) (542805) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) (542805) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) (542805) Building response >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) (542805) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:20,817::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:43:20,902::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 46. >GuestMonitor-vm::DEBUG::2014-08-11 17:43:21,104::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:21,104::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:43:21,104::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:21,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:21,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0524463 s, 19.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:21,914::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:21,915::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:21,915::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:23,627::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:23,709::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0215946 s, 47.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:23,857::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:23,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`140afe43-525c-448a-9d17-19f0e26229d6`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:23,858::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:43:23,858::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-10237::DEBUG::2014-08-11 17:43:23,858::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: d1919e29-2350-4faa-8241-34d8964ddb72 >Thread-10237::DEBUG::2014-08-11 17:43:23,858::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1919e29-2350-4faa-8241-34d8964ddb72'} >Thread-10237::DEBUG::2014-08-11 17:43:23,858::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a >Thread-10237::DEBUG::2014-08-11 17:43:23,858::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9c2a5d70-29fe-437b-b8a7-45f5efd4b79a'} >Thread-10237::DEBUG::2014-08-11 17:43:23,858::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'9c2a5d70-29fe-437b-b8a7-45f5efd4b79a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9c2a5d70-29fe-437b-b8a7-45f5efd4b79a'}, 'd1919e29-2350-4faa-8241-34d8964ddb72': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1919e29-2350-4faa-8241-34d8964ddb72'}} >Thread-10237::INFO::2014-08-11 17:43:23,858::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'9c2a5d70-29fe-437b-b8a7-45f5efd4b79a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9c2a5d70-29fe-437b-b8a7-45f5efd4b79a'}, 'd1919e29-2350-4faa-8241-34d8964ddb72': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1919e29-2350-4faa-8241-34d8964ddb72'}}} >Thread-10237::DEBUG::2014-08-11 17:43:23,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`140afe43-525c-448a-9d17-19f0e26229d6`::finished: {'allTasksStatus': {'9c2a5d70-29fe-437b-b8a7-45f5efd4b79a': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '9c2a5d70-29fe-437b-b8a7-45f5efd4b79a'}, 'd1919e29-2350-4faa-8241-34d8964ddb72': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': 'd1919e29-2350-4faa-8241-34d8964ddb72'}}} >Thread-10237::DEBUG::2014-08-11 17:43:23,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`140afe43-525c-448a-9d17-19f0e26229d6`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:23,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:23,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:23,859::task::993::Storage.TaskManager.Task::(_decref) Task=`140afe43-525c-448a-9d17-19f0e26229d6`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:24,002::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmHibernate with ('14c0fa91-1814-438b-8d7a-4e7de1e1da25', '7158eae9-4886-4af7-af0b-d668ecee9e4f,00000002-0002-0002-0002-00000000037f,a8e37c70-8fa4-46f7-bc12-f7b02e5b5856,041ad999-7aa9-4dcf-a3b1-bf962cc75c25,812042c3-6adc-4cf2-aaf4-e3f90efd5e5f,cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff') {} >Thread-10237::DEBUG::2014-08-11 17:43:24,002::API::511::vds::(migrate) {'hiberVolHandle': '7158eae9-4886-4af7-af0b-d668ecee9e4f,00000002-0002-0002-0002-00000000037f,a8e37c70-8fa4-46f7-bc12-f7b02e5b5856,041ad999-7aa9-4dcf-a3b1-bf962cc75c25,812042c3-6adc-4cf2-aaf4-e3f90efd5e5f,cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'mode': 'file'} >Thread-10237::DEBUG::2014-08-11 17:43:24,003::BindingXMLRPC::1134::vds::(wrapper) return vmHibernate with {'status': {'message': 'Hibernation process starting', 'code': 0}, 'progress': 0} >Thread-10248::DEBUG::2014-08-11 17:43:24,004::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10248::DEBUG::2014-08-11 17:43:24,005::migration::135::vm.Vm::(_prepareGuest) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Save State begins >Thread-10248::DEBUG::2014-08-11 17:43:24,005::guestagent::351::vm.Vm::(desktopLock) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::desktopLock called >libvirtEventLoop::DEBUG::2014-08-11 17:43:24,008::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Suspended detail 0 opaque None >Thread-10248::DEBUG::2014-08-11 17:43:24,009::migration::237::vm.Vm::(run) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::migration semaphore acquired after 0 seconds >libvirtEventLoop::DEBUG::2014-08-11 17:43:24,009::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Suspended detail 0 opaque None >Thread-10248::DEBUG::2014-08-11 17:43:24,026::sampling::414::vm.Vm::(pause) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Pause statistics collection >Thread-10248::DEBUG::2014-08-11 17:43:24,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd1b6f54-f953-4670-ab60-0c74c14d8946`::moving from state init -> state preparing >Thread-10248::INFO::2014-08-11 17:43:24,026::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', leafUUID='041ad999-7aa9-4dcf-a3b1-bf962cc75c25') >Thread-10248::DEBUG::2014-08-11 17:43:24,027::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`24c847a7-fa43-4277-aeb0-1362a1468b79`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-10248::DEBUG::2014-08-11 17:43:24,027::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10248::DEBUG::2014-08-11 17:43:24,027::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10237::DEBUG::2014-08-11 17:43:24,028::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10248::DEBUG::2014-08-11 17:43:24,028::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`24c847a7-fa43-4277-aeb0-1362a1468b79`::Granted request >Thread-10237::DEBUG::2014-08-11 17:43:24,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`c42aeb2a-8b92-4117-8803-1502d89f631e`::moving from state init -> state preparing >Thread-10248::DEBUG::2014-08-11 17:43:24,029::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cd1b6f54-f953-4670-ab60-0c74c14d8946`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10237::INFO::2014-08-11 17:43:24,030::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='9c2a5d70-29fe-437b-b8a7-45f5efd4b79a', spUUID=None, options=None) >Thread-10248::DEBUG::2014-08-11 17:43:24,030::task::993::Storage.TaskManager.Task::(_decref) Task=`cd1b6f54-f953-4670-ab60-0c74c14d8946`::ref 1 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:24,030::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 9c2a5d70-29fe-437b-b8a7-45f5efd4b79a >Thread-19::DEBUG::2014-08-11 17:43:24,031::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,031::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:43:24,031::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,031::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,031::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) (542806) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) (542806) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) (542807) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:24,032::__init__::225::IOProcess::(_processLogs) (542807) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:24,038::__init__::225::IOProcess::(_processLogs) (542807) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,039::__init__::225::IOProcess::(_processLogs) Sending response sized 288 >Thread-19::DEBUG::2014-08-11 17:43:24,039::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:43:24,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,039::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) (542808) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) (542808) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) (542808) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) (542808) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,040::__init__::225::IOProcess::(_processLogs) Message size is 217 >Thread-19::DEBUG::2014-08-11 17:43:24,041::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,041::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,041::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,041::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,041::__init__::225::IOProcess::(_processLogs) (542809) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,041::__init__::225::IOProcess::(_processLogs) (542809) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,057::__init__::225::IOProcess::(_processLogs) (542809) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,057::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,057::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-08-11 17:43:24,057::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) (542810) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) (542810) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) (542810) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) (542810) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,058::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) (542811) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,059::__init__::225::IOProcess::(_processLogs) (542811) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,075::__init__::225::IOProcess::(_processLogs) (542811) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,076::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,076::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:43:24,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) (542812) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) (542812) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) (542812) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) (542812) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:24,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,078::__init__::225::IOProcess::(_processLogs) (542813) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,078::__init__::225::IOProcess::(_processLogs) (542813) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,081::__init__::225::IOProcess::(_processLogs) (542806) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,081::__init__::225::IOProcess::(_processLogs) Sending response sized 6355 >Thread-10248::DEBUG::2014-08-11 17:43:24,083::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:43:24,083::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:43:24,083::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10248::DEBUG::2014-08-11 17:43:24,083::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:43:24,084::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10248::WARNING::2014-08-11 17:43:24,084::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f already exists >Thread-19::DEBUG::2014-08-11 17:43:24,085::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10248::DEBUG::2014-08-11 17:43:24,085::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 to /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 >Thread-19::DEBUG::2014-08-11 17:43:24,086::__init__::225::IOProcess::(_processLogs) (542814) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,087::__init__::225::IOProcess::(_processLogs) (542814) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,087::__init__::225::IOProcess::(_processLogs) (542814) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,087::__init__::225::IOProcess::(_processLogs) (542814) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,087::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,087::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:24,088::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:24,088::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,088::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,088::__init__::225::IOProcess::(_processLogs) (542815) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) (542815) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) (542815) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) (542815) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10248::DEBUG::2014-08-11 17:43:24,089::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:43:24,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,090::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,090::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,090::__init__::225::IOProcess::(_processLogs) (542816) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:24,090::__init__::225::IOProcess::(_processLogs) (542816) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:24,090::__init__::225::IOProcess::(_processLogs) (542816) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) (542816) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) (542813) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,091::__init__::225::IOProcess::(_processLogs) Message size is 273 >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) (542817) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) (542817) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:43:24,092::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,093::__init__::225::IOProcess::(_processLogs) (542817) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,093::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,093::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,093::__init__::225::IOProcess::(_processLogs) (542818) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) (542818) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) (542818) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) (542818) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-08-11 17:43:24,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) (542819) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) (542819) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,095::__init__::225::IOProcess::(_processLogs) (542820) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,096::__init__::225::IOProcess::(_processLogs) (542820) Got request for method 'unlink' >Thread-10248::INFO::2014-08-11 17:43:24,096::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}]} >Thread-19::DEBUG::2014-08-11 17:43:24,096::__init__::225::IOProcess::(_processLogs) (542819) Queuing response >Thread-10248::DEBUG::2014-08-11 17:43:24,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd1b6f54-f953-4670-ab60-0c74c14d8946`::finished: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}]} >Thread-19::DEBUG::2014-08-11 17:43:24,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10248::DEBUG::2014-08-11 17:43:24,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd1b6f54-f953-4670-ab60-0c74c14d8946`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:43:24,098::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10248::DEBUG::2014-08-11 17:43:24,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10248::DEBUG::2014-08-11 17:43:24,098::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10248::DEBUG::2014-08-11 17:43:24,099::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10248::DEBUG::2014-08-11 17:43:24,099::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10248::DEBUG::2014-08-11 17:43:24,099::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10248::DEBUG::2014-08-11 17:43:24,099::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10248::DEBUG::2014-08-11 17:43:24,099::task::993::Storage.TaskManager.Task::(_decref) Task=`cd1b6f54-f953-4670-ab60-0c74c14d8946`::ref 0 aborting False >Thread-10248::INFO::2014-08-11 17:43:24,099::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:43:24,105::__init__::225::IOProcess::(_processLogs) (542820) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,105::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,105::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-08-11 17:43:24,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) (542821) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) (542821) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) (542821) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) (542821) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) (542822) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,107::__init__::225::IOProcess::(_processLogs) (542822) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,118::__init__::225::IOProcess::(_processLogs) (542822) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,118::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) (542823) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:24,119::__init__::225::IOProcess::(_processLogs) (542823) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:24,132::__init__::225::IOProcess::(_processLogs) (542823) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,133::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:43:24,133::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-10237::INFO::2014-08-11 17:43:24,133::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-10237::DEBUG::2014-08-11 17:43:24,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`c42aeb2a-8b92-4117-8803-1502d89f631e`::finished: None >Thread-10237::DEBUG::2014-08-11 17:43:24,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`c42aeb2a-8b92-4117-8803-1502d89f631e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:24,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:24,134::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:24,134::task::993::Storage.TaskManager.Task::(_decref) Task=`c42aeb2a-8b92-4117-8803-1502d89f631e`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:24,151::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:24,151::task::595::Storage.TaskManager.Task::(_updateState) Task=`599a6864-cf1c-4bfa-8ebf-79f0a0822bc6`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:24,151::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='d1919e29-2350-4faa-8241-34d8964ddb72', spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:43:24,152::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: d1919e29-2350-4faa-8241-34d8964ddb72 >Thread-19::DEBUG::2014-08-11 17:43:24,152::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:43:24,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,152::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,153::__init__::225::IOProcess::(_processLogs) (542824) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:43:24,153::__init__::225::IOProcess::(_processLogs) (542824) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:43:24,154::__init__::225::IOProcess::(_processLogs) (542824) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) (542825) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) (542825) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) (542825) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,155::__init__::225::IOProcess::(_processLogs) (542825) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,156::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-08-11 17:43:24,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,156::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,157::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,157::__init__::225::IOProcess::(_processLogs) (542826) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,157::__init__::225::IOProcess::(_processLogs) (542826) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,166::__init__::225::IOProcess::(_processLogs) DEBUG|(542826) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,166::__init__::225::IOProcess::(_processLogs) (542826) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,166::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,167::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,167::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,167::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:43:24,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,167::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) (542827) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) (542827) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) (542827) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) (542827) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,168::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) (542828) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,169::__init__::225::IOProcess::(_processLogs) (542828) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,180::__init__::225::IOProcess::(_processLogs) DEBUG|(542828) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,180::__init__::225::IOProcess::(_processLogs) (542828) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,180::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,181::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,181::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,181::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-08-11 17:43:24,181::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,182::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,182::__init__::225::IOProcess::(_processLogs) (542829) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,182::__init__::225::IOProcess::(_processLogs) (542829) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) (542829) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) (542829) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,183::__init__::225::IOProcess::(_processLogs) (542830) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,184::__init__::225::IOProcess::(_processLogs) (542830) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,194::__init__::225::IOProcess::(_processLogs) DEBUG|(542830) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,195::__init__::225::IOProcess::(_processLogs) (542830) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,195::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,195::__init__::225::IOProcess::(_processLogs) Message size is 218 >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) (542831) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,196::__init__::225::IOProcess::(_processLogs) (542831) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) (542831) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) (542831) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,198::__init__::225::IOProcess::(_processLogs) (542832) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,198::__init__::225::IOProcess::(_processLogs) (542832) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,208::__init__::225::IOProcess::(_processLogs) DEBUG|(542832) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,208::__init__::225::IOProcess::(_processLogs) (542832) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,208::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,209::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,209::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,209::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:43:24,209::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,209::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,209::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) (542833) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) (542833) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) (542833) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) (542833) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) Message size is 217 >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,210::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,211::__init__::225::IOProcess::(_processLogs) (542834) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:43:24,211::__init__::225::IOProcess::(_processLogs) (542834) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:43:24,222::__init__::225::IOProcess::(_processLogs) DEBUG|(542834) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,222::__init__::225::IOProcess::(_processLogs) (542834) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,222::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) (542835) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:43:24,223::__init__::225::IOProcess::(_processLogs) (542835) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:43:24,233::__init__::225::IOProcess::(_processLogs) DEBUG|(542835) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,233::__init__::225::IOProcess::(_processLogs) (542835) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,233::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10237::DEBUG::2014-08-11 17:43:24,233::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-19::DEBUG::2014-08-11 17:43:24,234::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::INFO::2014-08-11 17:43:24,234::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-10237::DEBUG::2014-08-11 17:43:24,234::task::1191::Storage.TaskManager.Task::(prepare) Task=`599a6864-cf1c-4bfa-8ebf-79f0a0822bc6`::finished: None >Thread-10237::DEBUG::2014-08-11 17:43:24,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`599a6864-cf1c-4bfa-8ebf-79f0a0822bc6`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:24,234::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:24,234::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:24,235::task::993::Storage.TaskManager.Task::(_decref) Task=`599a6864-cf1c-4bfa-8ebf-79f0a0822bc6`::ref 0 aborting False >VM Channels Listener::ERROR::2014-08-11 17:43:24,605::vmchannels::54::vds::(_handle_event) Received 00000019 on fileno 46 >VM Channels Listener::DEBUG::2014-08-11 17:43:24,606::vmchannels::133::vds::(_handle_unconnected) Trying to connect fileno 46. >VM Channels Listener::DEBUG::2014-08-11 17:43:24,606::guestagent::199::vm.Vm::(_connect) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Attempting connection to /var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-08-11 17:43:24,606::guestagent::213::vm.Vm::(_connect) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Failed to connect to /var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.com.redhat.rhevm.vdsm with 111 >libvirtEventLoop::DEBUG::2014-08-11 17:43:24,770::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Stopped detail 4 opaque None >Thread-10248::DEBUG::2014-08-11 17:43:24,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5d61ab5-76e2-4a5b-a096-91353a5f25d7`::moving from state init -> state preparing >Thread-10248::INFO::2014-08-11 17:43:24,771::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', volUUID=None) >Thread-10248::DEBUG::2014-08-11 17:43:24,771::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`7290f426-bc05-427a-b109-8881b8f17ccb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-10248::DEBUG::2014-08-11 17:43:24,771::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10248::DEBUG::2014-08-11 17:43:24,771::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10248::DEBUG::2014-08-11 17:43:24,771::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`7290f426-bc05-427a-b109-8881b8f17ccb`::Granted request >Thread-10248::DEBUG::2014-08-11 17:43:24,771::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e5d61ab5-76e2-4a5b-a096-91353a5f25d7`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10248::DEBUG::2014-08-11 17:43:24,771::task::993::Storage.TaskManager.Task::(_decref) Task=`e5d61ab5-76e2-4a5b-a096-91353a5f25d7`::ref 1 aborting False >Thread-10248::INFO::2014-08-11 17:43:24,772::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-10248::DEBUG::2014-08-11 17:43:24,772::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5d61ab5-76e2-4a5b-a096-91353a5f25d7`::finished: None >Thread-10248::DEBUG::2014-08-11 17:43:24,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5d61ab5-76e2-4a5b-a096-91353a5f25d7`::moving from state preparing -> state finished >Thread-10248::DEBUG::2014-08-11 17:43:24,772::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10248::DEBUG::2014-08-11 17:43:24,772::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10248::DEBUG::2014-08-11 17:43:24,772::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10248::DEBUG::2014-08-11 17:43:24,772::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10248::DEBUG::2014-08-11 17:43:24,772::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10248::DEBUG::2014-08-11 17:43:24,772::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10248::DEBUG::2014-08-11 17:43:24,772::task::993::Storage.TaskManager.Task::(_decref) Task=`e5d61ab5-76e2-4a5b-a096-91353a5f25d7`::ref 0 aborting False >Thread-10248::DEBUG::2014-08-11 17:43:24,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`5df4fdc1-8383-472a-a39f-25242320f32a`::moving from state init -> state preparing >Thread-10248::INFO::2014-08-11 17:43:24,773::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', leafUUID='cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff') >Thread-10248::DEBUG::2014-08-11 17:43:24,773::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`2480165e-f856-4b2a-9df9-fbc4c96f2cf5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-10248::DEBUG::2014-08-11 17:43:24,773::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10248::DEBUG::2014-08-11 17:43:24,773::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10248::DEBUG::2014-08-11 17:43:24,773::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`2480165e-f856-4b2a-9df9-fbc4c96f2cf5`::Granted request >Thread-10248::DEBUG::2014-08-11 17:43:24,773::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5df4fdc1-8383-472a-a39f-25242320f32a`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10248::DEBUG::2014-08-11 17:43:24,773::task::993::Storage.TaskManager.Task::(_decref) Task=`5df4fdc1-8383-472a-a39f-25242320f32a`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,774::__init__::225::IOProcess::(_processLogs) (542836) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:43:24,775::__init__::225::IOProcess::(_processLogs) (542836) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:43:24,812::__init__::225::IOProcess::(_processLogs) DEBUG|(542836) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,812::__init__::225::IOProcess::(_processLogs) (542836) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,813::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,813::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 6355 >Thread-10248::DEBUG::2014-08-11 17:43:24,814::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-19::DEBUG::2014-08-11 17:43:24,814::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,814::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:43:24,814::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,814::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10248::DEBUG::2014-08-11 17:43:24,814::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:43:24,815::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10248::WARNING::2014-08-11 17:43:24,815::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f already exists >Thread-10248::DEBUG::2014-08-11 17:43:24,815::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f to /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f >Thread-19::DEBUG::2014-08-11 17:43:24,815::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) (542837) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) (542837) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) (542837) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) (542837) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) Sending response sized 238 >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:43:24,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) (542838) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) (542838) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) (542838) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,818::__init__::225::IOProcess::(_processLogs) (542838) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,819::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:43:24,819::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,819::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:43:24,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10248::DEBUG::2014-08-11 17:43:24,819::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-19::DEBUG::2014-08-11 17:43:24,819::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) (542839) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) (542839) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) (542839) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) (542839) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,820::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) Message size is 273 >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) (542840) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) (542840) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:24,821::__init__::225::IOProcess::(_processLogs) DEBUG|(542840) Building response >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) (542840) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:24,822::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:24,823::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:24,823::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:24,823::__init__::225::IOProcess::(_processLogs) (542841) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:24,823::__init__::225::IOProcess::(_processLogs) (542841) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:24,823::__init__::225::IOProcess::(_processLogs) DEBUG|(542841) Building response >Thread-10248::INFO::2014-08-11 17:43:24,823::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}]} >Thread-19::DEBUG::2014-08-11 17:43:24,824::__init__::225::IOProcess::(_processLogs) (542841) Queuing response >Thread-10248::DEBUG::2014-08-11 17:43:24,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`5df4fdc1-8383-472a-a39f-25242320f32a`::finished: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}]} >Thread-19::DEBUG::2014-08-11 17:43:24,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10248::DEBUG::2014-08-11 17:43:24,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`5df4fdc1-8383-472a-a39f-25242320f32a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:43:24,825::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10248::DEBUG::2014-08-11 17:43:24,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10248::DEBUG::2014-08-11 17:43:24,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10248::DEBUG::2014-08-11 17:43:24,825::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10248::DEBUG::2014-08-11 17:43:24,825::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10248::DEBUG::2014-08-11 17:43:24,825::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10248::DEBUG::2014-08-11 17:43:24,825::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10248::DEBUG::2014-08-11 17:43:24,826::task::993::Storage.TaskManager.Task::(_decref) Task=`5df4fdc1-8383-472a-a39f-25242320f32a`::ref 0 aborting False >Thread-10248::INFO::2014-08-11 17:43:24,826::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-10248::DEBUG::2014-08-11 17:43:24,841::task::595::Storage.TaskManager.Task::(_updateState) Task=`811fea73-8916-4ffd-83ca-cf4011cf70fd`::moving from state init -> state preparing >Thread-10248::INFO::2014-08-11 17:43:24,841::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', volUUID=None) >Thread-10248::DEBUG::2014-08-11 17:43:24,841::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`1ffb0b5b-aab0-40c3-be47-fd161eb431c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-10248::DEBUG::2014-08-11 17:43:24,842::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10248::DEBUG::2014-08-11 17:43:24,842::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10248::DEBUG::2014-08-11 17:43:24,842::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`1ffb0b5b-aab0-40c3-be47-fd161eb431c8`::Granted request >Thread-10248::DEBUG::2014-08-11 17:43:24,842::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`811fea73-8916-4ffd-83ca-cf4011cf70fd`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10248::DEBUG::2014-08-11 17:43:24,842::task::993::Storage.TaskManager.Task::(_decref) Task=`811fea73-8916-4ffd-83ca-cf4011cf70fd`::ref 1 aborting False >Thread-10248::INFO::2014-08-11 17:43:24,842::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-10248::DEBUG::2014-08-11 17:43:24,842::task::1191::Storage.TaskManager.Task::(prepare) Task=`811fea73-8916-4ffd-83ca-cf4011cf70fd`::finished: None >Thread-10248::DEBUG::2014-08-11 17:43:24,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`811fea73-8916-4ffd-83ca-cf4011cf70fd`::moving from state preparing -> state finished >Thread-10248::DEBUG::2014-08-11 17:43:24,842::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10248::DEBUG::2014-08-11 17:43:24,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10248::DEBUG::2014-08-11 17:43:24,842::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10248::DEBUG::2014-08-11 17:43:24,843::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10248::DEBUG::2014-08-11 17:43:24,843::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10248::DEBUG::2014-08-11 17:43:24,843::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10248::DEBUG::2014-08-11 17:43:24,843::task::993::Storage.TaskManager.Task::(_decref) Task=`811fea73-8916-4ffd-83ca-cf4011cf70fd`::ref 0 aborting False >Thread-10248::DEBUG::2014-08-11 17:43:24,845::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '14c0fa91-1814-438b-8d7a-4e7de1e1da25' (vm) >Thread-10248::DEBUG::2014-08-11 17:43:24,845::vm::2771::vm.Vm::(setDownStatus) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Changed state to Down: SaveState succeeded (code=5) >Thread-10248::DEBUG::2014-08-11 17:43:24,845::vmchannels::210::vds::(unregister) Delete fileno 46 from listener. >Thread-10248::DEBUG::2014-08-11 17:43:24,845::sampling::406::vm.Vm::(stop) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Stop statistics collection >Thread-10102::DEBUG::2014-08-11 17:43:24,845::sampling::437::vm.Vm::(run) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Stats thread finished >Thread-10248::DEBUG::2014-08-11 17:43:24,848::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '14c0fa91-1814-438b-8d7a-4e7de1e1da25' (vm) >Thread-10017::DEBUG::2014-08-11 17:43:25,072::task::595::Storage.TaskManager.Task::(_updateState) Task=`d021bca9-3db8-4d9a-b65c-60e8cb685abc`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:43:25,072::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:43:25,072::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:25,072::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:43:25,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:25,072::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:25,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:25,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:25,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:25,073::__init__::225::IOProcess::(_processLogs) (542842) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:43:25,073::__init__::225::IOProcess::(_processLogs) (542842) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:43:25,076::__init__::225::IOProcess::(_processLogs) DEBUG|(542842) Building response >Thread-19::DEBUG::2014-08-11 17:43:25,076::__init__::225::IOProcess::(_processLogs) (542842) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:25,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:25,076::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:43:25,076::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:25,077::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:43:25,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:25,077::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:43:25,077::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:43:25,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:43:25,078::task::1191::Storage.TaskManager.Task::(prepare) Task=`d021bca9-3db8-4d9a-b65c-60e8cb685abc`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:43:25,078::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:43:25,078::task::595::Storage.TaskManager.Task::(_updateState) Task=`d021bca9-3db8-4d9a-b65c-60e8cb685abc`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:43:25,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:43:25,079::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:43:25,079::__init__::225::IOProcess::(_processLogs) (542843) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:43:25,079::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:43:25,079::__init__::225::IOProcess::(_processLogs) (542843) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:43:25,080::task::993::Storage.TaskManager.Task::(_decref) Task=`d021bca9-3db8-4d9a-b65c-60e8cb685abc`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:43:25,080::__init__::225::IOProcess::(_processLogs) (542843) Building response >Thread-19::DEBUG::2014-08-11 17:43:25,080::__init__::225::IOProcess::(_processLogs) (542843) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:25,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:25,080::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:43:25,102::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) (542844) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:25,423::__init__::225::IOProcess::(_processLogs) (542844) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:25,424::__init__::225::IOProcess::(_processLogs) DEBUG|(542844) Building response >Thread-19::DEBUG::2014-08-11 17:43:25,424::__init__::225::IOProcess::(_processLogs) (542844) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:25,424::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:25,425::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:43:25,425::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:43:25,484::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000434408 s, 843 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:25,485::__init__::225::IOProcess::(_processLogs) (542845) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:25,486::__init__::225::IOProcess::(_processLogs) (542845) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:25,486::__init__::225::IOProcess::(_processLogs) DEBUG|(542845) Building response >Thread-19::DEBUG::2014-08-11 17:43:25,486::__init__::225::IOProcess::(_processLogs) (542845) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:25,486::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:25,487::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >VM Channels Listener::DEBUG::2014-08-11 17:43:25,607::vmchannels::117::vds::(_do_del_channels) fileno 46 was removed from listener. >Dummy-51::DEBUG::2014-08-11 17:43:25,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:25,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530564 s, 19.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:25,955::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmGetStats with ('14c0fa91-1814-438b-8d7a-4e7de1e1da25',) {} >Thread-10237::DEBUG::2014-08-11 17:43:25,955::BindingXMLRPC::1134::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'exitMessage': 'SaveState succeeded', 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'exitReason': 5, 'timeOffset': '0', 'exitCode': 0}]} >Thread-10237::DEBUG::2014-08-11 17:43:26,024::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmDestroy with ('14c0fa91-1814-438b-8d7a-4e7de1e1da25',) {} >Thread-10237::INFO::2014-08-11 17:43:26,024::API::333::vds::(destroy) vmContainerLock acquired by vm 14c0fa91-1814-438b-8d7a-4e7de1e1da25 >Thread-10237::DEBUG::2014-08-11 17:43:26,024::vm::4813::vm.Vm::(destroy) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::destroy Called >Thread-10237::INFO::2014-08-11 17:43:26,025::vm::4746::vm.Vm::(releaseVm) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Release VM resources >Thread-10237::WARNING::2014-08-11 17:43:26,025::vm::1924::vm.Vm::(_set_lastStatus) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::trying to set state to Powering down when already Down >Thread-10237::DEBUG::2014-08-11 17:43:26,025::sampling::406::vm.Vm::(stop) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Stop statistics collection >Thread-10237::DEBUG::2014-08-11 17:43:26,026::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 42 edom: 10 level: 2 message: Domain not found: no domain with matching uuid '14c0fa91-1814-438b-8d7a-4e7de1e1da25' (vm) >Thread-10237::INFO::2014-08-11 17:43:26,026::vm::4782::vm.Vm::(_destroyVmGraceful) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::VM '14c0fa91-1814-438b-8d7a-4e7de1e1da25' already down and destroyed >Thread-10237::DEBUG::2014-08-11 17:43:26,026::task::595::Storage.TaskManager.Task::(_updateState) Task=`8527ddd1-e8c3-421c-ad94-27bd003b0b81`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:26,026::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID=None) >Thread-10237::DEBUG::2014-08-11 17:43:26,027::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`7b562aaa-ee96-419b-a60a-479af3503829`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-10237::DEBUG::2014-08-11 17:43:26,027::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10237::DEBUG::2014-08-11 17:43:26,027::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10237::DEBUG::2014-08-11 17:43:26,027::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`7b562aaa-ee96-419b-a60a-479af3503829`::Granted request >Thread-10237::DEBUG::2014-08-11 17:43:26,027::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8527ddd1-e8c3-421c-ad94-27bd003b0b81`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10237::DEBUG::2014-08-11 17:43:26,027::task::993::Storage.TaskManager.Task::(_decref) Task=`8527ddd1-e8c3-421c-ad94-27bd003b0b81`::ref 1 aborting False >Thread-10237::INFO::2014-08-11 17:43:26,027::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-10237::DEBUG::2014-08-11 17:43:26,027::task::1191::Storage.TaskManager.Task::(prepare) Task=`8527ddd1-e8c3-421c-ad94-27bd003b0b81`::finished: None >Thread-10237::DEBUG::2014-08-11 17:43:26,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`8527ddd1-e8c3-421c-ad94-27bd003b0b81`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:26,028::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10237::DEBUG::2014-08-11 17:43:26,028::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:26,028::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10237::DEBUG::2014-08-11 17:43:26,028::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10237::DEBUG::2014-08-11 17:43:26,028::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10237::DEBUG::2014-08-11 17:43:26,028::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10237::DEBUG::2014-08-11 17:43:26,028::task::993::Storage.TaskManager.Task::(_decref) Task=`8527ddd1-e8c3-421c-ad94-27bd003b0b81`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:26,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`deb9e821-1a74-4892-80fb-bd3f65426ee0`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:26,029::logUtils::44::dispatcher::(wrapper) Run and protect: inappropriateDevices(thiefId='14c0fa91-1814-438b-8d7a-4e7de1e1da25') >Thread-10237::INFO::2014-08-11 17:43:26,029::logUtils::47::dispatcher::(wrapper) Run and protect: inappropriateDevices, Return response: None >Thread-10237::DEBUG::2014-08-11 17:43:26,029::task::1191::Storage.TaskManager.Task::(prepare) Task=`deb9e821-1a74-4892-80fb-bd3f65426ee0`::finished: None >Thread-10237::DEBUG::2014-08-11 17:43:26,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`deb9e821-1a74-4892-80fb-bd3f65426ee0`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:26,029::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:26,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:26,029::task::993::Storage.TaskManager.Task::(_decref) Task=`deb9e821-1a74-4892-80fb-bd3f65426ee0`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:26,029::vm::4807::vm.Vm::(deleteVm) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Total desktops after destroy of 14c0fa91-1814-438b-8d7a-4e7de1e1da25 is 3 >Thread-10237::DEBUG::2014-08-11 17:43:26,029::BindingXMLRPC::1134::vds::(wrapper) return vmDestroy with {'status': {'message': 'Machine destroyed', 'code': 0}} >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:26,921::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:26,921::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:26,922::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:27,835::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:27,923::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0284046 s, 36.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:29,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`704d839e-e9f5-41a1-8bdf-6f75b79b4bcd`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:29,095::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:43:29,095::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434408', 'lastCheck': '3.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00165722', 'lastCheck': '8.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:29,095::task::1191::Storage.TaskManager.Task::(prepare) Task=`704d839e-e9f5-41a1-8bdf-6f75b79b4bcd`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000434408', 'lastCheck': '3.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00165722', 'lastCheck': '8.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:29,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`704d839e-e9f5-41a1-8bdf-6f75b79b4bcd`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:29,095::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:29,095::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:29,096::task::993::Storage.TaskManager.Task::(_decref) Task=`704d839e-e9f5-41a1-8bdf-6f75b79b4bcd`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:29,115::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:29,931::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:30,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124142 s, 82.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:30,157::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:30,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1e1e483-7cf6-49d7-a44b-b8459c6dac3c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:30,158::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:43:30,214::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:30,215::task::1191::Storage.TaskManager.Task::(prepare) Task=`e1e1e483-7cf6-49d7-a44b-b8459c6dac3c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:30,215::task::595::Storage.TaskManager.Task::(_updateState) Task=`e1e1e483-7cf6-49d7-a44b-b8459c6dac3c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:30,215::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:30,215::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:30,215::task::993::Storage.TaskManager.Task::(_decref) Task=`e1e1e483-7cf6-49d7-a44b-b8459c6dac3c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:43:30,221::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:43:30,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebad88f3-4792-4721-b799-890be7ebe668`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:43:30,222::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:43:30,222::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`51526725-691f-47fb-b093-94e349815a08`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:43:30,222::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:43:30,222::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:43:30,222::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`51526725-691f-47fb-b093-94e349815a08`::Granted request >Thread-10197::DEBUG::2014-08-11 17:43:30,222::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ebad88f3-4792-4721-b799-890be7ebe668`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:43:30,223::task::993::Storage.TaskManager.Task::(_decref) Task=`ebad88f3-4792-4721-b799-890be7ebe668`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:43:30,267::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:30,267::task::1191::Storage.TaskManager.Task::(prepare) Task=`ebad88f3-4792-4721-b799-890be7ebe668`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:30,267::task::595::Storage.TaskManager.Task::(_updateState) Task=`ebad88f3-4792-4721-b799-890be7ebe668`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:43:30,267::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:43:30,267::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:43:30,267::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:43:30,268::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:43:30,268::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:43:30,268::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:43:30,268::task::993::Storage.TaskManager.Task::(_decref) Task=`ebad88f3-4792-4721-b799-890be7ebe668`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:43:30,817::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:30,817::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:30,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:30,817::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:30,817::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-28::DEBUG::2014-08-11 17:43:30,818::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:30,818::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:30,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:30,877::__init__::225::IOProcess::(_processLogs) (542846) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:30,877::__init__::225::IOProcess::(_processLogs) (542846) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:30,877::__init__::225::IOProcess::(_processLogs) (542846) Building response >Thread-19::DEBUG::2014-08-11 17:43:30,877::__init__::225::IOProcess::(_processLogs) (542846) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:30,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:30,877::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:43:30,878::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00123562 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:30,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:30,880::__init__::225::IOProcess::(_processLogs) (542847) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:30,880::__init__::225::IOProcess::(_processLogs) (542847) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:30,880::__init__::225::IOProcess::(_processLogs) DEBUG|(542847) Building response >Thread-19::DEBUG::2014-08-11 17:43:30,880::__init__::225::IOProcess::(_processLogs) (542847) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:30,881::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) (542848) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) (542848) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) (542848) Building response >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) (542848) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:30,882::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) (542849) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) (542849) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) (542849) Building response >Thread-19::DEBUG::2014-08-11 17:43:30,883::__init__::225::IOProcess::(_processLogs) (542849) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:30,884::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) (542850) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) (542850) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) (542850) Building response >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) (542850) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:30,885::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:31,928::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:31,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:31,932::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:32,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:32,131::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.060675 s, 16.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:43:33,616::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:43:34,206::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:34,282::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0174825 s, 58.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:35,487::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:35,487::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:35,487::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:35,488::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:35,488::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:35,488::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:35,488::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:35,488::__init__::225::IOProcess::(_processLogs) (542851) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:35,488::__init__::225::IOProcess::(_processLogs) (542851) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:35,489::__init__::225::IOProcess::(_processLogs) DEBUG|(542851) Building response >Thread-19::DEBUG::2014-08-11 17:43:35,489::__init__::225::IOProcess::(_processLogs) (542851) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:35,489::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:43:35,489::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:35,490::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:43:35,553::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0014723 s, 249 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) (542852) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:35,554::__init__::225::IOProcess::(_processLogs) (542852) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:35,555::__init__::225::IOProcess::(_processLogs) DEBUG|(542852) Building response >Thread-19::DEBUG::2014-08-11 17:43:35,555::__init__::225::IOProcess::(_processLogs) (542852) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:35,556::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:35,556::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:43:36,291::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:36,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709018 s, 14.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:36,939::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:36,939::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:36,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:38,430::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:38,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401244 s, 25.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:43:40,132::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:43:40,306::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:40,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`df779e3b-6c53-454b-8e45-3409c758add4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:40,307::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:43:40,365::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:40,366::task::1191::Storage.TaskManager.Task::(prepare) Task=`df779e3b-6c53-454b-8e45-3409c758add4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:40,366::task::595::Storage.TaskManager.Task::(_updateState) Task=`df779e3b-6c53-454b-8e45-3409c758add4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:40,366::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:40,366::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:40,366::task::993::Storage.TaskManager.Task::(_decref) Task=`df779e3b-6c53-454b-8e45-3409c758add4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:43:40,376::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:43:40,376::task::595::Storage.TaskManager.Task::(_updateState) Task=`fddc1d72-3ddb-48b7-ac4a-9d8476458940`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:43:40,376::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:43:40,376::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`412caaaf-20e0-4b2d-aff4-f43680f5bf52`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:43:40,376::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:43:40,377::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:43:40,377::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`412caaaf-20e0-4b2d-aff4-f43680f5bf52`::Granted request >Thread-10197::DEBUG::2014-08-11 17:43:40,377::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fddc1d72-3ddb-48b7-ac4a-9d8476458940`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:43:40,377::task::993::Storage.TaskManager.Task::(_decref) Task=`fddc1d72-3ddb-48b7-ac4a-9d8476458940`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:43:40,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:40,394::task::1191::Storage.TaskManager.Task::(prepare) Task=`fddc1d72-3ddb-48b7-ac4a-9d8476458940`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:40,394::task::595::Storage.TaskManager.Task::(_updateState) Task=`fddc1d72-3ddb-48b7-ac4a-9d8476458940`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:43:40,394::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:43:40,394::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:43:40,394::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:43:40,394::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:43:40,394::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:43:40,394::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:43:40,394::task::993::Storage.TaskManager.Task::(_decref) Task=`fddc1d72-3ddb-48b7-ac4a-9d8476458940`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:43:40,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:40,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351386 s, 29.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:40,885::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) (542853) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) (542853) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:40,886::__init__::225::IOProcess::(_processLogs) DEBUG|(542853) Building response >Thread-19::DEBUG::2014-08-11 17:43:40,887::__init__::225::IOProcess::(_processLogs) (542853) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:40,887::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:40,887::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:43:40,887::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:43:40,955::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00047929 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:40,956::__init__::225::IOProcess::(_processLogs) (542854) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:40,957::__init__::225::IOProcess::(_processLogs) (542854) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:40,957::__init__::225::IOProcess::(_processLogs) DEBUG|(542854) Building response >Thread-19::DEBUG::2014-08-11 17:43:40,957::__init__::225::IOProcess::(_processLogs) (542854) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:40,957::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:40,957::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:40,958::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) (542855) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) (542855) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) (542855) Building response >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) (542855) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:40,959::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) (542856) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) (542856) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) (542856) Building response >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) (542856) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:40,960::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:40,961::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:40,961::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:43:40,961::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:40,961::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:40,961::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) (542857) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) (542857) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) (542857) Building response >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) (542857) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:40,962::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:41,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:41,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:41,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:42,640::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:42,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0505971 s, 20.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:44,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`bed2fe6a-3d17-4e5e-968c-7ec47dc5b6f1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:44,290::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:43:44,290::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014723', 'lastCheck': '8.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047929', 'lastCheck': '3.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:44,290::task::1191::Storage.TaskManager.Task::(prepare) Task=`bed2fe6a-3d17-4e5e-968c-7ec47dc5b6f1`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014723', 'lastCheck': '8.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00047929', 'lastCheck': '3.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:44,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`bed2fe6a-3d17-4e5e-968c-7ec47dc5b6f1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:44,290::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:44,290::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:44,290::task::993::Storage.TaskManager.Task::(_decref) Task=`bed2fe6a-3d17-4e5e-968c-7ec47dc5b6f1`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:44,311::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:44,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:44,851::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0332692 s, 30.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:45,556::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:45,556::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:45,556::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:45,556::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:45,556::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:45,557::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:45,557::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:45,557::__init__::225::IOProcess::(_processLogs) (542858) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:45,557::__init__::225::IOProcess::(_processLogs) (542858) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:45,557::__init__::225::IOProcess::(_processLogs) DEBUG|(542858) Building response >Thread-19::DEBUG::2014-08-11 17:43:45,557::__init__::225::IOProcess::(_processLogs) (542858) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:45,558::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:45,558::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:43:45,558::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:43:45,658::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0217722 s, 16.8 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:45,658::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) (542859) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:45,659::__init__::225::IOProcess::(_processLogs) (542859) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:45,662::__init__::225::IOProcess::(_processLogs) DEBUG|(542859) Building response >Thread-19::DEBUG::2014-08-11 17:43:45,662::__init__::225::IOProcess::(_processLogs) (542859) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:45,662::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:45,663::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:43:46,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:46,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:46,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:46,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:46,968::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500065 s, 20.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:43:48,975::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:49,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0249765 s, 41.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:43:50,449::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:43:50,449::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea501e7d-a0c6-4102-b6d8-2880b058815d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:50,449::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:43:50,472::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:50,472::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea501e7d-a0c6-4102-b6d8-2880b058815d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:43:50,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea501e7d-a0c6-4102-b6d8-2880b058815d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:50,472::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:50,472::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:50,472::task::993::Storage.TaskManager.Task::(_decref) Task=`ea501e7d-a0c6-4102-b6d8-2880b058815d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:43:50,484::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:43:50,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c0c0750-5858-4f7c-aa57-05efc657cc36`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:43:50,484::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:43:50,485::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e565b276-13bf-4cdd-aa0d-7af1123ea2d7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:43:50,485::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:43:50,485::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:43:50,485::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e565b276-13bf-4cdd-aa0d-7af1123ea2d7`::Granted request >Thread-10197::DEBUG::2014-08-11 17:43:50,485::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7c0c0750-5858-4f7c-aa57-05efc657cc36`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:43:50,485::task::993::Storage.TaskManager.Task::(_decref) Task=`7c0c0750-5858-4f7c-aa57-05efc657cc36`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:43:50,502::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:50,502::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c0c0750-5858-4f7c-aa57-05efc657cc36`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:43:50,502::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c0c0750-5858-4f7c-aa57-05efc657cc36`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:43:50,502::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:43:50,502::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:43:50,502::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:43:50,502::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:43:50,503::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:43:50,503::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:43:50,503::task::993::Storage.TaskManager.Task::(_decref) Task=`7c0c0750-5858-4f7c-aa57-05efc657cc36`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:50,962::__init__::225::IOProcess::(_processLogs) (542860) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:50,963::__init__::225::IOProcess::(_processLogs) (542860) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:50,963::__init__::225::IOProcess::(_processLogs) DEBUG|(542860) Building response >Thread-19::DEBUG::2014-08-11 17:43:50,963::__init__::225::IOProcess::(_processLogs) (542860) Queuing response >Thread-28::DEBUG::2014-08-11 17:43:50,963::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:43:50,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:51,022::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:43:51,024::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00123594 s, 401 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) (542861) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:51,025::__init__::225::IOProcess::(_processLogs) (542861) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:51,026::__init__::225::IOProcess::(_processLogs) DEBUG|(542861) Building response >Thread-19::DEBUG::2014-08-11 17:43:51,026::__init__::225::IOProcess::(_processLogs) (542861) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:51,026::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:51,026::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) (542862) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:51,027::__init__::225::IOProcess::(_processLogs) (542862) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) (542862) Building response >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) (542862) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:43:51,028::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) (542863) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) (542863) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) (542863) Building response >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) (542863) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:43:51,029::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) (542864) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) (542864) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) DEBUG|(542864) Building response >Thread-19::DEBUG::2014-08-11 17:43:51,030::__init__::225::IOProcess::(_processLogs) (542864) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:51,031::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:51,031::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:43:51,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:51,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0484913 s, 21.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:51,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:51,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:51,960::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:53,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:53,278::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348967 s, 29.3 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:43:55,140::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:43:55,286::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:55,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0197809 s, 51.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) (542865) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:55,664::__init__::225::IOProcess::(_processLogs) (542865) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:55,665::__init__::225::IOProcess::(_processLogs) (542865) Building response >Thread-19::DEBUG::2014-08-11 17:43:55,665::__init__::225::IOProcess::(_processLogs) (542865) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:55,665::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:43:55,665::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:43:55,665::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:43:55,726::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00108284 s, 338 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:43:55,726::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:43:55,726::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:43:55,726::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) (542866) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) (542866) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:43:55,727::__init__::225::IOProcess::(_processLogs) DEBUG|(542866) Building response >Thread-19::DEBUG::2014-08-11 17:43:55,728::__init__::225::IOProcess::(_processLogs) (542866) Queuing response >Thread-19::DEBUG::2014-08-11 17:43:55,728::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:43:55,728::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:56,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:56,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:43:56,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:57,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:43:57,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0475997 s, 21.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:43:59,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:43:59,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`e19b868e-0267-4a9f-934e-1baca6a591b8`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:43:59,550::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:43:59,550::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108284', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123594', 'lastCheck': '8.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:59,550::task::1191::Storage.TaskManager.Task::(prepare) Task=`e19b868e-0267-4a9f-934e-1baca6a591b8`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108284', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00123594', 'lastCheck': '8.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:43:59,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`e19b868e-0267-4a9f-934e-1baca6a591b8`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:43:59,550::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:43:59,550::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:43:59,550::task::993::Storage.TaskManager.Task::(_decref) Task=`e19b868e-0267-4a9f-934e-1baca6a591b8`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:43:59,569::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:43:59,616::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0652757 s, 15.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:00,587::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:44:00,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e9c04a3-7232-4a02-b9c8-3a3f9d940ea1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:00,587::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:44:00,615::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:00,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`2e9c04a3-7232-4a02-b9c8-3a3f9d940ea1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:00,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`2e9c04a3-7232-4a02-b9c8-3a3f9d940ea1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:00,616::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:00,616::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:00,616::task::993::Storage.TaskManager.Task::(_decref) Task=`2e9c04a3-7232-4a02-b9c8-3a3f9d940ea1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:44:00,628::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:44:00,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`90471daa-8671-447d-8490-406e35d03862`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:44:00,628::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:44:00,628::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2e988a45-f44b-4c84-82f1-2772202d8d67`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:44:00,628::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:44:00,629::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:44:00,629::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2e988a45-f44b-4c84-82f1-2772202d8d67`::Granted request >Thread-10197::DEBUG::2014-08-11 17:44:00,629::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`90471daa-8671-447d-8490-406e35d03862`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:44:00,629::task::993::Storage.TaskManager.Task::(_decref) Task=`90471daa-8671-447d-8490-406e35d03862`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:44:00,645::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:00,645::task::1191::Storage.TaskManager.Task::(prepare) Task=`90471daa-8671-447d-8490-406e35d03862`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:00,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`90471daa-8671-447d-8490-406e35d03862`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:44:00,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:44:00,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:44:00,646::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:44:00,646::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:44:00,646::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:44:00,646::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:44:00,646::task::993::Storage.TaskManager.Task::(_decref) Task=`90471daa-8671-447d-8490-406e35d03862`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:44:01,031::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:01,031::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) (542867) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:01,032::__init__::225::IOProcess::(_processLogs) (542867) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:01,033::__init__::225::IOProcess::(_processLogs) DEBUG|(542867) Building response >Thread-19::DEBUG::2014-08-11 17:44:01,033::__init__::225::IOProcess::(_processLogs) (542867) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:01,033::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:44:01,034::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:44:01,034::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:44:01,096::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00117242 s, 422 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:01,096::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:01,096::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:01,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:01,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:01,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:01,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:01,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:01,097::__init__::225::IOProcess::(_processLogs) (542868) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:01,097::__init__::225::IOProcess::(_processLogs) (542868) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:01,097::__init__::225::IOProcess::(_processLogs) DEBUG|(542868) Building response >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) (542868) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:01,098::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) (542869) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) (542869) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) (542869) Building response >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) (542869) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:01,099::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:01,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) (542870) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) (542870) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) (542870) Building response >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) (542870) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:01,101::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:01,102::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:01,102::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:01,102::__init__::225::IOProcess::(_processLogs) (542871) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:01,102::__init__::225::IOProcess::(_processLogs) (542871) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:01,102::__init__::225::IOProcess::(_processLogs) (542871) Building response >Thread-19::DEBUG::2014-08-11 17:44:01,103::__init__::225::IOProcess::(_processLogs) (542871) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:01,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:01,103::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:44:01,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:01,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0546804 s, 18.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:01,973::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:01,975::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:01,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:44:03,683::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:44:03,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:03,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0487058 s, 21.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) (542872) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:05,729::__init__::225::IOProcess::(_processLogs) (542872) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:05,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542872) Building response >Thread-19::DEBUG::2014-08-11 17:44:05,731::__init__::225::IOProcess::(_processLogs) (542872) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:05,731::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:05,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:44:05,732::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:44:05,792::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000850648 s, 430 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) (542873) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) (542873) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:05,793::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542873) Building response >Thread-19::DEBUG::2014-08-11 17:44:05,794::__init__::225::IOProcess::(_processLogs) (542873) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:05,794::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:05,794::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:44:05,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:05,993::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0184711 s, 55.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:06,983::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:06,984::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:06,984::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:08,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:08,073::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130286 s, 78.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:10,081::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:44:10,147::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:44:10,177::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.038172 s, 26.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:10,680::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:44:10,680::task::595::Storage.TaskManager.Task::(_updateState) Task=`11603337-e598-4755-bfc1-d2775b14d791`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:10,680::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:44:10,731::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:10,731::task::1191::Storage.TaskManager.Task::(prepare) Task=`11603337-e598-4755-bfc1-d2775b14d791`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:10,731::task::595::Storage.TaskManager.Task::(_updateState) Task=`11603337-e598-4755-bfc1-d2775b14d791`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:10,732::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:10,732::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:10,732::task::993::Storage.TaskManager.Task::(_decref) Task=`11603337-e598-4755-bfc1-d2775b14d791`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:44:10,738::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:44:10,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`80802711-f2e8-4f60-ad69-152f9cd6221f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:44:10,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:44:10,739::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`af82cf3d-072e-4402-ba62-48b9b47b77b6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:44:10,739::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:44:10,739::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:44:10,739::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`af82cf3d-072e-4402-ba62-48b9b47b77b6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:44:10,739::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`80802711-f2e8-4f60-ad69-152f9cd6221f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:44:10,739::task::993::Storage.TaskManager.Task::(_decref) Task=`80802711-f2e8-4f60-ad69-152f9cd6221f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:44:10,772::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:10,772::task::1191::Storage.TaskManager.Task::(prepare) Task=`80802711-f2e8-4f60-ad69-152f9cd6221f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:10,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`80802711-f2e8-4f60-ad69-152f9cd6221f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:44:10,772::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:44:10,772::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:44:10,772::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:44:10,772::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:44:10,772::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:44:10,772::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:44:10,773::task::993::Storage.TaskManager.Task::(_decref) Task=`80802711-f2e8-4f60-ad69-152f9cd6221f`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) (542874) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:11,103::__init__::225::IOProcess::(_processLogs) (542874) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:11,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542874) Building response >Thread-19::DEBUG::2014-08-11 17:44:11,104::__init__::225::IOProcess::(_processLogs) (542874) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:11,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:11,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:44:11,105::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:44:11,165::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00180981 s, 274 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) (542875) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:11,166::__init__::225::IOProcess::(_processLogs) (542875) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:11,167::__init__::225::IOProcess::(_processLogs) DEBUG|(542875) Building response >Thread-19::DEBUG::2014-08-11 17:44:11,167::__init__::225::IOProcess::(_processLogs) (542875) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:11,167::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:11,167::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) (542876) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:11,168::__init__::225::IOProcess::(_processLogs) (542876) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) (542876) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:11,169::__init__::225::IOProcess::(_processLogs) (542877) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:11,170::__init__::225::IOProcess::(_processLogs) (542877) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:11,170::__init__::225::IOProcess::(_processLogs) (542877) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:11,170::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:11,170::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:11,171::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:44:11,171::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:11,171::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:11,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:11,171::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:11,171::__init__::225::IOProcess::(_processLogs) (542878) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:11,172::__init__::225::IOProcess::(_processLogs) (542878) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:11,172::__init__::225::IOProcess::(_processLogs) (542878) Building response >Thread-19::DEBUG::2014-08-11 17:44:11,172::__init__::225::IOProcess::(_processLogs) (542878) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:11,172::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:11,172::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:11,990::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:11,990::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:11,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:12,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:12,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0432893 s, 23.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:14,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:14,407::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0526365 s, 19.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:14,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba6a62bc-2426-4158-94f4-e3d3777e7d1f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:14,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:44:14,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000850648', 'lastCheck': '9.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00180981', 'lastCheck': '3.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:44:14,771::task::1191::Storage.TaskManager.Task::(prepare) Task=`ba6a62bc-2426-4158-94f4-e3d3777e7d1f`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000850648', 'lastCheck': '9.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00180981', 'lastCheck': '3.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:44:14,771::task::595::Storage.TaskManager.Task::(_updateState) Task=`ba6a62bc-2426-4158-94f4-e3d3777e7d1f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:14,771::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:14,771::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:14,771::task::993::Storage.TaskManager.Task::(_decref) Task=`ba6a62bc-2426-4158-94f4-e3d3777e7d1f`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:44:14,784::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) (542879) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:15,795::__init__::225::IOProcess::(_processLogs) (542879) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:15,800::__init__::225::IOProcess::(_processLogs) (542879) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:15,800::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:44:15,800::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:44:15,862::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00247464 s, 148 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) (542880) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:15,863::__init__::225::IOProcess::(_processLogs) (542880) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:15,864::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542880) Building response >Thread-19::DEBUG::2014-08-11 17:44:15,864::__init__::225::IOProcess::(_processLogs) (542880) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:15,864::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:44:15,865::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:44:16,415::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:16,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0380722 s, 26.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:16,996::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:16,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:16,997::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:18,520::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:18,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385516 s, 26.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:20,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:20,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0822805 s, 12.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:20,826::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:44:20,826::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c5ecb2d-ba9d-4007-bd46-e7eedd28c3ca`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:20,826::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:44:20,840::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:20,840::task::1191::Storage.TaskManager.Task::(prepare) Task=`6c5ecb2d-ba9d-4007-bd46-e7eedd28c3ca`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:20,840::task::595::Storage.TaskManager.Task::(_updateState) Task=`6c5ecb2d-ba9d-4007-bd46-e7eedd28c3ca`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:20,840::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:20,841::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:20,841::task::993::Storage.TaskManager.Task::(_decref) Task=`6c5ecb2d-ba9d-4007-bd46-e7eedd28c3ca`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:44:20,847::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:44:20,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e03c2bb-114a-4b66-a6d5-f36f153b4d1e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:44:20,848::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:44:20,848::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`26979616-b473-4390-a57b-2e3dbbcf63d6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:44:20,848::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:44:20,848::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:44:20,848::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`26979616-b473-4390-a57b-2e3dbbcf63d6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:44:20,848::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3e03c2bb-114a-4b66-a6d5-f36f153b4d1e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:44:20,848::task::993::Storage.TaskManager.Task::(_decref) Task=`3e03c2bb-114a-4b66-a6d5-f36f153b4d1e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:44:20,865::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:20,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e03c2bb-114a-4b66-a6d5-f36f153b4d1e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:20,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e03c2bb-114a-4b66-a6d5-f36f153b4d1e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:44:20,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:44:20,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:44:20,866::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:44:20,866::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:44:20,866::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:44:20,866::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:44:20,866::task::993::Storage.TaskManager.Task::(_decref) Task=`3e03c2bb-114a-4b66-a6d5-f36f153b4d1e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:44:21,172::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:21,172::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:21,172::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:21,172::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:21,172::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:21,173::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:21,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:21,173::__init__::225::IOProcess::(_processLogs) (542881) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:21,173::__init__::225::IOProcess::(_processLogs) (542881) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:21,173::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542881) Building response >Thread-19::DEBUG::2014-08-11 17:44:21,173::__init__::225::IOProcess::(_processLogs) (542881) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:21,174::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:44:21,174::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:44:21,174::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:44:21,235::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000900776 s, 550 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:21,236::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:21,237::__init__::225::IOProcess::(_processLogs) (542882) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:21,237::__init__::225::IOProcess::(_processLogs) (542882) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:21,237::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542882) Building response >Thread-19::DEBUG::2014-08-11 17:44:21,237::__init__::225::IOProcess::(_processLogs) (542882) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:21,238::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) (542883) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) (542883) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) (542883) Building response >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) (542883) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:21,239::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) (542884) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) (542884) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) (542884) Building response >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) (542884) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:21,240::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) (542885) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) (542885) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:21,241::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542885) Building response >Thread-19::DEBUG::2014-08-11 17:44:21,242::__init__::225::IOProcess::(_processLogs) (542885) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:21,242::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:44:21,242::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:22,003::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:22,003::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:22,004::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:22,775::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:22,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0697596 s, 14.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:24,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:25,025::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0552984 s, 18.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:44:25,165::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f9dd0a4-1815-4818-b551-72caa6c902b8`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:44:25,165::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:44:25,165::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:25,165::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) (542886) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:44:25,166::__init__::225::IOProcess::(_processLogs) (542886) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:44:25,169::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(542886) Building response >Thread-19::DEBUG::2014-08-11 17:44:25,169::__init__::225::IOProcess::(_processLogs) (542886) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:25,169::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:25,169::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:44:25,170::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:25,170::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:44:25,170::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Marshaling message... >Thread-10017::INFO::2014-08-11 17:44:25,170::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:44:25,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10017::DEBUG::2014-08-11 17:44:25,171::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f9dd0a4-1815-4818-b551-72caa6c902b8`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:44:25,171::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:44:25,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f9dd0a4-1815-4818-b551-72caa6c902b8`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:44:25,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:44:25,172::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:44:25,172::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:44:25,172::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:44:25,173::task::993::Storage.TaskManager.Task::(_decref) Task=`0f9dd0a4-1815-4818-b551-72caa6c902b8`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:44:25,173::__init__::225::IOProcess::(_processLogs) (542887) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:44:25,173::__init__::225::IOProcess::(_processLogs) (542887) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:44:25,173::__init__::225::IOProcess::(_processLogs) (542887) Building response >Thread-19::DEBUG::2014-08-11 17:44:25,173::__init__::225::IOProcess::(_processLogs) (542887) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:25,174::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:25,174::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:44:25,194::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:44:25,865::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:25,865::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) (542888) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:25,866::__init__::225::IOProcess::(_processLogs) (542888) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:25,867::__init__::225::IOProcess::(_processLogs) DEBUG|(542888) Building response >Thread-19::DEBUG::2014-08-11 17:44:25,867::__init__::225::IOProcess::(_processLogs) (542888) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:25,867::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:25,867::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:44:25,868::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:44:25,928::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000896164 s, 408 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:25,929::__init__::225::IOProcess::(_processLogs) (542889) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:25,930::__init__::225::IOProcess::(_processLogs) (542889) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:25,930::__init__::225::IOProcess::(_processLogs) DEBUG|(542889) Building response >Thread-19::DEBUG::2014-08-11 17:44:25,930::__init__::225::IOProcess::(_processLogs) (542889) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:25,931::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:25,931::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:27,009::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:27,010::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:27,010::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:27,033::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:27,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300457 s, 34.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:29,130::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:29,234::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045061 s, 22.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:29,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d7c9ebe-cf20-4740-b3e4-9ec6fb98ad75`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:29,950::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:44:29,950::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000896164', 'lastCheck': '4.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900776', 'lastCheck': '8.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:44:29,950::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d7c9ebe-cf20-4740-b3e4-9ec6fb98ad75`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000896164', 'lastCheck': '4.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900776', 'lastCheck': '8.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:44:29,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d7c9ebe-cf20-4740-b3e4-9ec6fb98ad75`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:29,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:29,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:29,950::task::993::Storage.TaskManager.Task::(_decref) Task=`3d7c9ebe-cf20-4740-b3e4-9ec6fb98ad75`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:44:29,969::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:44:30,899::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:44:30,899::task::595::Storage.TaskManager.Task::(_updateState) Task=`c930d272-f9ca-48f3-8f77-4b1bee30b62e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:30,900::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:44:30,924::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:30,924::task::1191::Storage.TaskManager.Task::(prepare) Task=`c930d272-f9ca-48f3-8f77-4b1bee30b62e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:30,924::task::595::Storage.TaskManager.Task::(_updateState) Task=`c930d272-f9ca-48f3-8f77-4b1bee30b62e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:30,924::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:30,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:30,924::task::993::Storage.TaskManager.Task::(_decref) Task=`c930d272-f9ca-48f3-8f77-4b1bee30b62e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:44:30,936::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:44:30,936::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f40485-0ddb-4b69-8a03-c021a690dc08`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:44:30,936::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:44:30,937::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f4a796cd-7722-4c37-9700-b2cc698b533a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:44:30,937::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:44:30,938::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:44:30,938::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f4a796cd-7722-4c37-9700-b2cc698b533a`::Granted request >Thread-10197::DEBUG::2014-08-11 17:44:30,938::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f4f40485-0ddb-4b69-8a03-c021a690dc08`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:44:30,938::task::993::Storage.TaskManager.Task::(_decref) Task=`f4f40485-0ddb-4b69-8a03-c021a690dc08`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:44:30,954::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:30,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4f40485-0ddb-4b69-8a03-c021a690dc08`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:30,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4f40485-0ddb-4b69-8a03-c021a690dc08`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:44:30,954::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:44:30,954::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:44:30,955::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:44:30,955::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:44:30,955::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:44:30,955::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:44:30,955::task::993::Storage.TaskManager.Task::(_decref) Task=`f4f40485-0ddb-4b69-8a03-c021a690dc08`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:44:31,241::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:44:31,300::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:31,300::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:31,300::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:31,300::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:31,300::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:31,301::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:31,301::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:31,301::__init__::225::IOProcess::(_processLogs) (542890) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:31,301::__init__::225::IOProcess::(_processLogs) (542890) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:31,301::__init__::225::IOProcess::(_processLogs) DEBUG|(542890) Building response >Thread-19::DEBUG::2014-08-11 17:44:31,302::__init__::225::IOProcess::(_processLogs) (542890) Queuing response >Thread-28::DEBUG::2014-08-11 17:44:31,302::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:44:31,302::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:31,361::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:44:31,362::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000381341 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:31,363::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:31,364::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:31,364::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:31,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:31,366::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:31,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:31,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:31,368::__init__::225::IOProcess::(_processLogs) (542891) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:31,368::__init__::225::IOProcess::(_processLogs) (542891) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:31,369::__init__::225::IOProcess::(_processLogs) (542891) Building response >Thread-19::DEBUG::2014-08-11 17:44:31,370::__init__::225::IOProcess::(_processLogs) (542891) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:31,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:31,371::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:44:31,371::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0701646 s, 14.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:31,372::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:31,372::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:44:31,373::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:31,373::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:31,374::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:31,374::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:31,375::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:31,375::__init__::225::IOProcess::(_processLogs) (542892) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:31,376::__init__::225::IOProcess::(_processLogs) (542892) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:31,376::__init__::225::IOProcess::(_processLogs) (542892) Building response >Thread-19::DEBUG::2014-08-11 17:44:31,377::__init__::225::IOProcess::(_processLogs) (542892) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:31,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:31,378::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:31,379::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:31,379::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:44:31,380::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:31,380::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:31,381::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:31,382::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:31,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:31,383::__init__::225::IOProcess::(_processLogs) (542893) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:31,383::__init__::225::IOProcess::(_processLogs) (542893) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:31,384::__init__::225::IOProcess::(_processLogs) (542893) Building response >Thread-19::DEBUG::2014-08-11 17:44:31,384::__init__::225::IOProcess::(_processLogs) (542893) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:31,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:31,385::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:31,386::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:31,386::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:44:31,387::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:31,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:31,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:31,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:31,389::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:31,390::__init__::225::IOProcess::(_processLogs) (542894) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:31,390::__init__::225::IOProcess::(_processLogs) (542894) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:31,391::__init__::225::IOProcess::(_processLogs) (542894) Building response >Thread-19::DEBUG::2014-08-11 17:44:31,391::__init__::225::IOProcess::(_processLogs) (542894) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:31,392::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:31,392::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:32,017::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:32,020::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:32,024::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:33,399::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:33,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0276638 s, 37.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:44:33,711::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:44:35,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:35,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0715884 s, 14.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:35,931::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:35,931::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) (542895) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:35,932::__init__::225::IOProcess::(_processLogs) (542895) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:35,933::__init__::225::IOProcess::(_processLogs) DEBUG|(542895) Building response >Thread-19::DEBUG::2014-08-11 17:44:35,933::__init__::225::IOProcess::(_processLogs) (542895) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:35,933::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:35,933::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:44:35,934::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:44:35,994::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00105725 s, 346 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:35,995::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:35,995::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:35,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:35,995::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:35,995::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:35,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) (542896) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) (542896) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) DEBUG|(542896) Building response >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) (542896) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:35,996::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:37,031::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:37,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:37,032::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:37,634::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:37,746::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0535005 s, 19.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:39,754::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:39,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411592 s, 24.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:44:40,201::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:44:40,988::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:44:40,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d6e08af-4149-4688-a57f-e984c87c3281`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:40,989::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:44:41,088::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:41,088::task::1191::Storage.TaskManager.Task::(prepare) Task=`1d6e08af-4149-4688-a57f-e984c87c3281`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:41,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`1d6e08af-4149-4688-a57f-e984c87c3281`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:41,088::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:41,088::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:41,088::task::993::Storage.TaskManager.Task::(_decref) Task=`1d6e08af-4149-4688-a57f-e984c87c3281`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:44:41,098::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:44:41,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e195784-7de0-4f2c-b8ff-403064591d97`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:44:41,098::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:44:41,098::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`56f7ee33-d7ce-4748-9eb0-ab446787b7cc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:44:41,098::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:44:41,098::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:44:41,099::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`56f7ee33-d7ce-4748-9eb0-ab446787b7cc`::Granted request >Thread-10197::DEBUG::2014-08-11 17:44:41,099::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9e195784-7de0-4f2c-b8ff-403064591d97`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:44:41,099::task::993::Storage.TaskManager.Task::(_decref) Task=`9e195784-7de0-4f2c-b8ff-403064591d97`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:44:41,115::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:41,115::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e195784-7de0-4f2c-b8ff-403064591d97`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:41,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e195784-7de0-4f2c-b8ff-403064591d97`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:44:41,116::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:44:41,116::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:44:41,116::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:44:41,116::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:44:41,116::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:44:41,116::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:44:41,116::task::993::Storage.TaskManager.Task::(_decref) Task=`9e195784-7de0-4f2c-b8ff-403064591d97`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:44:41,390::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:41,390::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:41,390::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) (542897) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) (542897) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) DEBUG|(542897) Building response >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) (542897) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:41,391::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:44:41,392::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:44:41,392::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:44:41,453::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00150001 s, 330 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:41,454::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:41,454::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:41,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:41,454::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:41,454::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:41,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:41,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:41,455::__init__::225::IOProcess::(_processLogs) (542898) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:41,455::__init__::225::IOProcess::(_processLogs) (542898) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:41,455::__init__::225::IOProcess::(_processLogs) DEBUG|(542898) Building response >Thread-19::DEBUG::2014-08-11 17:44:41,455::__init__::225::IOProcess::(_processLogs) (542898) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:41,456::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:44:41,456::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:44:41,456::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:41,456::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:44:41,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) (542899) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) (542899) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) (542899) Building response >Thread-19::DEBUG::2014-08-11 17:44:41,457::__init__::225::IOProcess::(_processLogs) (542899) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:41,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) (542900) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) (542900) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) (542900) Building response >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) (542900) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:41,459::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:44:41,460::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:41,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:41,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:41,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:41,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:41,460::__init__::225::IOProcess::(_processLogs) (542901) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:41,461::__init__::225::IOProcess::(_processLogs) (542901) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:41,461::__init__::225::IOProcess::(_processLogs) (542901) Building response >Thread-19::DEBUG::2014-08-11 17:44:41,461::__init__::225::IOProcess::(_processLogs) (542901) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:41,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:41,461::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:44:41,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:41,984::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437194 s, 23.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:42,038::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:42,038::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:42,039::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:43,992::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:44,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0431784 s, 23.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:45,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`897a07bd-27de-48df-bd6f-ff300eb35234`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:45,127::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:44:45,127::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105725', 'lastCheck': '9.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150001', 'lastCheck': '3.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:44:45,127::task::1191::Storage.TaskManager.Task::(prepare) Task=`897a07bd-27de-48df-bd6f-ff300eb35234`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00105725', 'lastCheck': '9.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00150001', 'lastCheck': '3.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:44:45,127::task::595::Storage.TaskManager.Task::(_updateState) Task=`897a07bd-27de-48df-bd6f-ff300eb35234`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:45,127::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:45,127::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:45,127::task::993::Storage.TaskManager.Task::(_decref) Task=`897a07bd-27de-48df-bd6f-ff300eb35234`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:44:45,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:44:45,997::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:45,997::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) (542902) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:45,998::__init__::225::IOProcess::(_processLogs) (542902) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:46,000::__init__::225::IOProcess::(_processLogs) DEBUG|(542902) Building response >Thread-19::DEBUG::2014-08-11 17:44:46,001::__init__::225::IOProcess::(_processLogs) (542902) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:46,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:46,001::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:44:46,001::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:44:46,062::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000734825 s, 498 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) (542903) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:46,063::__init__::225::IOProcess::(_processLogs) (542903) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:46,064::__init__::225::IOProcess::(_processLogs) DEBUG|(542903) Building response >Thread-19::DEBUG::2014-08-11 17:44:46,064::__init__::225::IOProcess::(_processLogs) (542903) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:46,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:46,065::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:44:46,102::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:46,200::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0395522 s, 25.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:47,044::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:47,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:47,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:48,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:48,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0508208 s, 20.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:50,327::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:50,419::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0219447 s, 46.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:44:51,272::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:44:51,273::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff6b0cf1-6307-4ff6-885c-d98b38efbeb5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:44:51,273::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Detector thread::DEBUG::2014-08-11 17:44:51,297::protocoldetector::160::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 10.35.1.234:43391 >Detector thread::DEBUG::2014-08-11 17:44:51,298::protocoldetector::171::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 10.35.1.234:43391 >Detector thread::DEBUG::2014-08-11 17:44:51,298::protocoldetector::197::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 10.35.1.234:43391 >Detector thread::DEBUG::2014-08-11 17:44:51,298::BindingXMLRPC::1167::XmlDetector::(handleSocket) xml over http detected from ('10.35.1.234', 43391) >Thread-10237::INFO::2014-08-11 17:44:51,311::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:51,311::task::1191::Storage.TaskManager.Task::(prepare) Task=`ff6b0cf1-6307-4ff6-885c-d98b38efbeb5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:44:51,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`ff6b0cf1-6307-4ff6-885c-d98b38efbeb5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:44:51,312::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:44:51,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:44:51,312::task::993::Storage.TaskManager.Task::(_decref) Task=`ff6b0cf1-6307-4ff6-885c-d98b38efbeb5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:44:51,318::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:44:51,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbeb74a8-63e5-4fe6-b310-338a8620d73e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:44:51,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:44:51,319::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d3e0605d-6008-46f4-a183-f49e3bbd5ff4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:44:51,319::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:44:51,319::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:44:51,319::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d3e0605d-6008-46f4-a183-f49e3bbd5ff4`::Granted request >Thread-10197::DEBUG::2014-08-11 17:44:51,319::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fbeb74a8-63e5-4fe6-b310-338a8620d73e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:44:51,319::task::993::Storage.TaskManager.Task::(_decref) Task=`fbeb74a8-63e5-4fe6-b310-338a8620d73e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:44:51,336::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:51,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`fbeb74a8-63e5-4fe6-b310-338a8620d73e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:44:51,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`fbeb74a8-63e5-4fe6-b310-338a8620d73e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:44:51,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:44:51,336::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:44:51,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:44:51,336::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:44:51,336::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:44:51,336::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:44:51,337::task::993::Storage.TaskManager.Task::(_decref) Task=`fbeb74a8-63e5-4fe6-b310-338a8620d73e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) (542904) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:51,461::__init__::225::IOProcess::(_processLogs) (542904) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:51,477::__init__::225::IOProcess::(_processLogs) (542904) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:51,477::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:44:51,477::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:44:51,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000410734 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) (542905) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:51,537::__init__::225::IOProcess::(_processLogs) (542905) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:51,539::__init__::225::IOProcess::(_processLogs) (542905) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:51,539::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:44:51,540::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:44:51,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:51,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:51,540::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) (542906) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) (542906) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) (542906) Building response >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) (542906) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:51,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) (542907) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) (542907) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) (542907) Building response >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) (542907) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:51,542::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:44:51,543::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:44:51,543::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:51,543::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:51,543::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) (542908) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) (542908) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) (542908) Building response >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) (542908) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:51,544::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:52,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:52,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:52,052::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:52,427::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:52,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012135 s, 84.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:44:54,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:54,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0496491 s, 20.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:44:55,209::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) (542909) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:56,065::__init__::225::IOProcess::(_processLogs) (542909) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:56,066::__init__::225::IOProcess::(_processLogs) (542909) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:56,067::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:44:56,067::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:44:56,126::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000399978 s, 915 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:44:56,127::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:44:56,127::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:44:56,127::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:44:56,127::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:44:56,127::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:44:56,127::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:44:56,128::__init__::225::IOProcess::(_processLogs) (542910) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:44:56,128::__init__::225::IOProcess::(_processLogs) (542910) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:44:56,128::__init__::225::IOProcess::(_processLogs) (542910) Queuing response >Thread-19::DEBUG::2014-08-11 17:44:56,128::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:44:56,129::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:44:56,623::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:56,728::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455246 s, 22.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:57,058::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:57,058::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:44:57,058::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:44:58,735::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:44:58,832::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0379005 s, 27.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:45:00,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e807ffb-8f54-477a-ad8f-28736a9848c2`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:00,337::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:45:00,337::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399978', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410734', 'lastCheck': '8.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:00,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e807ffb-8f54-477a-ad8f-28736a9848c2`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399978', 'lastCheck': '4.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410734', 'lastCheck': '8.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:00,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e807ffb-8f54-477a-ad8f-28736a9848c2`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:00,337::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:00,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:00,337::task::993::Storage.TaskManager.Task::(_decref) Task=`3e807ffb-8f54-477a-ad8f-28736a9848c2`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:45:00,383::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:00,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:00,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153665 s, 66.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:45:01,372::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:45:01,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`95d2ca0c-e242-4ca4-8c1a-bd9796738448`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:01,373::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:45:01,434::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:01,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`95d2ca0c-e242-4ca4-8c1a-bd9796738448`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:01,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`95d2ca0c-e242-4ca4-8c1a-bd9796738448`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:01,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:01,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:01,434::task::993::Storage.TaskManager.Task::(_decref) Task=`95d2ca0c-e242-4ca4-8c1a-bd9796738448`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:45:01,445::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:45:01,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`82599f3c-7316-4077-aac5-4414f7d67ae2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:45:01,446::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:45:01,446::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0a59adcb-b3a8-4b28-8d0c-7ca1f79ff2b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:45:01,446::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:45:01,446::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:45:01,446::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0a59adcb-b3a8-4b28-8d0c-7ca1f79ff2b9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:45:01,446::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`82599f3c-7316-4077-aac5-4414f7d67ae2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:45:01,447::task::993::Storage.TaskManager.Task::(_decref) Task=`82599f3c-7316-4077-aac5-4414f7d67ae2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:45:01,484::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:01,484::task::1191::Storage.TaskManager.Task::(prepare) Task=`82599f3c-7316-4077-aac5-4414f7d67ae2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:01,484::task::595::Storage.TaskManager.Task::(_updateState) Task=`82599f3c-7316-4077-aac5-4414f7d67ae2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:45:01,484::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:45:01,485::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:45:01,485::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:45:01,485::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:45:01,485::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:45:01,485::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:45:01,485::task::993::Storage.TaskManager.Task::(_decref) Task=`82599f3c-7316-4077-aac5-4414f7d67ae2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) (542911) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:01,544::__init__::225::IOProcess::(_processLogs) (542911) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:01,545::__init__::225::IOProcess::(_processLogs) (542911) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:01,545::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:45:01,545::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:45:01,611::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00257336 s, 192 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:01,611::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:01,611::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:01,612::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:01,612::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:01,612::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:01,612::__init__::225::IOProcess::(_processLogs) (542912) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:01,612::__init__::225::IOProcess::(_processLogs) (542912) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:01,613::__init__::225::IOProcess::(_processLogs) (542912) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:01,613::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:01,614::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:45:01,614::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:01,614::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:01,614::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:01,614::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:01,614::__init__::225::IOProcess::(_processLogs) (542913) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) (542913) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) (542913) Building response >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) (542913) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:01,615::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) (542914) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) (542914) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) (542914) Building response >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) (542914) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:45:01,616::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) Message size is 205DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) (542915) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) (542915) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:01,617::__init__::225::IOProcess::(_processLogs) (542915) Building response >Thread-19::DEBUG::2014-08-11 17:45:01,618::__init__::225::IOProcess::(_processLogs) (542915) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:01,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:01,618::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:02,065::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:02,067::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:02,069::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:02,925::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:02,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143817 s, 71.2 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:45:03,798::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:45:05,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:05,105::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0394696 s, 25.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:06,129::__init__::225::IOProcess::(_processLogs) Message size is 205DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) Message size is 205DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) (542916) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:06,130::__init__::225::IOProcess::(_processLogs) (542916) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:06,131::__init__::225::IOProcess::(_processLogs) Message size is 205DEBUG|(542916) Building response >Thread-19::DEBUG::2014-08-11 17:45:06,131::__init__::225::IOProcess::(_processLogs) (542916) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:06,131::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:06,131::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:45:06,132::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:45:06,191::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000399036 s, 917 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:06,191::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:45:06,192::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:06,192::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:06,192::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:06,192::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) (542917) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) (542917) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) (542917) Building response >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) (542917) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:06,193::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:07,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:07,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:07,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:07,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:07,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0929139 s, 11.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:09,273::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:09,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0455299 s, 22.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:45:10,216::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:45:11,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:11,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0212576 s, 48.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:45:11,558::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:45:11,558::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c33e8c1-8506-40f2-a391-1458fa8e9b57`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:11,558::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-19::DEBUG::2014-08-11 17:45:11,617::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) (542918) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:11,618::__init__::225::IOProcess::(_processLogs) (542918) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:11,634::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(542918) Building response >Thread-10237::INFO::2014-08-11 17:45:11,635::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-19::DEBUG::2014-08-11 17:45:11,635::__init__::225::IOProcess::(_processLogs) (542918) Queuing response >Thread-10237::DEBUG::2014-08-11 17:45:11,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`4c33e8c1-8506-40f2-a391-1458fa8e9b57`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:11,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`4c33e8c1-8506-40f2-a391-1458fa8e9b57`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:45:11,636::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-10237::DEBUG::2014-08-11 17:45:11,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-28::DEBUG::2014-08-11 17:45:11,637::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:45:11,637::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:45:11,637::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:11,696::task::993::Storage.TaskManager.Task::(_decref) Task=`4c33e8c1-8506-40f2-a391-1458fa8e9b57`::ref 0 aborting False >Thread-28::DEBUG::2014-08-11 17:45:11,697::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000412038 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) (542919) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:11,698::__init__::225::IOProcess::(_processLogs) (542919) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:11,699::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(542919) Building response >Thread-19::DEBUG::2014-08-11 17:45:11,699::__init__::225::IOProcess::(_processLogs) (542919) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:11,699::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:45:11,699::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) (542920) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:11,700::__init__::225::IOProcess::(_processLogs) (542920) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:11,701::__init__::225::IOProcess::(_processLogs) Sending response sized 247DEBUG|(542920) Building response >Thread-19::DEBUG::2014-08-11 17:45:11,701::__init__::225::IOProcess::(_processLogs) (542920) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:11,701::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:11,701::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:11,701::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:45:11,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) (542921) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) (542921) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:45:11,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:11,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:11,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:11,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:11,703::__init__::225::IOProcess::(_processLogs) (542922) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:11,703::__init__::225::IOProcess::(_processLogs) (542922) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:11,703::__init__::225::IOProcess::(_processLogs) (542922) Building response >Thread-19::DEBUG::2014-08-11 17:45:11,704::__init__::225::IOProcess::(_processLogs) (542922) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:11,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:11,704::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:45:11,708::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:45:11,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`27569efd-606b-42af-a24f-62ba69d8d1f1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:45:11,709::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:45:11,709::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`109c171d-59e2-4bfe-858b-3d0a044b1aa2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:45:11,709::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:45:11,709::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:45:11,710::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`109c171d-59e2-4bfe-858b-3d0a044b1aa2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:45:11,710::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`27569efd-606b-42af-a24f-62ba69d8d1f1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:45:11,710::task::993::Storage.TaskManager.Task::(_decref) Task=`27569efd-606b-42af-a24f-62ba69d8d1f1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:45:11,763::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:11,764::task::1191::Storage.TaskManager.Task::(prepare) Task=`27569efd-606b-42af-a24f-62ba69d8d1f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:11,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`27569efd-606b-42af-a24f-62ba69d8d1f1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:45:11,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:45:11,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:45:11,764::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:45:11,764::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:45:11,764::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:45:11,764::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:45:11,764::task::993::Storage.TaskManager.Task::(_decref) Task=`27569efd-606b-42af-a24f-62ba69d8d1f1`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:12,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:12,083::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:12,083::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:13,491::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:13,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0460469 s, 22.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:15,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:45:15,663::task::595::Storage.TaskManager.Task::(_updateState) Task=`02b80657-dfef-4018-b72e-8d8f402d22a5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:15,664::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:45:15,664::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399036', 'lastCheck': '9.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412038', 'lastCheck': '4.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:15,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`02b80657-dfef-4018-b72e-8d8f402d22a5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000399036', 'lastCheck': '9.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000412038', 'lastCheck': '4.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:15,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`02b80657-dfef-4018-b72e-8d8f402d22a5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:15,664::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:15,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:15,664::task::993::Storage.TaskManager.Task::(_decref) Task=`02b80657-dfef-4018-b72e-8d8f402d22a5`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:45:15,680::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:15,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0778914 s, 13.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:16,193::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:16,193::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) (542923) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) (542923) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) (542923) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:16,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:45:16,195::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:45:16,253::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000431473 s, 848 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) (542924) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:16,254::__init__::225::IOProcess::(_processLogs) (542924) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:16,255::__init__::225::IOProcess::(_processLogs) (542924) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:16,255::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:16,256::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:17,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:17,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:17,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:17,749::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:17,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132376 s, 77.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:19,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:19,943::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465468 s, 22.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) (542925) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:21,704::__init__::225::IOProcess::(_processLogs) (542925) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:21,705::__init__::225::IOProcess::(_processLogs) (542925) Queuing response >Thread-28::DEBUG::2014-08-11 17:45:21,705::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:45:21,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:21,764::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:45:21,766::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000788382 s, 628 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:21,766::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:21,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:21,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:21,767::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:21,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:21,767::__init__::225::IOProcess::(_processLogs) (542926) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:21,767::__init__::225::IOProcess::(_processLogs) (542926) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:21,767::__init__::225::IOProcess::(_processLogs) (542926) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) (542927) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) (542927) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:21,768::__init__::225::IOProcess::(_processLogs) (542927) Building response >Thread-19::DEBUG::2014-08-11 17:45:21,769::__init__::225::IOProcess::(_processLogs) (542927) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:21,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:21,769::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:45:21,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:21,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:21,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) (542928) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) (542928) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) (542928) Building response >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) (542928) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:21,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:21,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:21,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:21,771::__init__::225::IOProcess::(_processLogs) (542929) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:21,771::__init__::225::IOProcess::(_processLogs) (542929) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:21,771::__init__::225::IOProcess::(_processLogs) (542929) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:21,771::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:45:21,835::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:45:21,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`9064b808-36c8-4163-bcac-c2421e997a6c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:21,836::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:45:21,885::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:21,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`9064b808-36c8-4163-bcac-c2421e997a6c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:21,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`9064b808-36c8-4163-bcac-c2421e997a6c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:21,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:21,885::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:21,885::task::993::Storage.TaskManager.Task::(_decref) Task=`9064b808-36c8-4163-bcac-c2421e997a6c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:45:21,891::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:45:21,892::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce70937a-694f-42b2-a2e2-c9a0a1ba3c84`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:45:21,892::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:45:21,892::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f13a5913-1ec9-4a6c-8622-55bdb241fd78`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:45:21,892::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:45:21,892::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:45:21,892::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f13a5913-1ec9-4a6c-8622-55bdb241fd78`::Granted request >Thread-10197::DEBUG::2014-08-11 17:45:21,893::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ce70937a-694f-42b2-a2e2-c9a0a1ba3c84`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:45:21,893::task::993::Storage.TaskManager.Task::(_decref) Task=`ce70937a-694f-42b2-a2e2-c9a0a1ba3c84`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:45:21,910::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:21,910::task::1191::Storage.TaskManager.Task::(prepare) Task=`ce70937a-694f-42b2-a2e2-c9a0a1ba3c84`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:21,910::task::595::Storage.TaskManager.Task::(_updateState) Task=`ce70937a-694f-42b2-a2e2-c9a0a1ba3c84`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:45:21,910::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:45:21,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:45:21,911::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:45:21,911::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:45:21,911::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:45:21,911::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:45:21,911::task::993::Storage.TaskManager.Task::(_decref) Task=`ce70937a-694f-42b2-a2e2-c9a0a1ba3c84`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:45:21,951::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:22,053::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425125 s, 24.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:22,095::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:22,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:22,096::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:24,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:24,132::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122838 s, 83.4 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:45:25,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2347ba1-cc71-4a2f-841f-7efec7a71711`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:45:25,218::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:45:25,218::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:45:25,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:25,219::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:25,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:25,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:25,219::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:25,219::__init__::225::IOProcess::(_processLogs) (542930) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:45:25,219::__init__::225::IOProcess::(_processLogs) (542930) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:45:25,222::__init__::225::IOProcess::(_processLogs) (542930) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:25,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:25,222::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:45:25,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:25,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:45:25,223::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:45:25,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:45:25,224::task::1191::Storage.TaskManager.Task::(prepare) Task=`a2347ba1-cc71-4a2f-841f-7efec7a71711`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:45:25,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:45:25,224::task::595::Storage.TaskManager.Task::(_updateState) Task=`a2347ba1-cc71-4a2f-841f-7efec7a71711`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:45:25,224::__init__::225::IOProcess::(_processLogs) (542931) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:45:25,225::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:45:25,225::__init__::225::IOProcess::(_processLogs) (542931) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:45:25,225::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:45:25,225::__init__::225::IOProcess::(_processLogs) (542931) Building response >Thread-10017::DEBUG::2014-08-11 17:45:25,226::task::993::Storage.TaskManager.Task::(_decref) Task=`a2347ba1-cc71-4a2f-841f-7efec7a71711`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:45:25,226::__init__::225::IOProcess::(_processLogs) (542931) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:25,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:25,226::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:45:25,245::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:45:26,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) (542932) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:26,258::__init__::225::IOProcess::(_processLogs) (542932) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:26,259::__init__::225::IOProcess::(_processLogs) (542932) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:26,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:45:26,259::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:26,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0629912 s, 16.3 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:45:26,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000334569 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:26,322::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:26,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:26,323::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:26,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:26,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:26,325::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:26,325::__init__::225::IOProcess::(_processLogs) (542933) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:26,326::__init__::225::IOProcess::(_processLogs) (542933) Building response >Thread-19::DEBUG::2014-08-11 17:45:26,327::__init__::225::IOProcess::(_processLogs) (542933) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:26,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:26,328::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:27,102::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:27,102::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:27,103::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:28,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:28,474::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0794233 s, 12.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:30,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:30,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0404138 s, 25.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:45:30,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`0feb135a-eb1a-4ee0-83d0-27d2eafadf76`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:30,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:45:30,850::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334569', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788382', 'lastCheck': '9.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:30,850::task::1191::Storage.TaskManager.Task::(prepare) Task=`0feb135a-eb1a-4ee0-83d0-27d2eafadf76`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000334569', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000788382', 'lastCheck': '9.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:30,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`0feb135a-eb1a-4ee0-83d0-27d2eafadf76`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:30,850::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:30,850::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:30,850::task::993::Storage.TaskManager.Task::(_decref) Task=`0feb135a-eb1a-4ee0-83d0-27d2eafadf76`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:45:30,870::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:45:31,772::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:31,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:31,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:31,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:31,775::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-28::DEBUG::2014-08-11 17:45:31,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:45:31,776::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:31,835::__init__::225::IOProcess::(_processLogs) (542934) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:31,837::__init__::225::IOProcess::(_processLogs) (542934) Got request for method 'statvfs' >Thread-28::DEBUG::2014-08-11 17:45:31,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00125302 s, 395 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:31,838::__init__::225::IOProcess::(_processLogs) (542934) Building response >Thread-19::DEBUG::2014-08-11 17:45:31,839::__init__::225::IOProcess::(_processLogs) (542934) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:31,840::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:31,841::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:31,842::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:31,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:31,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:31,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:31,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:31,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:31,847::__init__::225::IOProcess::(_processLogs) (542935) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:31,848::__init__::225::IOProcess::(_processLogs) (542935) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:31,849::__init__::225::IOProcess::(_processLogs) (542935) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:31,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:31,851::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:31,852::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:45:31,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:31,854::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:31,854::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:31,855::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:31,856::__init__::225::IOProcess::(_processLogs) (542936) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:31,857::__init__::225::IOProcess::(_processLogs) (542936) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:31,858::__init__::225::IOProcess::(_processLogs) (542936) Building response >Thread-19::DEBUG::2014-08-11 17:45:31,859::__init__::225::IOProcess::(_processLogs) (542936) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:31,860::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:31,860::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:31,862::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:45:31,862::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:31,863::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:31,864::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:31,865::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:31,866::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:31,866::__init__::225::IOProcess::(_processLogs) (542937) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:31,867::__init__::225::IOProcess::(_processLogs) (542937) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:31,868::__init__::225::IOProcess::(_processLogs) (542937) Building response >Thread-19::DEBUG::2014-08-11 17:45:31,869::__init__::225::IOProcess::(_processLogs) (542937) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:31,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:31,870::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:31,872::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:45:31,872::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:31,873::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:31,874::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:31,875::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:31,876::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:31,876::__init__::225::IOProcess::(_processLogs) (542938) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:31,877::__init__::225::IOProcess::(_processLogs) (542938) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:31,878::__init__::225::IOProcess::(_processLogs) (542938) Building response >Thread-19::DEBUG::2014-08-11 17:45:31,879::__init__::225::IOProcess::(_processLogs) (542938) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:31,879::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:31,880::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:45:31,976::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:45:31,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcaea559-8229-4b0a-afba-c1b50cb8faab`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:31,978::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:45:32,027::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:32,028::task::1191::Storage.TaskManager.Task::(prepare) Task=`bcaea559-8229-4b0a-afba-c1b50cb8faab`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:32,028::task::595::Storage.TaskManager.Task::(_updateState) Task=`bcaea559-8229-4b0a-afba-c1b50cb8faab`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:32,028::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:32,029::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:32,029::task::993::Storage.TaskManager.Task::(_decref) Task=`bcaea559-8229-4b0a-afba-c1b50cb8faab`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:45:32,042::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:45:32,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`47d008fe-5ca1-45b0-95fd-96a08fb4f280`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:45:32,044::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:45:32,046::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bcc16f09-eb23-4075-a85c-cfd76f274c1e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:45:32,046::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:45:32,047::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:45:32,048::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`bcc16f09-eb23-4075-a85c-cfd76f274c1e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:45:32,050::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`47d008fe-5ca1-45b0-95fd-96a08fb4f280`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:45:32,050::task::993::Storage.TaskManager.Task::(_decref) Task=`47d008fe-5ca1-45b0-95fd-96a08fb4f280`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:45:32,081::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:32,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`47d008fe-5ca1-45b0-95fd-96a08fb4f280`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:32,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`47d008fe-5ca1-45b0-95fd-96a08fb4f280`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:45:32,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:45:32,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:45:32,084::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:45:32,084::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:45:32,085::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:45:32,085::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:45:32,086::task::993::Storage.TaskManager.Task::(_decref) Task=`47d008fe-5ca1-45b0-95fd-96a08fb4f280`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:32,109::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:32,111::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:32,113::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:32,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:32,689::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.039698 s, 25.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:45:33,837::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:45:34,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:34,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0423439 s, 24.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) (542939) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:36,328::__init__::225::IOProcess::(_processLogs) (542939) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:36,329::__init__::225::IOProcess::(_processLogs) (542939) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:36,329::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:45:36,329::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:45:36,393::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00144663 s, 253 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:36,393::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:36,393::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:36,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:36,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:36,394::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:36,394::__init__::225::IOProcess::(_processLogs) (542940) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:36,394::__init__::225::IOProcess::(_processLogs) (542940) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:36,394::__init__::225::IOProcess::(_processLogs) (542940) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:36,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:36,395::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:45:36,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:36,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0268321 s, 38.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:37,119::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:37,120::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:37,120::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:38,907::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:39,012::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471041 s, 21.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:45:40,253::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:45:41,021::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:41,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0285914 s, 35.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:41,882::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) (542941) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) (542941) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:41,883::__init__::225::IOProcess::(_processLogs) (542941) Queuing response >Thread-28::DEBUG::2014-08-11 17:45:41,884::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:45:41,884::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:41,942::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:45:41,944::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00154141 s, 321 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) (542942) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:41,945::__init__::225::IOProcess::(_processLogs) (542942) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:41,946::__init__::225::IOProcess::(_processLogs) (542942) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:41,946::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:41,946::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) (542943) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) (542943) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) (542943) Building response >Thread-19::DEBUG::2014-08-11 17:45:41,947::__init__::225::IOProcess::(_processLogs) (542943) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:41,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) (542944) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) (542944) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) (542944) Building response >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) (542944) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:41,949::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) (542945) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) (542945) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) (542945) Building response >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) (542945) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:41,950::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:42,123::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:42,124::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:42,124::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:45:42,163::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:45:42,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`29d6a779-c213-4630-a140-83dca84bbec1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:42,164::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:45:42,186::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:42,186::task::1191::Storage.TaskManager.Task::(prepare) Task=`29d6a779-c213-4630-a140-83dca84bbec1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:42,186::task::595::Storage.TaskManager.Task::(_updateState) Task=`29d6a779-c213-4630-a140-83dca84bbec1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:42,186::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:42,186::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:42,186::task::993::Storage.TaskManager.Task::(_decref) Task=`29d6a779-c213-4630-a140-83dca84bbec1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:45:42,198::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:45:42,199::task::595::Storage.TaskManager.Task::(_updateState) Task=`719f9437-6569-4f3d-92cf-4afe1858f435`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:45:42,199::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:45:42,199::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7f69d9de-4a7b-40f0-b296-56e8479fea57`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:45:42,199::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:45:42,199::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:45:42,199::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7f69d9de-4a7b-40f0-b296-56e8479fea57`::Granted request >Thread-10197::DEBUG::2014-08-11 17:45:42,199::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`719f9437-6569-4f3d-92cf-4afe1858f435`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:45:42,200::task::993::Storage.TaskManager.Task::(_decref) Task=`719f9437-6569-4f3d-92cf-4afe1858f435`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:45:42,215::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:42,216::task::1191::Storage.TaskManager.Task::(prepare) Task=`719f9437-6569-4f3d-92cf-4afe1858f435`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:42,216::task::595::Storage.TaskManager.Task::(_updateState) Task=`719f9437-6569-4f3d-92cf-4afe1858f435`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:45:42,216::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:45:42,216::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:45:42,216::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:45:42,216::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:45:42,216::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:45:42,216::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:45:42,216::task::993::Storage.TaskManager.Task::(_decref) Task=`719f9437-6569-4f3d-92cf-4afe1858f435`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:45:43,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:43,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567949 s, 18.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:45,240::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:45,326::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0259705 s, 39.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:45:46,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaa7abd7-445f-42a1-a6cd-06b2e62cd279`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:46,081::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:45:46,081::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00144663', 'lastCheck': '9.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154141', 'lastCheck': '4.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:46,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`eaa7abd7-445f-42a1-a6cd-06b2e62cd279`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00144663', 'lastCheck': '9.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00154141', 'lastCheck': '4.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:45:46,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`eaa7abd7-445f-42a1-a6cd-06b2e62cd279`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:46,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:46,081::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:46,081::task::993::Storage.TaskManager.Task::(_decref) Task=`eaa7abd7-445f-42a1-a6cd-06b2e62cd279`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:45:46,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:45:46,395::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:46,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:46,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:46,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:46,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:46,396::__init__::225::IOProcess::(_processLogs) (542946) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:46,396::__init__::225::IOProcess::(_processLogs) (542946) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:46,401::__init__::225::IOProcess::(_processLogs) (542946) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:46,401::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:45:46,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:45:46,468::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00435181 s, 84.1 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) (542947) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) (542947) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:46,469::__init__::225::IOProcess::(_processLogs) (542947) Building response >Thread-19::DEBUG::2014-08-11 17:45:46,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:46,470::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:47,126::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:47,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:47,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:47,334::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:47,413::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0205916 s, 49.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:49,422::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:49,529::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0481076 s, 21.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:51,538::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:51,667::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0701077 s, 14.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) (542948) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:51,951::__init__::225::IOProcess::(_processLogs) (542948) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:51,952::__init__::225::IOProcess::(_processLogs) (542948) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:51,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:45:51,952::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:45:52,011::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000425912 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:52,011::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:52,011::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:52,011::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:52,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:52,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:52,012::__init__::225::IOProcess::(_processLogs) (542949) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:52,012::__init__::225::IOProcess::(_processLogs) (542949) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) (542949) Building response >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) (542949) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:52,013::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) (542950) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) (542950) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) (542950) Building response >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) (542950) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:52,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) (542951) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) (542951) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) (542951) Building response >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) (542951) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:52,015::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:45:52,016::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:45:52,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:52,016::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:45:52,016::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:52,016::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:52,016::__init__::225::IOProcess::(_processLogs) (542952) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:45:52,017::__init__::225::IOProcess::(_processLogs) (542952) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:45:52,017::__init__::225::IOProcess::(_processLogs) (542952) Building response >Thread-19::DEBUG::2014-08-11 17:45:52,017::__init__::225::IOProcess::(_processLogs) (542952) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:52,017::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:52,017::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:52,133::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:52,134::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:52,134::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:45:52,294::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:45:52,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3a2d054-62c3-47f1-b16c-da35e61ad0bb`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:45:52,294::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:45:52,335::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:52,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`b3a2d054-62c3-47f1-b16c-da35e61ad0bb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:45:52,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`b3a2d054-62c3-47f1-b16c-da35e61ad0bb`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:45:52,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:45:52,335::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:45:52,335::task::993::Storage.TaskManager.Task::(_decref) Task=`b3a2d054-62c3-47f1-b16c-da35e61ad0bb`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:45:52,347::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:45:52,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7e351a6-b2ad-47f5-898e-54a1d478db26`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:45:52,347::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:45:52,347::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9a7fae62-266b-4a47-b89b-30e92c8c0b71`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:45:52,347::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:45:52,348::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:45:52,348::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9a7fae62-266b-4a47-b89b-30e92c8c0b71`::Granted request >Thread-10197::DEBUG::2014-08-11 17:45:52,348::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d7e351a6-b2ad-47f5-898e-54a1d478db26`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:45:52,348::task::993::Storage.TaskManager.Task::(_decref) Task=`d7e351a6-b2ad-47f5-898e-54a1d478db26`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:45:52,365::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:52,365::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7e351a6-b2ad-47f5-898e-54a1d478db26`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:45:52,365::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7e351a6-b2ad-47f5-898e-54a1d478db26`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:45:52,365::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:45:52,365::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:45:52,365::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:45:52,366::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:45:52,366::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:45:52,366::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:45:52,366::task::993::Storage.TaskManager.Task::(_decref) Task=`d7e351a6-b2ad-47f5-898e-54a1d478db26`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:45:53,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:53,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125214 s, 81.8 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:45:55,305::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:45:55,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:55,867::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0523729 s, 19.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) (542953) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:56,471::__init__::225::IOProcess::(_processLogs) (542953) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:56,472::__init__::225::IOProcess::(_processLogs) (542953) Queuing response >Thread-27::DEBUG::2014-08-11 17:45:56,472::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:45:56,472::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:56,531::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:45:56,533::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00132486 s, 276 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:45:56,534::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:45:56,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:45:56,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:45:56,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:45:56,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:45:56,537::__init__::225::IOProcess::(_processLogs) (542954) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:45:56,538::__init__::225::IOProcess::(_processLogs) (542954) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:45:56,538::__init__::225::IOProcess::(_processLogs) (542954) Queuing response >Thread-19::DEBUG::2014-08-11 17:45:56,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:45:56,539::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:57,140::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:57,140::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:45:57,141::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:45:57,875::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:45:57,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0253817 s, 40.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:45:59,967::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:00,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477597 s, 21.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:46:01,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`407c0a4b-6adb-485a-ba23-862c03784006`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:01,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:46:01,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132486', 'lastCheck': '4.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425912', 'lastCheck': '9.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:01,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`407c0a4b-6adb-485a-ba23-862c03784006`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00132486', 'lastCheck': '4.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000425912', 'lastCheck': '9.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:01,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`407c0a4b-6adb-485a-ba23-862c03784006`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:01,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:01,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:01,407::task::993::Storage.TaskManager.Task::(_decref) Task=`407c0a4b-6adb-485a-ba23-862c03784006`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:46:01,427::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:02,018::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:02,018::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:02,019::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:02,020::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:02,021::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:02,022::__init__::225::IOProcess::(_processLogs) (542955) Finding callback 'statvfs'... >Thread-28::DEBUG::2014-08-11 17:46:02,023::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:02,023::__init__::225::IOProcess::(_processLogs) (542955) Got request for method 'statvfs' >Dummy-51::DEBUG::2014-08-11 17:46:02,083::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:02,083::__init__::225::IOProcess::(_processLogs) (542955) Building response >Thread-19::DEBUG::2014-08-11 17:46:02,174::__init__::225::IOProcess::(_processLogs) (542955) Queuing response >Thread-28::DEBUG::2014-08-11 17:46:02,204::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00112355 s, 441 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:02,206::__init__::225::IOProcess::(_processLogs) Generating json... >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:02,206::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:02,209::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:02,212::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:02,214::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:02,215::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:02,215::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:02,217::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:02,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:02,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:02,222::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:02,222::__init__::225::IOProcess::(_processLogs) (542956) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:02,224::__init__::225::IOProcess::(_processLogs) (542956) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:02,226::__init__::225::IOProcess::(_processLogs) (542956) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:02,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:02,229::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:46:02,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0548458 s, 18.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:02,231::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:46:02,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:02,232::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:02,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:02,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:02,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:02,235::__init__::225::IOProcess::(_processLogs) (542957) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:02,237::__init__::225::IOProcess::(_processLogs) (542957) Building response >Thread-19::DEBUG::2014-08-11 17:46:02,237::__init__::225::IOProcess::(_processLogs) (542957) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:02,238::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:02,239::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:02,240::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:46:02,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:02,242::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:02,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:02,243::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:02,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:02,246::__init__::225::IOProcess::(_processLogs) (542958) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:02,247::__init__::225::IOProcess::(_processLogs) (542958) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:02,248::__init__::225::IOProcess::(_processLogs) (542958) Building response >Thread-19::DEBUG::2014-08-11 17:46:02,248::__init__::225::IOProcess::(_processLogs) (542958) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:02,249::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:02,250::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:02,251::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:46:02,252::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:02,252::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:02,253::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:02,254::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:02,254::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:02,255::__init__::225::IOProcess::(_processLogs) (542959) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:02,256::__init__::225::IOProcess::(_processLogs) (542959) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:02,256::__init__::225::IOProcess::(_processLogs) (542959) Building response >Thread-19::DEBUG::2014-08-11 17:46:02,257::__init__::225::IOProcess::(_processLogs) (542959) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:02,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10237::DEBUG::2014-08-11 17:46:02,440::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:46:02,441::task::595::Storage.TaskManager.Task::(_updateState) Task=`d950242c-8c8f-4426-b81b-fc4f0b6778a4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:02,441::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:46:02,491::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:02,491::task::1191::Storage.TaskManager.Task::(prepare) Task=`d950242c-8c8f-4426-b81b-fc4f0b6778a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:02,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`d950242c-8c8f-4426-b81b-fc4f0b6778a4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:02,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:02,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:02,493::task::993::Storage.TaskManager.Task::(_decref) Task=`d950242c-8c8f-4426-b81b-fc4f0b6778a4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:46:02,505::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:46:02,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e2a06e8-e37d-4cb8-87d3-303fb0c04c15`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:46:02,506::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:46:02,507::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`904dab85-9c3b-42be-ae46-11f58a75b9d5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:46:02,508::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:46:02,508::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:46:02,509::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`904dab85-9c3b-42be-ae46-11f58a75b9d5`::Granted request >Thread-10197::DEBUG::2014-08-11 17:46:02,510::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6e2a06e8-e37d-4cb8-87d3-303fb0c04c15`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:46:02,510::task::993::Storage.TaskManager.Task::(_decref) Task=`6e2a06e8-e37d-4cb8-87d3-303fb0c04c15`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:46:02,582::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:02,583::task::1191::Storage.TaskManager.Task::(prepare) Task=`6e2a06e8-e37d-4cb8-87d3-303fb0c04c15`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:02,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`6e2a06e8-e37d-4cb8-87d3-303fb0c04c15`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:46:02,583::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:46:02,584::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:46:02,584::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:46:02,585::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:46:02,585::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:46:02,586::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:46:02,586::task::993::Storage.TaskManager.Task::(_decref) Task=`6e2a06e8-e37d-4cb8-87d3-303fb0c04c15`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:46:03,938::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:46:04,306::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:04,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304658 s, 33.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:06,403::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:06,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406678 s, 25.2 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:46:06,539::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) (542960) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:46:06,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:06,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,542::__init__::225::IOProcess::(_processLogs) (542961) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:46:06,542::__init__::225::IOProcess::(_processLogs) (542961) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:46:06,542::__init__::225::IOProcess::(_processLogs) (542960) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:06,543::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:06,543::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:46:06,543::__init__::225::IOProcess::(_processLogs) (542961) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:06,543::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:46:06,547::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:46:06,547::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:46:06,547::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:06,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,548::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,548::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,548::__init__::225::IOProcess::(_processLogs) (542962) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:46:06,548::__init__::225::IOProcess::(_processLogs) (542962) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:46:06,554::__init__::225::IOProcess::(_processLogs) (542962) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:06,554::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-27::DEBUG::2014-08-11 17:46:06,554::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:46:06,555::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:46:06,555::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:06,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,555::__init__::225::IOProcess::(_processLogs) (542963) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:46:06,556::__init__::225::IOProcess::(_processLogs) (542963) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:46:06,556::__init__::225::IOProcess::(_processLogs) (542963) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:06,557::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:46:06,557::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:46:06,559::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:46:06,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:06,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:06,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,562::__init__::225::IOProcess::(_processLogs) (542964) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:06,563::__init__::225::IOProcess::(_processLogs) (542964) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:06,564::__init__::225::IOProcess::(_processLogs) (542964) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:06,564::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:06,565::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:06,566::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:46:06,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:06,566::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:06,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,566::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,567::__init__::225::IOProcess::(_processLogs) (542965) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:46:06,567::__init__::225::IOProcess::(_processLogs) (542965) Got request for method 'glob' >Thread-27::DEBUG::2014-08-11 17:46:06,567::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:46:06,567::__init__::225::IOProcess::(_processLogs) (542965) Queuing response >Thread-27::INFO::2014-08-11 17:46:06,568::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:46:06,568::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::INFO::2014-08-11 17:46:06,568::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:46:06,569::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:46:06,569::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) (542966) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) (542966) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:06,570::__init__::225::IOProcess::(_processLogs) (542966) Queuing response >Thread-27::DEBUG::2014-08-11 17:46:06,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:06,571::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:06,630::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:46:06,631::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000992015 s, 369 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) (542967) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) (542967) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:06,632::__init__::225::IOProcess::(_processLogs) (542967) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:06,633::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:06,633::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:07,231::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:07,232::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:07,232::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:08,511::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:08,607::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377535 s, 27.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:46:10,313::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:46:10,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:10,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291876 s, 35.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:12,238::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:12,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:12,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:12,260::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) (542968) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) (542968) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:12,261::__init__::225::IOProcess::(_processLogs) (542968) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:12,262::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:46:12,262::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:46:12,321::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000810153 s, 611 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) (542969) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) (542969) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) (542969) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:12,322::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) (542970) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:12,323::__init__::225::IOProcess::(_processLogs) (542970) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) (542970) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:12,324::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:12,325::__init__::225::IOProcess::(_processLogs) (542971) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:12,325::__init__::225::IOProcess::(_processLogs) (542971) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:12,325::__init__::225::IOProcess::(_processLogs) (542971) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:12,325::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:12,325::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:46:12,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:12,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:12,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:12,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:12,326::__init__::225::IOProcess::(_processLogs) (542972) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:12,326::__init__::225::IOProcess::(_processLogs) (542972) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:12,327::__init__::225::IOProcess::(_processLogs) (542972) Building response >Thread-19::DEBUG::2014-08-11 17:46:12,327::__init__::225::IOProcess::(_processLogs) (542972) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:12,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:12,327::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:46:12,633::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:46:12,634::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f11e483-69f7-46bb-87c0-1295feaaec99`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:12,634::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:46:12,660::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:12,660::task::1191::Storage.TaskManager.Task::(prepare) Task=`9f11e483-69f7-46bb-87c0-1295feaaec99`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:12,660::task::595::Storage.TaskManager.Task::(_updateState) Task=`9f11e483-69f7-46bb-87c0-1295feaaec99`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:12,661::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:12,661::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:12,661::task::993::Storage.TaskManager.Task::(_decref) Task=`9f11e483-69f7-46bb-87c0-1295feaaec99`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:46:12,672::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:46:12,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e676c7a-45be-4830-93d0-583f53f330f1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:46:12,672::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:46:12,673::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`56de162b-041f-4497-88d3-b31c1f857327`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:46:12,673::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:46:12,673::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:46:12,673::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`56de162b-041f-4497-88d3-b31c1f857327`::Granted request >Thread-10197::DEBUG::2014-08-11 17:46:12,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8e676c7a-45be-4830-93d0-583f53f330f1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:46:12,673::task::993::Storage.TaskManager.Task::(_decref) Task=`8e676c7a-45be-4830-93d0-583f53f330f1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:46:12,693::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:12,693::task::1191::Storage.TaskManager.Task::(prepare) Task=`8e676c7a-45be-4830-93d0-583f53f330f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:12,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`8e676c7a-45be-4830-93d0-583f53f330f1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:46:12,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:46:12,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:46:12,694::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:46:12,694::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:46:12,694::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:46:12,694::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:46:12,694::task::993::Storage.TaskManager.Task::(_decref) Task=`8e676c7a-45be-4830-93d0-583f53f330f1`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:46:12,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:12,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0468501 s, 21.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:14,826::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:14,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130221 s, 78.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:16,634::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:16,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:16,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:16,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:16,635::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:16,636::__init__::225::IOProcess::(_processLogs) (542973) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:16,636::__init__::225::IOProcess::(_processLogs) (542973) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:16,637::__init__::225::IOProcess::(_processLogs) (542973) Queuing response >Thread-10237::DEBUG::2014-08-11 17:46:16,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`44431eb9-ce9c-4732-979b-8f83cced892d`::moving from state init -> state preparing >Thread-27::DEBUG::2014-08-11 17:46:16,638::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:16,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10237::INFO::2014-08-11 17:46:16,638::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2014-08-11 17:46:16,698::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::INFO::2014-08-11 17:46:16,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992015', 'lastCheck': '10.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810153', 'lastCheck': '4.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:16,698::task::1191::Storage.TaskManager.Task::(prepare) Task=`44431eb9-ce9c-4732-979b-8f83cced892d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000992015', 'lastCheck': '10.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000810153', 'lastCheck': '4.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:16,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`44431eb9-ce9c-4732-979b-8f83cced892d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:16,699::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:16,699::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:16,699::task::993::Storage.TaskManager.Task::(_decref) Task=`44431eb9-ce9c-4732-979b-8f83cced892d`::ref 0 aborting False >Thread-27::DEBUG::2014-08-11 17:46:16,701::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00330146 s, 111 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) (542974) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) (542974) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:16,702::__init__::225::IOProcess::(_processLogs) (542974) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:16,703::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:16,703::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:46:16,728::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:16,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:17,026::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0622645 s, 16.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:17,245::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:17,245::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:17,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:19,034::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:19,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0787982 s, 13.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:21,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:21,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0731207 s, 14.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:22,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:22,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:22,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) (542975) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:22,327::__init__::225::IOProcess::(_processLogs) (542975) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:22,328::__init__::225::IOProcess::(_processLogs) (542975) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:22,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:46:22,328::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:46:22,391::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00049294 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) (542976) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:22,392::__init__::225::IOProcess::(_processLogs) (542976) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:22,393::__init__::225::IOProcess::(_processLogs) (542976) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:22,394::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:22,394::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:46:22,394::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) (542977) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) (542977) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) (542977) Building response >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) (542977) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:22,395::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) (542978) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) (542978) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:22,396::__init__::225::IOProcess::(_processLogs) (542978) Building response >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) (542978) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) (542979) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:22,397::__init__::225::IOProcess::(_processLogs) (542979) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:22,399::__init__::225::IOProcess::(_processLogs) (542979) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:22,399::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:46:22,747::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:46:22,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc8a6c60-9077-418d-b23f-64dec00f5919`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:22,749::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:46:22,763::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:22,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`dc8a6c60-9077-418d-b23f-64dec00f5919`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:22,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`dc8a6c60-9077-418d-b23f-64dec00f5919`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:22,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:22,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:22,764::task::993::Storage.TaskManager.Task::(_decref) Task=`dc8a6c60-9077-418d-b23f-64dec00f5919`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:46:22,776::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:46:22,776::task::595::Storage.TaskManager.Task::(_updateState) Task=`918ec360-9c4b-4b1e-b5bd-f5045ca02bd2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:46:22,776::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:46:22,777::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c11824b1-6fef-42aa-b870-c755c81bc81b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:46:22,777::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:46:22,777::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:46:22,777::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`c11824b1-6fef-42aa-b870-c755c81bc81b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:46:22,778::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`918ec360-9c4b-4b1e-b5bd-f5045ca02bd2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:46:22,778::task::993::Storage.TaskManager.Task::(_decref) Task=`918ec360-9c4b-4b1e-b5bd-f5045ca02bd2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:46:22,810::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:22,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`918ec360-9c4b-4b1e-b5bd-f5045ca02bd2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:22,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`918ec360-9c4b-4b1e-b5bd-f5045ca02bd2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:46:22,810::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:46:22,810::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:46:22,811::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:46:22,811::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:46:22,811::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:46:22,811::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:46:22,811::task::993::Storage.TaskManager.Task::(_decref) Task=`918ec360-9c4b-4b1e-b5bd-f5045ca02bd2`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:46:23,321::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:23,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0840228 s, 12.2 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:46:25,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1dff98c-3929-4941-9fdc-a66c1e1741df`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:46:25,315::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) (542980) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:46:25,316::__init__::225::IOProcess::(_processLogs) (542980) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:46:25,320::__init__::225::IOProcess::(_processLogs) (542980) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:25,320::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:25,320::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:46:25,320::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:25,320::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:25,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:25,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::INFO::2014-08-11 17:46:25,321::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:46:25,321::__init__::225::IOProcess::(_processLogs) (542981) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:46:25,321::task::1191::Storage.TaskManager.Task::(prepare) Task=`d1dff98c-3929-4941-9fdc-a66c1e1741df`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:46:25,322::__init__::225::IOProcess::(_processLogs) (542981) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:46:25,322::task::595::Storage.TaskManager.Task::(_updateState) Task=`d1dff98c-3929-4941-9fdc-a66c1e1741df`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:46:25,322::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:46:25,322::__init__::225::IOProcess::(_processLogs) (542981) Building response >Thread-10017::DEBUG::2014-08-11 17:46:25,323::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:46:25,323::__init__::225::IOProcess::(_processLogs) (542981) Queuing response >Thread-10017::DEBUG::2014-08-11 17:46:25,323::task::993::Storage.TaskManager.Task::(_decref) Task=`d1dff98c-3929-4941-9fdc-a66c1e1741df`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:46:25,324::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:25,324::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:46:25,345::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:46:25,472::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:25,596::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0655175 s, 15.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) (542982) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:26,704::__init__::225::IOProcess::(_processLogs) (542982) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:26,705::__init__::225::IOProcess::(_processLogs) (542982) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:26,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:46:26,705::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:46:26,765::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00038786 s, 944 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:26,765::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) (542983) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) (542983) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) (542983) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:26,766::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:27,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:27,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:27,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:27,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:27,688::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250928 s, 40.8 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:29,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:29,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0674062 s, 15.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:31,829::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:31,913::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239386 s, 42.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:46:31,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7ab1899-6f6d-4ab1-8640-357ff0927409`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:31,939::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:46:31,940::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038786', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049294', 'lastCheck': '9.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:31,942::task::1191::Storage.TaskManager.Task::(prepare) Task=`a7ab1899-6f6d-4ab1-8640-357ff0927409`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00038786', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00049294', 'lastCheck': '9.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:31,942::task::595::Storage.TaskManager.Task::(_updateState) Task=`a7ab1899-6f6d-4ab1-8640-357ff0927409`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:31,943::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:31,944::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:31,945::task::993::Storage.TaskManager.Task::(_decref) Task=`a7ab1899-6f6d-4ab1-8640-357ff0927409`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:46:31,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:32,263::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:32,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:32,267::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:32,401::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:32,401::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:32,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:32,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:32,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:32,404::__init__::225::IOProcess::(_processLogs) (542984) Finding callback 'statvfs'... >Thread-28::DEBUG::2014-08-11 17:46:32,404::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:32,404::__init__::225::IOProcess::(_processLogs) (542984) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:32,464::__init__::225::IOProcess::(_processLogs) (542984) Building response >Thread-19::DEBUG::2014-08-11 17:46:32,465::__init__::225::IOProcess::(_processLogs) (542984) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:32,466::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:46:32,466::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00127102 s, 389 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:32,467::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:32,469::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:32,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:32,470::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:32,470::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:32,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:32,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:32,472::__init__::225::IOProcess::(_processLogs) (542985) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:32,473::__init__::225::IOProcess::(_processLogs) (542985) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:32,474::__init__::225::IOProcess::(_processLogs) (542985) Building response >Thread-19::DEBUG::2014-08-11 17:46:32,474::__init__::225::IOProcess::(_processLogs) (542985) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:32,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:32,475::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:32,476::__init__::225::IOProcess::(_processLogs) (542985) Finding callback 'statvfs'...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:32,476::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:46:32,477::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:32,477::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:32,478::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:32,478::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:32,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:32,479::__init__::225::IOProcess::(_processLogs) (542986) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:32,480::__init__::225::IOProcess::(_processLogs) (542986) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:32,481::__init__::225::IOProcess::(_processLogs) (542986) Building response >Thread-19::DEBUG::2014-08-11 17:46:32,481::__init__::225::IOProcess::(_processLogs) (542986) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:32,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:32,482::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:32,483::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:32,483::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:46:32,484::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:32,484::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:32,485::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:32,485::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:32,486::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:32,486::__init__::225::IOProcess::(_processLogs) (542987) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:32,487::__init__::225::IOProcess::(_processLogs) (542987) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:32,487::__init__::225::IOProcess::(_processLogs) DEBUG|(542987) Building response >Thread-19::DEBUG::2014-08-11 17:46:32,488::__init__::225::IOProcess::(_processLogs) (542987) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:32,488::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:32,489::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:32,490::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:32,490::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:46:32,491::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:32,491::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:32,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:32,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:32,492::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:32,493::__init__::225::IOProcess::(_processLogs) (542988) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:32,493::__init__::225::IOProcess::(_processLogs) (542988) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:32,494::__init__::225::IOProcess::(_processLogs) DEBUG|(542988) Building response >Thread-19::DEBUG::2014-08-11 17:46:32,495::__init__::225::IOProcess::(_processLogs) (542988) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:32,496::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:32,496::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:46:32,886::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:46:32,886::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8e8a7e6-0249-4f23-a879-51e9f1c54569`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:32,887::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:46:32,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:32,970::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8e8a7e6-0249-4f23-a879-51e9f1c54569`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:32,970::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8e8a7e6-0249-4f23-a879-51e9f1c54569`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:32,970::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:32,970::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:32,970::task::993::Storage.TaskManager.Task::(_decref) Task=`e8e8a7e6-0249-4f23-a879-51e9f1c54569`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:46:32,983::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:46:32,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2fc7cb-94f2-4421-bc09-d67ca19ac8ea`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:46:32,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:46:32,984::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cc204678-97d3-4be8-a34e-194769602b0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:46:32,984::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:46:32,984::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:46:32,984::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`cc204678-97d3-4be8-a34e-194769602b0c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:46:32,984::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c2fc7cb-94f2-4421-bc09-d67ca19ac8ea`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:46:32,984::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2fc7cb-94f2-4421-bc09-d67ca19ac8ea`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:46:33,022::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:33,022::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c2fc7cb-94f2-4421-bc09-d67ca19ac8ea`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:33,023::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2fc7cb-94f2-4421-bc09-d67ca19ac8ea`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:46:33,023::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:46:33,023::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:46:33,023::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:46:33,023::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:46:33,023::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:46:33,023::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:46:33,024::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2fc7cb-94f2-4421-bc09-d67ca19ac8ea`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:46:33,981::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:46:34,009::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:34,119::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0507263 s, 20.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:36,127::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:36,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0677029 s, 15.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:36,767::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:36,767::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:36,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) (542989) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) (542989) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:36,768::__init__::225::IOProcess::(_processLogs) DEBUG|(542989) Building response >Thread-27::DEBUG::2014-08-11 17:46:36,769::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:36,769::__init__::225::IOProcess::(_processLogs) (542989) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:36,827::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:36,827::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:46:36,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00961918 s, 38.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:36,840::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:36,840::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:36,840::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) (542990) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) (542990) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:36,841::__init__::225::IOProcess::(_processLogs) DEBUG|(542990) Building response >Thread-19::DEBUG::2014-08-11 17:46:36,842::__init__::225::IOProcess::(_processLogs) (542990) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:36,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:36,842::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:37,274::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:37,274::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:37,275::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:38,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:38,339::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135872 s, 75.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:40,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:46:40,409::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:46:40,508::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.100969 s, 10.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:42,279::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:42,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:42,280::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:42,495::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) (542991) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) (542991) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:42,496::__init__::225::IOProcess::(_processLogs) DEBUG|(542991) Building response >Thread-19::DEBUG::2014-08-11 17:46:42,497::__init__::225::IOProcess::(_processLogs) (542991) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:42,497::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:46:42,498::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:42,498::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:46:42,557::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:46:42,616::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0025465 s, 194 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:42,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:42,618::__init__::225::IOProcess::(_processLogs) (542992) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:42,618::__init__::225::IOProcess::(_processLogs) (542992) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:42,618::__init__::225::IOProcess::(_processLogs) DEBUG|(542992) Building response >Thread-19::DEBUG::2014-08-11 17:46:42,618::__init__::225::IOProcess::(_processLogs) (542992) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:42,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) (542993) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) (542993) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) (542993) Building response >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) (542993) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:42,620::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) (542994) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:42,621::__init__::225::IOProcess::(_processLogs) (542994) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) (542994) Building response >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) (542994) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:42,622::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:42,623::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:42,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:42,623::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:42,623::__init__::225::IOProcess::(_processLogs) (542995) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:42,623::__init__::225::IOProcess::(_processLogs) (542995) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:42,624::__init__::225::IOProcess::(_processLogs) (542995) Building response >Thread-19::DEBUG::2014-08-11 17:46:42,624::__init__::225::IOProcess::(_processLogs) (542995) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:42,624::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:42,624::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:46:42,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0759172 s, 13.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:46:43,067::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [13b5bee0] >Thread-10237::DEBUG::2014-08-11 17:46:43,067::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c4f84ff-ecda-4998-b736-99566e94ebf0`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:43,067::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:46:43,081::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:43,081::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c4f84ff-ecda-4998-b736-99566e94ebf0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:43,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c4f84ff-ecda-4998-b736-99566e94ebf0`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:43,081::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:43,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:43,082::task::993::Storage.TaskManager.Task::(_decref) Task=`1c4f84ff-ecda-4998-b736-99566e94ebf0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:46:43,093::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [13b5bee0] >Thread-10197::DEBUG::2014-08-11 17:46:43,093::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd51e67d-0e1e-40c9-924f-03bab1d0671f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:46:43,093::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:46:43,093::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0203fac5-0b0b-4f19-a841-a2922e4f2de9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:46:43,093::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:46:43,094::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:46:43,094::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0203fac5-0b0b-4f19-a841-a2922e4f2de9`::Granted request >Thread-10197::DEBUG::2014-08-11 17:46:43,094::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bd51e67d-0e1e-40c9-924f-03bab1d0671f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:46:43,094::task::993::Storage.TaskManager.Task::(_decref) Task=`bd51e67d-0e1e-40c9-924f-03bab1d0671f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:46:43,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:43,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`bd51e67d-0e1e-40c9-924f-03bab1d0671f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:43,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`bd51e67d-0e1e-40c9-924f-03bab1d0671f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:46:43,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:46:43,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:46:43,110::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:46:43,110::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:46:43,110::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:46:43,110::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:46:43,111::task::993::Storage.TaskManager.Task::(_decref) Task=`bd51e67d-0e1e-40c9-924f-03bab1d0671f`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:46:44,701::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:44,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0179383 s, 57.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:46,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:46,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:46,845::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:46,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:46,845::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:46,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:46,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:46,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:46,846::__init__::225::IOProcess::(_processLogs) (542996) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:46,846::__init__::225::IOProcess::(_processLogs) (542996) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:46,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542996) Building response >Thread-19::DEBUG::2014-08-11 17:46:46,847::__init__::225::IOProcess::(_processLogs) (542996) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:46,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:46,848::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:46:46,848::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:46,911::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0641493 s, 16.0 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:46:46,914::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0004009 s, 913 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:46,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:46,915::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:46,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:46,916::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:46,917::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:46,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:46,918::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:46,919::__init__::225::IOProcess::(_processLogs) (542997) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:46,920::__init__::225::IOProcess::(_processLogs) (542997) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:46,920::__init__::225::IOProcess::(_processLogs) (542997) Building response >Thread-19::DEBUG::2014-08-11 17:46:46,920::__init__::225::IOProcess::(_processLogs) (542997) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:46,921::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:46,921::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:46:47,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a8fcc71-0e7d-4cba-84af-b789c33eb5a3`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:47,200::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:46:47,200::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004009', 'lastCheck': '0.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0025465', 'lastCheck': '4.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:47,200::task::1191::Storage.TaskManager.Task::(prepare) Task=`9a8fcc71-0e7d-4cba-84af-b789c33eb5a3`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0004009', 'lastCheck': '0.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0025465', 'lastCheck': '4.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:46:47,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`9a8fcc71-0e7d-4cba-84af-b789c33eb5a3`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:47,200::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:47,200::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:47,200::task::993::Storage.TaskManager.Task::(_decref) Task=`9a8fcc71-0e7d-4cba-84af-b789c33eb5a3`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:46:47,217::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:47,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:47,286::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:47,287::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:48,927::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:48,999::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132708 s, 77.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:51,007::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:51,126::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0595139 s, 17.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:52,291::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:52,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:52,292::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:52,624::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:52,625::__init__::225::IOProcess::(_processLogs) (542998) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:52,625::__init__::225::IOProcess::(_processLogs) (542998) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:52,625::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542998) Building response >Thread-19::DEBUG::2014-08-11 17:46:52,625::__init__::225::IOProcess::(_processLogs) (542998) Queuing response >Thread-28::DEBUG::2014-08-11 17:46:52,625::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:52,626::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:52,684::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:46:52,688::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00335006 s, 148 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) (542999) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:52,689::__init__::225::IOProcess::(_processLogs) (542999) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:52,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(542999) Building response >Thread-19::DEBUG::2014-08-11 17:46:52,690::__init__::225::IOProcess::(_processLogs) (542999) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:52,690::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:52,690::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:46:52,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) (543000) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:52,691::__init__::225::IOProcess::(_processLogs) (543000) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) (543000) Building response >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) (543000) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:52,692::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) (543001) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) (543001) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) (543001) Building response >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) (543001) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:52,693::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:46:52,694::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:52,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:52,694::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:52,694::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:52,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:52,695::__init__::225::IOProcess::(_processLogs) (543002) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:46:52,695::__init__::225::IOProcess::(_processLogs) (543002) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:46:52,695::__init__::225::IOProcess::(_processLogs) (543002) Building response >Thread-19::DEBUG::2014-08-11 17:46:52,695::__init__::225::IOProcess::(_processLogs) (543002) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:52,695::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:52,695::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:46:53,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:46:53,192::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:46:53,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2ba54d1-f605-4237-ba33-5385da3bb0a5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:46:53,193::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:46:53,204::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121575 s, 84.2 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:46:53,221::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:53,221::task::1191::Storage.TaskManager.Task::(prepare) Task=`c2ba54d1-f605-4237-ba33-5385da3bb0a5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:46:53,221::task::595::Storage.TaskManager.Task::(_updateState) Task=`c2ba54d1-f605-4237-ba33-5385da3bb0a5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:46:53,221::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:46:53,221::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:46:53,222::task::993::Storage.TaskManager.Task::(_decref) Task=`c2ba54d1-f605-4237-ba33-5385da3bb0a5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:46:53,234::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:46:53,234::task::595::Storage.TaskManager.Task::(_updateState) Task=`1732c14b-2afa-41a0-a667-661c9e6e4803`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:46:53,234::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:46:53,234::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`83a13db0-7f0d-4872-a0af-f75ca4cd79e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:46:53,234::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:46:53,235::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:46:53,235::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`83a13db0-7f0d-4872-a0af-f75ca4cd79e5`::Granted request >Thread-10197::DEBUG::2014-08-11 17:46:53,235::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1732c14b-2afa-41a0-a667-661c9e6e4803`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:46:53,235::task::993::Storage.TaskManager.Task::(_decref) Task=`1732c14b-2afa-41a0-a667-661c9e6e4803`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:46:53,251::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:53,251::task::1191::Storage.TaskManager.Task::(prepare) Task=`1732c14b-2afa-41a0-a667-661c9e6e4803`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:46:53,251::task::595::Storage.TaskManager.Task::(_updateState) Task=`1732c14b-2afa-41a0-a667-661c9e6e4803`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:46:53,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:46:53,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:46:53,252::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:46:53,252::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:46:53,252::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:46:53,252::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:46:53,252::task::993::Storage.TaskManager.Task::(_decref) Task=`1732c14b-2afa-41a0-a667-661c9e6e4803`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:46:55,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:55,330::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0585482 s, 17.5 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:46:55,417::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:46:56,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) (543003) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:56,920::__init__::225::IOProcess::(_processLogs) (543003) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:56,921::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543003) Building response >Thread-27::DEBUG::2014-08-11 17:46:56,921::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:46:56,921::__init__::225::IOProcess::(_processLogs) (543003) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:56,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:56,980::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:46:56,981::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000333235 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:46:56,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:46:56,981::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:46:56,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:46:56,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:46:56,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:46:56,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:46:56,982::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:46:56,982::__init__::225::IOProcess::(_processLogs) (543004) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:46:56,982::__init__::225::IOProcess::(_processLogs) (543004) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:46:56,982::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543004) Building response >Thread-19::DEBUG::2014-08-11 17:46:56,983::__init__::225::IOProcess::(_processLogs) (543004) Queuing response >Thread-19::DEBUG::2014-08-11 17:46:56,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:46:56,983::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:57,298::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:57,299::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:46:57,299::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:46:57,338::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:57,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0814647 s, 12.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:46:59,485::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:46:59,568::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0239679 s, 42.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:01,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:01,651::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017674 s, 57.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:02,305::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:02,307::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:02,309::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:47:02,403::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7304196-b229-4b5e-be2e-c90b027ace01`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:02,404::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:47:02,405::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333235', 'lastCheck': '5.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335006', 'lastCheck': '9.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:02,405::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7304196-b229-4b5e-be2e-c90b027ace01`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000333235', 'lastCheck': '5.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00335006', 'lastCheck': '9.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:02,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7304196-b229-4b5e-be2e-c90b027ace01`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:02,406::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:02,406::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:02,407::task::993::Storage.TaskManager.Task::(_decref) Task=`d7304196-b229-4b5e-be2e-c90b027ace01`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:47:02,435::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:47:02,695::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:02,695::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:02,696::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:02,696::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:02,697::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:02,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:02,697::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-28::DEBUG::2014-08-11 17:47:02,698::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:47:02,698::__init__::225::IOProcess::(_processLogs) (543005) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:02,757::__init__::225::IOProcess::(_processLogs) (543005) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:02,757::__init__::225::IOProcess::(_processLogs) (543005) Building response >Thread-19::DEBUG::2014-08-11 17:47:02,758::__init__::225::IOProcess::(_processLogs) (543005) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:02,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:02,760::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:47:02,760::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00127943 s, 387 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:02,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:02,762::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:02,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:02,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:02,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:02,764::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:02,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:02,766::__init__::225::IOProcess::(_processLogs) (543006) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:02,766::__init__::225::IOProcess::(_processLogs) (543006) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:02,767::__init__::225::IOProcess::(_processLogs) (543006) Building response >Thread-19::DEBUG::2014-08-11 17:47:02,767::__init__::225::IOProcess::(_processLogs) (543006) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:02,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:02,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) (543007) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) (543007) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) (543007) Building response >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) (543007) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:02,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) (543008) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) (543008) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) (543008) Building response >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) (543008) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:02,770::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:02,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:02,772::__init__::225::IOProcess::(_processLogs) (543009) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:02,772::__init__::225::IOProcess::(_processLogs) (543009) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:02,772::__init__::225::IOProcess::(_processLogs) (543009) Building response >Thread-19::DEBUG::2014-08-11 17:47:02,772::__init__::225::IOProcess::(_processLogs) (543009) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:02,772::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:02,772::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:47:03,287::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:47:03,287::task::595::Storage.TaskManager.Task::(_updateState) Task=`351ba50b-119b-4f6f-b0b8-9b4b7aba12c9`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:03,288::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:47:03,304::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:03,304::task::1191::Storage.TaskManager.Task::(prepare) Task=`351ba50b-119b-4f6f-b0b8-9b4b7aba12c9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:03,304::task::595::Storage.TaskManager.Task::(_updateState) Task=`351ba50b-119b-4f6f-b0b8-9b4b7aba12c9`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:03,304::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:03,304::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:03,304::task::993::Storage.TaskManager.Task::(_decref) Task=`351ba50b-119b-4f6f-b0b8-9b4b7aba12c9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:47:03,315::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:47:03,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`9dd1fba6-2349-4550-93f6-e5e719157ddf`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:47:03,316::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:47:03,316::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a1da0bd0-ed08-48c6-97f8-c93b81be050e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:47:03,316::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:47:03,317::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:47:03,317::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a1da0bd0-ed08-48c6-97f8-c93b81be050e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:47:03,317::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9dd1fba6-2349-4550-93f6-e5e719157ddf`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:47:03,317::task::993::Storage.TaskManager.Task::(_decref) Task=`9dd1fba6-2349-4550-93f6-e5e719157ddf`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:47:03,335::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:03,335::task::1191::Storage.TaskManager.Task::(prepare) Task=`9dd1fba6-2349-4550-93f6-e5e719157ddf`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:03,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`9dd1fba6-2349-4550-93f6-e5e719157ddf`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:47:03,335::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:47:03,335::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:47:03,336::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:47:03,336::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:47:03,336::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:47:03,336::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:47:03,336::task::993::Storage.TaskManager.Task::(_decref) Task=`9dd1fba6-2349-4550-93f6-e5e719157ddf`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:47:03,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:03,759::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135113 s, 75.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:47:04,014::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:47:05,767::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:05,891::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0654241 s, 15.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) (543010) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:06,984::__init__::225::IOProcess::(_processLogs) (543010) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:06,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543010) Building response >Thread-19::DEBUG::2014-08-11 17:47:06,985::__init__::225::IOProcess::(_processLogs) (543010) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:06,985::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:47:06,986::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:47:06,986::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:47:07,046::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000993421 s, 368 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:07,047::__init__::225::IOProcess::(_processLogs) (543011) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:07,048::__init__::225::IOProcess::(_processLogs) (543011) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:07,048::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543011) Building response >Thread-19::DEBUG::2014-08-11 17:47:07,048::__init__::225::IOProcess::(_processLogs) (543011) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:07,049::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:07,049::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:07,315::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:07,316::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:07,316::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:07,899::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:07,983::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0256531 s, 39.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:09,991::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:10,062::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125525 s, 81.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:47:10,425::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:47:12,069::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:12,141::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134645 s, 76.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:12,322::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:12,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:12,323::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) (543012) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:12,774::__init__::225::IOProcess::(_processLogs) (543012) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:12,775::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543012) Building response >Thread-28::DEBUG::2014-08-11 17:47:12,775::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:47:12,775::__init__::225::IOProcess::(_processLogs) (543012) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:12,834::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:12,835::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:47:12,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00124892 s, 396 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:12,838::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:12,838::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:12,839::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:12,839::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:12,839::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:12,840::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:12,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:12,842::__init__::225::IOProcess::(_processLogs) (543013) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:12,842::__init__::225::IOProcess::(_processLogs) (543013) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:12,843::__init__::225::IOProcess::(_processLogs) (543013) Building response >Thread-19::DEBUG::2014-08-11 17:47:12,843::__init__::225::IOProcess::(_processLogs) (543013) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:12,843::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) (543014) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:12,844::__init__::225::IOProcess::(_processLogs) (543014) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:12,847::__init__::225::IOProcess::(_processLogs) DEBUG|(543014) Building response >Thread-19::DEBUG::2014-08-11 17:47:12,847::__init__::225::IOProcess::(_processLogs) (543014) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:12,847::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:47:12,847::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:12,847::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:12,847::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) (543015) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:12,848::__init__::225::IOProcess::(_processLogs) (543015) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:12,849::__init__::225::IOProcess::(_processLogs) DEBUG|(543015) Building response >Thread-19::DEBUG::2014-08-11 17:47:12,849::__init__::225::IOProcess::(_processLogs) (543015) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:12,849::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:47:12,849::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:12,849::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:12,849::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:47:12,850::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:12,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:12,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:12,850::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:12,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:12,851::__init__::225::IOProcess::(_processLogs) (543016) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:12,851::__init__::225::IOProcess::(_processLogs) (543016) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:12,851::__init__::225::IOProcess::(_processLogs) (543016) Building response >Thread-19::DEBUG::2014-08-11 17:47:12,851::__init__::225::IOProcess::(_processLogs) (543016) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:12,851::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:12,851::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:47:13,391::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:47:13,392::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7ce98c5-073a-4623-951e-2783c4a09404`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:13,392::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:47:13,435::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:13,435::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7ce98c5-073a-4623-951e-2783c4a09404`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:13,435::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7ce98c5-073a-4623-951e-2783c4a09404`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:13,435::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:13,435::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:13,435::task::993::Storage.TaskManager.Task::(_decref) Task=`e7ce98c5-073a-4623-951e-2783c4a09404`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:47:13,461::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:47:13,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`30848264-0aec-43eb-9225-061531a15fab`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:47:13,461::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:47:13,461::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c3b0b9c-1f4e-4ba4-a285-582e1a672247`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:47:13,462::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:47:13,462::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:47:13,462::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2c3b0b9c-1f4e-4ba4-a285-582e1a672247`::Granted request >Thread-10197::DEBUG::2014-08-11 17:47:13,462::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`30848264-0aec-43eb-9225-061531a15fab`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:47:13,462::task::993::Storage.TaskManager.Task::(_decref) Task=`30848264-0aec-43eb-9225-061531a15fab`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:47:13,481::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:13,481::task::1191::Storage.TaskManager.Task::(prepare) Task=`30848264-0aec-43eb-9225-061531a15fab`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:13,481::task::595::Storage.TaskManager.Task::(_updateState) Task=`30848264-0aec-43eb-9225-061531a15fab`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:47:13,482::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:47:13,482::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:47:13,482::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:47:13,482::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:47:13,482::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:47:13,482::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:47:13,482::task::993::Storage.TaskManager.Task::(_decref) Task=`30848264-0aec-43eb-9225-061531a15fab`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:47:14,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:14,254::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.045462 s, 22.5 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:16,262::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:16,379::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0580061 s, 17.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:17,049::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:17,049::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:17,049::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:17,049::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:17,049::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:17,050::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:17,050::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:17,050::__init__::225::IOProcess::(_processLogs) (543017) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:17,050::__init__::225::IOProcess::(_processLogs) (543017) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:17,053::__init__::225::IOProcess::(_processLogs) DEBUG|(543017) Building response >Thread-19::DEBUG::2014-08-11 17:47:17,053::__init__::225::IOProcess::(_processLogs) (543017) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:17,054::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:47:17,054::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:47:17,054::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:47:17,127::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00781566 s, 46.8 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) (543018) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:17,128::__init__::225::IOProcess::(_processLogs) (543018) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:17,134::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543018) Building response >Thread-19::DEBUG::2014-08-11 17:47:17,134::__init__::225::IOProcess::(_processLogs) (543018) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:17,134::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:47:17,134::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:17,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:17,324::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:17,325::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:47:17,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`75473f54-5ed2-4fbb-864b-fe9e9b104f0b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:17,622::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:47:17,622::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00781566', 'lastCheck': '0.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124892', 'lastCheck': '4.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:17,623::task::1191::Storage.TaskManager.Task::(prepare) Task=`75473f54-5ed2-4fbb-864b-fe9e9b104f0b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00781566', 'lastCheck': '0.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00124892', 'lastCheck': '4.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:17,623::task::595::Storage.TaskManager.Task::(_updateState) Task=`75473f54-5ed2-4fbb-864b-fe9e9b104f0b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:17,623::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:17,623::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:17,623::task::993::Storage.TaskManager.Task::(_decref) Task=`75473f54-5ed2-4fbb-864b-fe9e9b104f0b`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:47:17,635::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:18,387::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:18,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0291126 s, 35.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:20,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:20,556::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013235 s, 77.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:22,329::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:22,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:22,330::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:22,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:22,636::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0137118 s, 74.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:22,851::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:22,851::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:22,851::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:22,851::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:22,852::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-28::DEBUG::2014-08-11 17:47:22,852::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:47:22,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:22,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:22,911::__init__::225::IOProcess::(_processLogs) (543019) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:22,912::__init__::225::IOProcess::(_processLogs) (543019) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:22,913::__init__::225::IOProcess::(_processLogs) (543019) Building response >Thread-19::DEBUG::2014-08-11 17:47:22,914::__init__::225::IOProcess::(_processLogs) (543019) Queuing response >Thread-28::DEBUG::2014-08-11 17:47:22,914::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00111463 s, 444 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:22,915::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:22,916::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:22,917::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:22,917::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:22,917::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:22,918::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:22,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:22,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:22,920::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:22,921::__init__::225::IOProcess::(_processLogs) (543020) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:22,921::__init__::225::IOProcess::(_processLogs) (543020) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:22,922::__init__::225::IOProcess::(_processLogs) (543020) Building response >Thread-19::DEBUG::2014-08-11 17:47:22,922::__init__::225::IOProcess::(_processLogs) (543020) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:22,922::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:22,922::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:22,922::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:22,922::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) (543021) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) (543021) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:22,923::__init__::225::IOProcess::(_processLogs) (543021) Building response >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) (543021) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:22,924::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) (543022) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) (543022) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) (543022) Building response >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) (543022) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:47:22,925::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:22,926::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:22,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:22,926::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:22,926::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:22,926::__init__::225::IOProcess::(_processLogs) (543023) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:22,926::__init__::225::IOProcess::(_processLogs) (543023) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:22,927::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543023) Building response >Thread-19::DEBUG::2014-08-11 17:47:22,927::__init__::225::IOProcess::(_processLogs) (543023) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:22,927::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:47:22,927::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:47:23,505::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:47:23,506::task::595::Storage.TaskManager.Task::(_updateState) Task=`5106b4f0-7ce3-4253-aef1-2a4358178a77`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:23,506::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:47:23,568::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:23,568::task::1191::Storage.TaskManager.Task::(prepare) Task=`5106b4f0-7ce3-4253-aef1-2a4358178a77`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:23,568::task::595::Storage.TaskManager.Task::(_updateState) Task=`5106b4f0-7ce3-4253-aef1-2a4358178a77`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:23,568::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:23,568::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:23,569::task::993::Storage.TaskManager.Task::(_decref) Task=`5106b4f0-7ce3-4253-aef1-2a4358178a77`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:47:23,577::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:47:23,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ea68622-8618-446c-b63d-6ea974f6b06b`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:47:23,577::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:47:23,578::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5adc9ea6-bc83-4fb1-b5ee-f163d8c36dc1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:47:23,578::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:47:23,578::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:47:23,578::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`5adc9ea6-bc83-4fb1-b5ee-f163d8c36dc1`::Granted request >Thread-10197::DEBUG::2014-08-11 17:47:23,578::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7ea68622-8618-446c-b63d-6ea974f6b06b`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:47:23,578::task::993::Storage.TaskManager.Task::(_decref) Task=`7ea68622-8618-446c-b63d-6ea974f6b06b`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:47:23,596::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:23,596::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ea68622-8618-446c-b63d-6ea974f6b06b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:23,596::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ea68622-8618-446c-b63d-6ea974f6b06b`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:47:23,596::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:47:23,596::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:47:23,597::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:47:23,597::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:47:23,597::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:47:23,597::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:47:23,597::task::993::Storage.TaskManager.Task::(_decref) Task=`7ea68622-8618-446c-b63d-6ea974f6b06b`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:47:24,644::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:24,739::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0353457 s, 29.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:47:25,426::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffe6a2e5-f581-486f-b999-50f0b98c5002`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:47:25,427::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:25,427::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:25,428::__init__::225::IOProcess::(_processLogs) (543024) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:47:25,428::__init__::225::IOProcess::(_processLogs) (543024) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:47:25,437::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543024) Building response >Thread-19::DEBUG::2014-08-11 17:47:25,438::__init__::225::IOProcess::(_processLogs) (543024) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:25,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:25,438::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:47:25,438::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:25,438::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:47:25,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:25,439::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:47:25,439::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:47:25,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:47:25,440::task::1191::Storage.TaskManager.Task::(prepare) Task=`ffe6a2e5-f581-486f-b999-50f0b98c5002`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:47:25,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:47:25,440::task::595::Storage.TaskManager.Task::(_updateState) Task=`ffe6a2e5-f581-486f-b999-50f0b98c5002`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:47:25,440::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:47:25,440::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:47:25,441::__init__::225::IOProcess::(_processLogs) (543025) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:47:25,441::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:47:25,441::__init__::225::IOProcess::(_processLogs) (543025) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:47:25,442::task::993::Storage.TaskManager.Task::(_decref) Task=`ffe6a2e5-f581-486f-b999-50f0b98c5002`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:47:25,442::__init__::225::IOProcess::(_processLogs) (543025) Building response >Thread-19::DEBUG::2014-08-11 17:47:25,442::__init__::225::IOProcess::(_processLogs) (543025) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:25,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:25,442::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:47:25,462::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:47:26,747::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:26,876::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0698491 s, 14.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:27,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:27,135::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:27,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:27,136::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:27,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:27,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:27,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:27,136::__init__::225::IOProcess::(_processLogs) (543026) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:27,136::__init__::225::IOProcess::(_processLogs) (543026) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:27,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543026) Building response >Thread-19::DEBUG::2014-08-11 17:47:27,137::__init__::225::IOProcess::(_processLogs) (543026) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:27,137::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:27,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:47:27,138::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:47:27,198::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00087976 s, 416 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) (543027) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:27,199::__init__::225::IOProcess::(_processLogs) (543027) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:27,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543027) Building response >Thread-19::DEBUG::2014-08-11 17:47:27,201::__init__::225::IOProcess::(_processLogs) (543027) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:27,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:27,202::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:27,336::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:27,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:27,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:28,884::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:28,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465682 s, 22.0 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:30,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:31,096::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0386634 s, 26.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:32,343::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:32,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:32,347::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:47:32,850::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed4ad947-efa2-40d6-9f17-101208071b7b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:32,850::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:47:32,851::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00087976', 'lastCheck': '5.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111463', 'lastCheck': '9.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:32,851::task::1191::Storage.TaskManager.Task::(prepare) Task=`ed4ad947-efa2-40d6-9f17-101208071b7b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00087976', 'lastCheck': '5.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00111463', 'lastCheck': '9.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:32,851::task::595::Storage.TaskManager.Task::(_updateState) Task=`ed4ad947-efa2-40d6-9f17-101208071b7b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:32,851::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:32,851::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:32,851::task::993::Storage.TaskManager.Task::(_decref) Task=`ed4ad947-efa2-40d6-9f17-101208071b7b`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:47:32,867::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) (543028) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:32,928::__init__::225::IOProcess::(_processLogs) (543028) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:32,929::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543028) Building response >Thread-28::DEBUG::2014-08-11 17:47:32,929::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:47:32,929::__init__::225::IOProcess::(_processLogs) (543028) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:32,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:32,989::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:47:32,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00128408 s, 385 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:32,992::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:32,992::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:32,993::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:32,993::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:32,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:32,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:32,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:32,995::__init__::225::IOProcess::(_processLogs) (543029) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:32,995::__init__::225::IOProcess::(_processLogs) (543029) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:32,996::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543029) Building response >Thread-19::DEBUG::2014-08-11 17:47:32,997::__init__::225::IOProcess::(_processLogs) (543029) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:32,997::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:32,998::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:32,998::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) (543030) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) (543030) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:32,999::__init__::225::IOProcess::(_processLogs) (543030) Building response >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) (543030) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:33,000::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) (543031) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) (543031) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) (543031) Building response >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) (543031) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:33,001::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:47:33,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:33,002::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:33,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:33,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:33,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:33,003::__init__::225::IOProcess::(_processLogs) (543032) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:33,003::__init__::225::IOProcess::(_processLogs) (543032) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:33,003::__init__::225::IOProcess::(_processLogs) (543032) Building response >Thread-19::DEBUG::2014-08-11 17:47:33,003::__init__::225::IOProcess::(_processLogs) (543032) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:33,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:33,003::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:47:33,104::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:33,179::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0156916 s, 65.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:47:33,637::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:47:33,638::task::595::Storage.TaskManager.Task::(_updateState) Task=`34694bf9-76c9-4730-8258-8be382e39c02`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:33,638::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:47:33,660::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:33,660::task::1191::Storage.TaskManager.Task::(prepare) Task=`34694bf9-76c9-4730-8258-8be382e39c02`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:33,660::task::595::Storage.TaskManager.Task::(_updateState) Task=`34694bf9-76c9-4730-8258-8be382e39c02`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:33,660::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:33,660::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:33,660::task::993::Storage.TaskManager.Task::(_decref) Task=`34694bf9-76c9-4730-8258-8be382e39c02`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:47:33,672::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:47:33,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c8b98ae-93bc-4634-a9f4-4525fb91205d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:47:33,672::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:47:33,673::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ab59cd98-bdc2-4cb1-bdf1-8b46183ff831`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:47:33,673::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:47:33,673::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:47:33,673::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ab59cd98-bdc2-4cb1-bdf1-8b46183ff831`::Granted request >Thread-10197::DEBUG::2014-08-11 17:47:33,673::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0c8b98ae-93bc-4634-a9f4-4525fb91205d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:47:33,673::task::993::Storage.TaskManager.Task::(_decref) Task=`0c8b98ae-93bc-4634-a9f4-4525fb91205d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:47:33,696::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:33,696::task::1191::Storage.TaskManager.Task::(prepare) Task=`0c8b98ae-93bc-4634-a9f4-4525fb91205d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:33,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`0c8b98ae-93bc-4634-a9f4-4525fb91205d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:47:33,696::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:47:33,696::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:47:33,696::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:47:33,696::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:47:33,696::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:47:33,696::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:47:33,697::task::993::Storage.TaskManager.Task::(_decref) Task=`0c8b98ae-93bc-4634-a9f4-4525fb91205d`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:47:34,164::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:47:35,185::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:35,305::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0600293 s, 17.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:37,202::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:37,202::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:37,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:37,202::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:37,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:37,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:37,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:37,203::__init__::225::IOProcess::(_processLogs) (543033) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:37,203::__init__::225::IOProcess::(_processLogs) (543033) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:37,203::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543033) Building response >Thread-19::DEBUG::2014-08-11 17:47:37,204::__init__::225::IOProcess::(_processLogs) (543033) Queuing response >Thread-27::DEBUG::2014-08-11 17:47:37,204::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:47:37,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:37,262::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:47:37,263::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00036775 s, 995 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) (543034) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:37,264::__init__::225::IOProcess::(_processLogs) (543034) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:37,265::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543034) Building response >Thread-19::DEBUG::2014-08-11 17:47:37,265::__init__::225::IOProcess::(_processLogs) (543034) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:37,265::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:37,266::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:47:37,312::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:37,370::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:37,371::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:37,371::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:37,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0666435 s, 15.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:39,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:39,530::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0250225 s, 40.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:47:40,511::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:47:41,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:41,662::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0587646 s, 17.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:42,377::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:42,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:42,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) (543035) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:43,003::__init__::225::IOProcess::(_processLogs) (543035) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:43,008::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543035) Building response >Thread-19::DEBUG::2014-08-11 17:47:43,008::__init__::225::IOProcess::(_processLogs) (543035) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:43,008::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:43,008::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:47:43,009::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:47:43,069::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00101596 s, 487 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:43,071::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:43,071::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:43,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:43,073::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:43,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:43,075::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:43,075::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:43,075::__init__::225::IOProcess::(_processLogs) (543036) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:43,075::__init__::225::IOProcess::(_processLogs) (543036) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:43,075::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543036) Building response >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) (543036) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:43,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) (543037) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) (543037) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) (543037) Building response >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) (543037) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:43,077::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:43,078::__init__::225::IOProcess::(_processLogs) (543038) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) (543038) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) (543038) Building response >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) (543038) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:43,079::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) (543039) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) (543039) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) (543039) Building response >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) (543039) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:43,080::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:43,081::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:47:43,670::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:47:43,732::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:47:43,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c926ff8-9a6c-44ac-9bec-7b8723493e70`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:43,733::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:47:43,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0639512 s, 16.0 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:47:43,819::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:43,819::task::1191::Storage.TaskManager.Task::(prepare) Task=`5c926ff8-9a6c-44ac-9bec-7b8723493e70`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:43,819::task::595::Storage.TaskManager.Task::(_updateState) Task=`5c926ff8-9a6c-44ac-9bec-7b8723493e70`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:43,820::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:43,820::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:43,820::task::993::Storage.TaskManager.Task::(_decref) Task=`5c926ff8-9a6c-44ac-9bec-7b8723493e70`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:47:43,829::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:47:43,829::task::595::Storage.TaskManager.Task::(_updateState) Task=`58a7a6f3-cb5b-404e-86eb-bb63c06a0d32`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:47:43,829::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:47:43,829::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`67e514b4-ec18-4d0a-96f6-f3112421db5b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:47:43,829::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:47:43,830::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:47:43,830::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`67e514b4-ec18-4d0a-96f6-f3112421db5b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:47:43,830::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`58a7a6f3-cb5b-404e-86eb-bb63c06a0d32`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:47:43,830::task::993::Storage.TaskManager.Task::(_decref) Task=`58a7a6f3-cb5b-404e-86eb-bb63c06a0d32`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:47:43,846::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:43,846::task::1191::Storage.TaskManager.Task::(prepare) Task=`58a7a6f3-cb5b-404e-86eb-bb63c06a0d32`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:43,847::task::595::Storage.TaskManager.Task::(_updateState) Task=`58a7a6f3-cb5b-404e-86eb-bb63c06a0d32`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:47:43,847::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:47:43,847::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:47:43,847::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:47:43,847::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:47:43,847::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:47:43,847::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:47:43,847::task::993::Storage.TaskManager.Task::(_decref) Task=`58a7a6f3-cb5b-404e-86eb-bb63c06a0d32`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:47:45,801::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:45,885::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0254091 s, 40.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:47,266::__init__::225::IOProcess::(_processLogs) (543040) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:47,267::__init__::225::IOProcess::(_processLogs) (543040) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:47,276::__init__::225::IOProcess::(_processLogs) DEBUG|(543040) Building response >Thread-19::DEBUG::2014-08-11 17:47:47,277::__init__::225::IOProcess::(_processLogs) (543040) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:47,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:47,277::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:47:47,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:47:47,354::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00979982 s, 37.3 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:47,354::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:47,354::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:47,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:47,354::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:47,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:47,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:47,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:47,355::__init__::225::IOProcess::(_processLogs) (543041) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:47,355::__init__::225::IOProcess::(_processLogs) (543041) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:47,358::__init__::225::IOProcess::(_processLogs) DEBUG|(543041) Building response >Thread-19::DEBUG::2014-08-11 17:47:47,359::__init__::225::IOProcess::(_processLogs) (543041) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:47,359::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:47:47,359::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:47,381::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:47,382::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:47,382::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:47,893::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:47,971::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0176497 s, 58.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:47:48,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d8ce46b-efec-4944-89f9-acf61e5f0c70`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:48,112::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:47:48,112::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00979982', 'lastCheck': '0.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101596', 'lastCheck': '5.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:48,112::task::1191::Storage.TaskManager.Task::(prepare) Task=`6d8ce46b-efec-4944-89f9-acf61e5f0c70`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00979982', 'lastCheck': '0.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101596', 'lastCheck': '5.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:47:48,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`6d8ce46b-efec-4944-89f9-acf61e5f0c70`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:48,112::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:48,112::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:48,112::task::993::Storage.TaskManager.Task::(_decref) Task=`6d8ce46b-efec-4944-89f9-acf61e5f0c70`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:47:48,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:47:49,978::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:50,093::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0537407 s, 19.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:47:52,103::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:52,178::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168418 s, 60.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:52,388::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:52,389::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:52,389::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) (543042) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:53,081::__init__::225::IOProcess::(_processLogs) (543042) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:53,082::__init__::225::IOProcess::(_processLogs) DEBUG|(543042) Building response >Thread-19::DEBUG::2014-08-11 17:47:53,082::__init__::225::IOProcess::(_processLogs) (543042) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:53,083::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:53,083::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:47:53,083::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:47:53,142::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000366757 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:53,144::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:53,145::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:53,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:53,146::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:53,146::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:53,146::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:53,147::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:53,147::__init__::225::IOProcess::(_processLogs) (543043) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:53,148::__init__::225::IOProcess::(_processLogs) (543043) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:53,149::__init__::225::IOProcess::(_processLogs) DEBUG|(543043) Building response >Thread-19::DEBUG::2014-08-11 17:47:53,150::__init__::225::IOProcess::(_processLogs) (543043) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:53,150::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:53,151::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:47:53,151::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) (543044) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:53,152::__init__::225::IOProcess::(_processLogs) (543044) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) (543044) Building response >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) (543044) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:53,153::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) (543045) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) (543045) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) (543045) Building response >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) (543045) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:47:53,154::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:53,155::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:53,155::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:53,155::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:53,155::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:53,155::__init__::225::IOProcess::(_processLogs) (543046) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:47:53,156::__init__::225::IOProcess::(_processLogs) (543046) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:47:53,156::__init__::225::IOProcess::(_processLogs) (543046) Building response >Thread-19::DEBUG::2014-08-11 17:47:53,156::__init__::225::IOProcess::(_processLogs) (543046) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:53,156::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:53,156::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:47:53,905::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:47:53,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`af6454fc-53a0-4acb-b902-d3f0457b0e1c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:47:53,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:47:53,964::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:53,965::task::1191::Storage.TaskManager.Task::(prepare) Task=`af6454fc-53a0-4acb-b902-d3f0457b0e1c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:47:53,965::task::595::Storage.TaskManager.Task::(_updateState) Task=`af6454fc-53a0-4acb-b902-d3f0457b0e1c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:47:53,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:47:53,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:47:53,965::task::993::Storage.TaskManager.Task::(_decref) Task=`af6454fc-53a0-4acb-b902-d3f0457b0e1c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:47:53,974::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:47:53,974::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac4f3bbc-43d2-484b-a572-53b49a907535`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:47:53,974::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:47:53,975::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`407ff65e-10a0-4f9b-a4e4-cccc5de8a2e0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:47:53,975::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:47:53,975::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:47:53,975::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`407ff65e-10a0-4f9b-a4e4-cccc5de8a2e0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:47:53,975::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ac4f3bbc-43d2-484b-a572-53b49a907535`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:47:53,975::task::993::Storage.TaskManager.Task::(_decref) Task=`ac4f3bbc-43d2-484b-a572-53b49a907535`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:47:53,994::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:53,994::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac4f3bbc-43d2-484b-a572-53b49a907535`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:47:53,994::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac4f3bbc-43d2-484b-a572-53b49a907535`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:47:53,994::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:47:53,994::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:47:53,994::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:47:53,995::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:47:53,995::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:47:53,995::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:47:53,995::task::993::Storage.TaskManager.Task::(_decref) Task=`ac4f3bbc-43d2-484b-a572-53b49a907535`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:47:54,186::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:54,256::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120578 s, 84.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:47:55,518::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:47:56,265::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:56,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0396487 s, 25.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:57,360::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:57,360::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:57,360::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:57,360::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:57,360::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) (543047) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) (543047) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) DEBUG|(543047) Building response >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) (543047) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:57,361::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:57,362::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:47:57,362::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:57,421::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:57,421::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:47:57,422::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:47:57,432::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00754568 s, 48.5 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:47:57,432::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) (543048) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) (543048) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:47:57,433::__init__::225::IOProcess::(_processLogs) DEBUG|(543048) Building response >Thread-19::DEBUG::2014-08-11 17:47:57,434::__init__::225::IOProcess::(_processLogs) (543048) Queuing response >Thread-19::DEBUG::2014-08-11 17:47:57,434::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:47:57,434::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:47:58,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:47:58,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0960156 s, 10.7 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:48:00,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:00,650::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0557162 s, 18.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:02,427::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:02,429::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:02,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:02,659::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:02,762::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0442885 s, 23.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:03,156::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:03,157::__init__::225::IOProcess::(_processLogs) (543049) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:03,157::__init__::225::IOProcess::(_processLogs) (543049) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:03,157::__init__::225::IOProcess::(_processLogs) DEBUG|(543049) Building response >Thread-19::DEBUG::2014-08-11 17:48:03,157::__init__::225::IOProcess::(_processLogs) (543049) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:03,157::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:03,157::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:48:03,158::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:48:03,220::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00197811 s, 250 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:03,220::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:03,220::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:03,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:03,220::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:03,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:03,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:03,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:03,221::__init__::225::IOProcess::(_processLogs) (543050) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:03,221::__init__::225::IOProcess::(_processLogs) (543050) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:03,221::__init__::225::IOProcess::(_processLogs) DEBUG|(543050) Building response >Thread-19::DEBUG::2014-08-11 17:48:03,222::__init__::225::IOProcess::(_processLogs) (543050) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:03,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:03,222::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:03,222::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:03,222::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:03,222::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) (543051) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) (543051) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) (543051) Building response >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) (543051) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:03,223::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) (543052) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) (543052) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) (543052) Building response >Thread-19::DEBUG::2014-08-11 17:48:03,224::__init__::225::IOProcess::(_processLogs) (543052) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) (543053) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) (543053) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:03,225::__init__::225::IOProcess::(_processLogs) (543053) Building response >Thread-19::DEBUG::2014-08-11 17:48:03,226::__init__::225::IOProcess::(_processLogs) (543053) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:03,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:03,226::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:48:03,313::task::595::Storage.TaskManager.Task::(_updateState) Task=`a31204c3-ff55-4de9-bde6-bd22900912c9`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:03,313::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:48:03,314::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00754568', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197811', 'lastCheck': '0.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:03,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`a31204c3-ff55-4de9-bde6-bd22900912c9`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00754568', 'lastCheck': '5.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00197811', 'lastCheck': '0.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:03,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`a31204c3-ff55-4de9-bde6-bd22900912c9`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:03,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:03,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:03,314::task::993::Storage.TaskManager.Task::(_decref) Task=`a31204c3-ff55-4de9-bde6-bd22900912c9`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:48:03,328::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:48:04,053::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:48:04,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2b55aa7-c8c9-4131-aa33-be8886d6c77b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:04,053::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:48:04,115::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:04,115::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2b55aa7-c8c9-4131-aa33-be8886d6c77b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:04,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2b55aa7-c8c9-4131-aa33-be8886d6c77b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:04,116::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:04,116::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:04,116::task::993::Storage.TaskManager.Task::(_decref) Task=`d2b55aa7-c8c9-4131-aa33-be8886d6c77b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:04,127::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:48:04,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca519b7-bbe8-43fd-ac1a-af7ba22adc21`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:04,128::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:48:04,128::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`06d323ae-3c21-4058-bbbf-43a765d6fbe2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:48:04,128::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:04,128::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:04,128::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`06d323ae-3c21-4058-bbbf-43a765d6fbe2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:04,128::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ca519b7-bbe8-43fd-ac1a-af7ba22adc21`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:04,129::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca519b7-bbe8-43fd-ac1a-af7ba22adc21`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:48:04,176::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:04,176::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ca519b7-bbe8-43fd-ac1a-af7ba22adc21`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:04,176::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ca519b7-bbe8-43fd-ac1a-af7ba22adc21`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:48:04,176::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:48:04,176::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:48:04,176::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:48:04,176::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:48:04,176::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:48:04,176::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:48:04,176::task::993::Storage.TaskManager.Task::(_decref) Task=`2ca519b7-bbe8-43fd-ac1a-af7ba22adc21`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:48:04,217::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:48:04,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:04,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0421844 s, 24.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:48:06,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:07,006::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0685557 s, 14.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:07,436::__init__::225::IOProcess::(_processLogs) Message size is 182 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:07,436::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:07,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:07,437::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:07,438::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:07,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:07,438::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:07,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:07,439::__init__::225::IOProcess::(_processLogs) (543054) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:07,440::__init__::225::IOProcess::(_processLogs) (543054) Got request for method 'statvfs' >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:07,441::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:07,441::__init__::225::IOProcess::(_processLogs) (543054) Queuing response >Thread-27::DEBUG::2014-08-11 17:48:07,442::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:07,442::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:07,501::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:48:07,502::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00107286 s, 341 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) (543055) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:07,503::__init__::225::IOProcess::(_processLogs) (543055) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:07,504::__init__::225::IOProcess::(_processLogs) (543055) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:07,504::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:48:09,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:09,088::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142349 s, 71.9 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:48:10,550::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:48:11,097::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:11,212::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0561034 s, 18.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:12,507::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:12,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:12,508::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:13,220::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:48:13,278::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:48:13,283::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:48:13,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,286::__init__::225::IOProcess::(_processLogs) (543056) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:13,286::__init__::225::IOProcess::(_processLogs) (543056) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:13,288::__init__::225::IOProcess::(_processLogs) (543056) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,290::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:48:13,292::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:48:13,293::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,293::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,295::__init__::225::IOProcess::(_processLogs) (543057) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:13,295::__init__::225::IOProcess::(_processLogs) (543057) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:13,296::__init__::225::IOProcess::(_processLogs) (543057) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,297::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:48:13,307::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0269123 s, 38.0 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:48:13,312::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:48:13,313::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:48:13,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,314::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,316::__init__::225::IOProcess::(_processLogs) (543058) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:48:13,325::__init__::225::IOProcess::(_processLogs) (543058) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,326::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-28::DEBUG::2014-08-11 17:48:13,326::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:48:13,326::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:48:13,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,326::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,327::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,327::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,327::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,327::__init__::225::IOProcess::(_processLogs) (543059) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:13,327::__init__::225::IOProcess::(_processLogs) (543059) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:13,329::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543059) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,329::__init__::225::IOProcess::(_processLogs) (543059) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,329::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,329::__init__::225::IOProcess::(_processLogs) Sending response sized 716 >Thread-28::DEBUG::2014-08-11 17:48:13,329::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:48:13,329::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) (543060) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:13,330::__init__::225::IOProcess::(_processLogs) (543060) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) (543060) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) (543060) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,331::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,332::__init__::225::IOProcess::(_processLogs) (543061) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:13,332::__init__::225::IOProcess::(_processLogs) (543061) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:13,332::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543061) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,332::__init__::225::IOProcess::(_processLogs) (543061) Queuing response >Thread-28::DEBUG::2014-08-11 17:48:13,333::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:48:13,333::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-28::INFO::2014-08-11 17:48:13,333::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:48:13,333::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-28::INFO::2014-08-11 17:48:13,333::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:48:13,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,334::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:13,334::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,334::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,334::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,334::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,335::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,335::__init__::225::IOProcess::(_processLogs) (543062) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:13,335::__init__::225::IOProcess::(_processLogs) (543062) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:13,335::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543062) Building response >Thread-28::DEBUG::2014-08-11 17:48:13,336::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:13,336::__init__::225::IOProcess::(_processLogs) (543062) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,395::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,395::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:48:13,396::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00110759 s, 447 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) (543063) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:13,397::__init__::225::IOProcess::(_processLogs) (543063) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:13,398::__init__::225::IOProcess::(_processLogs) DEBUG|(543063) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,398::__init__::225::IOProcess::(_processLogs) (543063) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,398::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) (543064) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) (543064) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:13,399::__init__::225::IOProcess::(_processLogs) DEBUG|(543064) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) (543064) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,400::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) (543065) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) (543065) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) DEBUG|(543065) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) (543065) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:13,401::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:13,402::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:48:13,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:13,402::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:13,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:13,402::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:13,402::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:13,403::__init__::225::IOProcess::(_processLogs) (543066) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:13,403::__init__::225::IOProcess::(_processLogs) (543066) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:13,403::__init__::225::IOProcess::(_processLogs) (543066) Building response >Thread-19::DEBUG::2014-08-11 17:48:13,403::__init__::225::IOProcess::(_processLogs) (543066) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:13,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:13,403::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:48:14,231::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:48:14,233::task::595::Storage.TaskManager.Task::(_updateState) Task=`7deed149-cda6-4d83-8548-0754726bda95`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:14,233::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:48:14,281::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:14,281::task::1191::Storage.TaskManager.Task::(prepare) Task=`7deed149-cda6-4d83-8548-0754726bda95`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:14,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`7deed149-cda6-4d83-8548-0754726bda95`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:14,281::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:14,281::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:14,281::task::993::Storage.TaskManager.Task::(_decref) Task=`7deed149-cda6-4d83-8548-0754726bda95`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:14,292::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:48:14,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`a00d06ac-075a-4385-97b4-f7c78b51b57e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:14,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:48:14,292::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`34b50907-d42b-4504-8225-d3107e2624a3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:48:14,292::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:14,292::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:14,293::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`34b50907-d42b-4504-8225-d3107e2624a3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:14,293::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a00d06ac-075a-4385-97b4-f7c78b51b57e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:14,293::task::993::Storage.TaskManager.Task::(_decref) Task=`a00d06ac-075a-4385-97b4-f7c78b51b57e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:48:14,356::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:14,356::task::1191::Storage.TaskManager.Task::(prepare) Task=`a00d06ac-075a-4385-97b4-f7c78b51b57e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:14,357::task::595::Storage.TaskManager.Task::(_updateState) Task=`a00d06ac-075a-4385-97b4-f7c78b51b57e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:48:14,357::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:48:14,357::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:48:14,357::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:48:14,357::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:48:14,357::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:48:14,357::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:48:14,357::task::993::Storage.TaskManager.Task::(_decref) Task=`a00d06ac-075a-4385-97b4-f7c78b51b57e`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:48:15,323::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:15,460::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0783994 s, 13.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:48:17,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:17,528::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:17,529::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:17,529::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:17,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:17,531::__init__::225::IOProcess::(_processLogs) Queuing request... >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:17,531::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:17,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:17,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:17,533::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:17,533::__init__::225::IOProcess::(_processLogs) (543067) Finding callback 'statvfs'... >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:17,534::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:17,534::__init__::225::IOProcess::(_processLogs) (543067) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:17,535::__init__::225::IOProcess::(_processLogs) DEBUG|(543067) Building response >Thread-27::DEBUG::2014-08-11 17:48:17,536::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:17,536::__init__::225::IOProcess::(_processLogs) (543067) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:17,595::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:48:17,596::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000357756 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:17,597::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:17,598::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:17,599::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:17,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:17,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:17,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:17,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:17,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:17,601::__init__::225::IOProcess::(_processLogs) (543068) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:17,602::__init__::225::IOProcess::(_processLogs) DEBUG|(543068) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:17,603::__init__::225::IOProcess::(_processLogs) (543068) Building response >Thread-19::DEBUG::2014-08-11 17:48:17,604::__init__::225::IOProcess::(_processLogs) (543068) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:17,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:17,605::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:48:17,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0783003 s, 13.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:48:18,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`8927d424-a471-4d25-86e5-da2b0f7644f6`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:18,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:48:18,500::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357756', 'lastCheck': '0.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110759', 'lastCheck': '5.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:18,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`8927d424-a471-4d25-86e5-da2b0f7644f6`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000357756', 'lastCheck': '0.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00110759', 'lastCheck': '5.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:18,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`8927d424-a471-4d25-86e5-da2b0f7644f6`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:18,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:18,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:18,500::task::993::Storage.TaskManager.Task::(_decref) Task=`8927d424-a471-4d25-86e5-da2b0f7644f6`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:48:18,517::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:19,614::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:19,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0559524 s, 18.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:48:21,738::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:21,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579556 s, 17.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:22,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:22,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:22,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:23,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:23,404::__init__::225::IOProcess::(_processLogs) (543069) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:23,404::__init__::225::IOProcess::(_processLogs) (543069) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:23,404::__init__::225::IOProcess::(_processLogs) DEBUG|(543069) Building response >Thread-19::DEBUG::2014-08-11 17:48:23,404::__init__::225::IOProcess::(_processLogs) (543069) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:23,404::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:23,404::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:48:23,405::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:48:23,467::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000994226 s, 498 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:23,467::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:23,467::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:23,467::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:23,467::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:23,468::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:23,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:23,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:23,468::__init__::225::IOProcess::(_processLogs) (543070) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:23,468::__init__::225::IOProcess::(_processLogs) (543070) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:23,468::__init__::225::IOProcess::(_processLogs) (543070) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:23,469::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:23,469::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:23,469::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:23,469::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:23,469::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) (543071) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) (543071) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) (543071) Building response >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) (543071) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:23,470::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) (543072) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) (543072) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) (543072) Building response >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) (543072) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:23,471::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) (543073) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) (543073) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) (543073) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:23,472::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:23,473::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:48:23,863::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:23,953::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0304893 s, 33.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:48:24,427::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:48:24,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`eccaf268-9163-44b7-994e-045be9986096`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:24,428::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:48:24,447::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:24,447::task::1191::Storage.TaskManager.Task::(prepare) Task=`eccaf268-9163-44b7-994e-045be9986096`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:24,447::task::595::Storage.TaskManager.Task::(_updateState) Task=`eccaf268-9163-44b7-994e-045be9986096`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:24,447::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:24,447::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:24,447::task::993::Storage.TaskManager.Task::(_decref) Task=`eccaf268-9163-44b7-994e-045be9986096`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:24,459::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:48:24,459::task::595::Storage.TaskManager.Task::(_updateState) Task=`77f3680d-45a9-4066-9472-f34c09ec191f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:24,459::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:48:24,459::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b6e770ff-636f-4236-9927-fa4955a532e2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:48:24,460::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:24,460::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:24,460::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b6e770ff-636f-4236-9927-fa4955a532e2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:24,460::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`77f3680d-45a9-4066-9472-f34c09ec191f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:24,460::task::993::Storage.TaskManager.Task::(_decref) Task=`77f3680d-45a9-4066-9472-f34c09ec191f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:48:24,519::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:24,519::task::1191::Storage.TaskManager.Task::(prepare) Task=`77f3680d-45a9-4066-9472-f34c09ec191f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:24,519::task::595::Storage.TaskManager.Task::(_updateState) Task=`77f3680d-45a9-4066-9472-f34c09ec191f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:48:24,519::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:48:24,519::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:48:24,519::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:48:24,519::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:48:24,519::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:48:24,520::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:48:24,520::task::993::Storage.TaskManager.Task::(_decref) Task=`77f3680d-45a9-4066-9472-f34c09ec191f`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:48:25,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`03ab045e-39c0-4335-81eb-16db2e5d35ee`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:48:25,597::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:48:25,597::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) (543074) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:25,598::__init__::225::IOProcess::(_processLogs) (543074) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:25,601::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543074) Building response >Thread-19::DEBUG::2014-08-11 17:48:25,601::__init__::225::IOProcess::(_processLogs) (543074) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:25,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:25,601::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:48:25,602::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:25,602::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:25,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:25,603::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:48:25,603::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:48:25,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:48:25,603::task::1191::Storage.TaskManager.Task::(prepare) Task=`03ab045e-39c0-4335-81eb-16db2e5d35ee`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:48:25,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:48:25,604::task::595::Storage.TaskManager.Task::(_updateState) Task=`03ab045e-39c0-4335-81eb-16db2e5d35ee`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:48:25,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:48:25,604::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:48:25,605::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:48:25,605::__init__::225::IOProcess::(_processLogs) (543075) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:48:25,605::task::993::Storage.TaskManager.Task::(_decref) Task=`03ab045e-39c0-4335-81eb-16db2e5d35ee`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:48:25,605::__init__::225::IOProcess::(_processLogs) (543075) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:25,606::__init__::225::IOProcess::(_processLogs) (543075) Building response >Thread-19::DEBUG::2014-08-11 17:48:25,606::__init__::225::IOProcess::(_processLogs) (543075) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:25,606::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:25,606::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:48:25,624::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:48:25,961::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:48:26,077::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmCreate with ({'acpiEnable': 'true', 'emulatedMachine': 'pc-1.0', 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'SandyBridge', 'custom': {}, 'hiberVolHandle': '7158eae9-4886-4af7-af0b-d668ecee9e4f,00000002-0002-0002-0002-00000000037f,a8e37c70-8fa4-46f7-bc12-f7b02e5b5856,041ad999-7aa9-4dcf-a3b1-bf962cc75c25,812042c3-6adc-4cf2-aaf4-e3f90efd5e5f,cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'numaTune': {'mode': 'interleave'}, 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm', 'nice': '0', 'bootMenuEnable': 'false', 'copyPasteEnable': 'true', 'smartcardEnable': 'false', 'fileTransferEnable': 'true', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '68e21ff2-4b5a-4b29-8765-eec79f1b15dd', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '496deb19-46c7-4b58-94a3-06b7fa34f7ac', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '00000002-0002-0002-0002-00000000037f', 'volumeID': '3f8b5bbe-741b-4a4f-9397-84123d530772', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'specParams': {}, 'readonly': 'false', 'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'deviceId': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:01:57', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1e5b18b9-16eb-4b96-83b6-4568b8bed355', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'specParams': {}, 'deviceId': '3959560b-27d1-4acf-acd9-c39f0c4148b2', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'timeOffset': '0', 'maxVCpus': '16', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'},) {} flowID [16f312ca] >Thread-10237::DEBUG::2014-08-11 17:48:26,077::task::595::Storage.TaskManager.Task::(_updateState) Task=`84e649a3-67ce-4547-af2e-9bb82a5cb66a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:26,078::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', leafUUID='cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff') >Thread-10237::DEBUG::2014-08-11 17:48:26,078::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`91b4c8af-a3e0-40cc-86b6-2e0787a87967`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-10237::DEBUG::2014-08-11 17:48:26,078::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10237::DEBUG::2014-08-11 17:48:26,078::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10237::DEBUG::2014-08-11 17:48:26,080::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`91b4c8af-a3e0-40cc-86b6-2e0787a87967`::Granted request >Thread-10237::DEBUG::2014-08-11 17:48:26,080::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`84e649a3-67ce-4547-af2e-9bb82a5cb66a`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10237::DEBUG::2014-08-11 17:48:26,080::task::993::Storage.TaskManager.Task::(_decref) Task=`84e649a3-67ce-4547-af2e-9bb82a5cb66a`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,081::__init__::225::IOProcess::(_processLogs) (543076) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:26,082::__init__::225::IOProcess::(_processLogs) (543076) Got request for method 'glob' >Dummy-51::DEBUG::2014-08-11 17:48:26,092::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0700032 s, 14.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:26,112::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543076) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,112::__init__::225::IOProcess::(_processLogs) (543076) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,112::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,113::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Sending response sized 6355 >Thread-10237::DEBUG::2014-08-11 17:48:26,113::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) (543077) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,114::__init__::225::IOProcess::(_processLogs) (543077) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,115::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543077) Building response >Thread-10237::DEBUG::2014-08-11 17:48:26,115::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:48:26,115::__init__::225::IOProcess::(_processLogs) (543077) Queuing response >Thread-10237::WARNING::2014-08-11 17:48:26,115::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f already exists >Thread-10237::DEBUG::2014-08-11 17:48:26,116::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f to /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f >Thread-19::DEBUG::2014-08-11 17:48:26,116::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10237::DEBUG::2014-08-11 17:48:26,116::fileSD::477::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f >Thread-19::DEBUG::2014-08-11 17:48:26,116::__init__::225::IOProcess::(_processLogs) Sending response sized 238 >Thread-19::DEBUG::2014-08-11 17:48:26,117::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) (543078) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) (543078) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,118::__init__::225::IOProcess::(_processLogs) (543078) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) (543078) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10237::DEBUG::2014-08-11 17:48:26,119::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-19::DEBUG::2014-08-11 17:48:26,119::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) (543079) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) (543079) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) (543079) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) (543079) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,120::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) Message size is 273 >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) (543080) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,121::__init__::225::IOProcess::(_processLogs) (543080) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,122::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543080) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,122::__init__::225::IOProcess::(_processLogs) (543080) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,122::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,122::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,122::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,122::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) (543081) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) (543081) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,123::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543081) Building response >Thread-10237::INFO::2014-08-11 17:48:26,123::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}]} >Thread-19::DEBUG::2014-08-11 17:48:26,124::__init__::225::IOProcess::(_processLogs) (543081) Queuing response >Thread-10237::DEBUG::2014-08-11 17:48:26,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`84e649a3-67ce-4547-af2e-9bb82a5cb66a`::finished: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'volumeID': u'cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease', 'imageID': '812042c3-6adc-4cf2-aaf4-e3f90efd5e5f'}]} >Thread-10237::DEBUG::2014-08-11 17:48:26,125::task::595::Storage.TaskManager.Task::(_updateState) Task=`84e649a3-67ce-4547-af2e-9bb82a5cb66a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:48:26,125::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10237::DEBUG::2014-08-11 17:48:26,125::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:48:26,125::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:48:26,125::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:26,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10237::DEBUG::2014-08-11 17:48:26,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10237::DEBUG::2014-08-11 17:48:26,126::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10237::DEBUG::2014-08-11 17:48:26,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10237::DEBUG::2014-08-11 17:48:26,126::task::993::Storage.TaskManager.Task::(_decref) Task=`84e649a3-67ce-4547-af2e-9bb82a5cb66a`::ref 0 aborting False >Thread-10237::INFO::2014-08-11 17:48:26,126::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-10237::DEBUG::2014-08-11 17:48:26,127::API::193::vds::(create) loaded pickledMachineParams {'guestFQDN': '', 'acpiEnable': 'true', 'emulatedMachine': 'pc-1.0', 'afterMigrationStatus': '', 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': u'5902', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'SandyBridge', 'smp': '1', 'numaTune': {'mode': 'interleave'}, 'custom': {}, 'vmType': 'kvm', '_srcDomXML': "<domain type='kvm' id='13'>\n <name>vm</name>\n <uuid>14c0fa91-1814-438b-8d7a-4e7de1e1da25</uuid>\n <memory unit='KiB'>1048576</memory>\n <currentMemory unit='KiB'>1048576</currentMemory>\n <memtune>\n <min_guarantee unit='KiB'>1048576</min_guarantee>\n </memtune>\n <vcpu placement='static' current='1'>16</vcpu>\n <cputune>\n <shares>1020</shares>\n </cputune>\n <resource>\n <partition>/machine</partition>\n </resource>\n <sysinfo type='smbios'>\n <system>\n <entry name='manufacturer'>oVirt</entry>\n <entry name='product'>oVirt Node</entry>\n <entry name='version'>20-3</entry>\n <entry name='serial'>4C4C4544-0048-3910-8046-B2C04F46354A</entry>\n <entry name='uuid'>14c0fa91-1814-438b-8d7a-4e7de1e1da25</entry>\n </system>\n </sysinfo>\n <os>\n <type arch='x86_64' machine='pc-1.0'>hvm</type>\n <boot dev='hd'/>\n <smbios mode='sysinfo'/>\n </os>\n <features>\n <acpi/>\n </features>\n <cpu mode='custom' match='exact'>\n <model fallback='allow'>SandyBridge</model>\n <topology sockets='16' cores='1' threads='1'/>\n </cpu>\n <clock offset='variable' adjustment='0' basis='utc'>\n <timer name='rtc' tickpolicy='catchup'/>\n <timer name='pit' tickpolicy='delay'/>\n <timer name='hpet' present='no'/>\n </clock>\n <on_poweroff>destroy</on_poweroff>\n <on_reboot>restart</on_reboot>\n <on_crash>destroy</on_crash>\n <devices>\n <emulator>/usr/bin/qemu-kvm</emulator>\n <disk type='file' device='cdrom'>\n <driver name='qemu' type='raw'/>\n <source startupPolicy='optional'/>\n <target dev='hdc' bus='ide'/>\n <readonly/>\n <serial></serial>\n <alias name='ide0-1-0'/>\n <address type='drive' controller='0' bus='1' target='0' unit='0'/>\n </disk>\n <disk type='file' device='cdrom'>\n <driver name='qemu' type='raw'/>\n <source file='/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img' startupPolicy='optional'/>\n <target dev='hdd' bus='ide'/>\n <readonly/>\n <serial></serial>\n <alias name='ide0-1-1'/>\n <address type='drive' controller='0' bus='1' target='0' unit='1'/>\n </disk>\n <disk type='file' device='disk' snapshot='no'>\n <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/>\n <source file='/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772'/>\n <target dev='vda' bus='virtio'/>\n <serial>99e5cda5-262b-4469-b336-04e3f0cf7c38</serial>\n <alias name='virtio-disk0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>\n </disk>\n <controller type='scsi' index='0' model='virtio-scsi'>\n <alias name='scsi0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>\n </controller>\n <controller type='ide' index='0'>\n <alias name='ide0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>\n </controller>\n <controller type='virtio-serial' index='0'>\n <alias name='virtio-serial0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>\n </controller>\n <controller type='usb' index='0'>\n <alias name='usb0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>\n </controller>\n <controller type='pci' index='0' model='pci-root'>\n <alias name='pci.0'/>\n </controller>\n <interface type='bridge'>\n <mac address='00:1a:4a:16:01:57'/>\n <source bridge='ovirtmgmt'/>\n <target dev='vnet2'/>\n <model type='virtio'/>\n <filterref filter='vdsm-no-mac-spoofing'/>\n <link state='up'/>\n <bandwidth>\n </bandwidth>\n <alias name='net0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>\n </interface>\n <channel type='unix'>\n <source mode='bind' path='/var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.com.redhat.rhevm.vdsm'/>\n <target type='virtio' name='com.redhat.rhevm.vdsm'/>\n <alias name='channel0'/>\n <address type='virtio-serial' controller='0' bus='0' port='1'/>\n </channel>\n <channel type='unix'>\n <source mode='bind' path='/var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.org.qemu.guest_agent.0'/>\n <target type='virtio' name='org.qemu.guest_agent.0'/>\n <alias name='channel1'/>\n <address type='virtio-serial' controller='0' bus='0' port='2'/>\n </channel>\n <channel type='spicevmc'>\n <target type='virtio' name='com.redhat.spice.0'/>\n <alias name='channel2'/>\n <address type='virtio-serial' controller='0' bus='0' port='3'/>\n </channel>\n <input type='mouse' bus='ps2'/>\n <graphics type='spice' tlsPort='5902' autoport='yes' keymap='en-us' passwdValidTo='1970-01-01T00:00:01'>\n <listen type='network' address='10.35.0.105' network='vdsm-ovirtmgmt'/>\n <channel name='main' mode='secure'/>\n <channel name='display' mode='secure'/>\n <channel name='inputs' mode='secure'/>\n <channel name='cursor' mode='secure'/>\n <channel name='playback' mode='secure'/>\n <channel name='record' mode='secure'/>\n <channel name='smartcard' mode='secure'/>\n <channel name='usbredir' mode='secure'/>\n </graphics>\n <video>\n <model type='qxl' ram='65536' vram='32768' heads='1'/>\n <alias name='video0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>\n </video>\n <memballoon model='none'>\n <alias name='balloon0'/>\n </memballoon>\n </devices>\n <seclabel type='none'/>\n</domain>\n", 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm', 'nice': '0', 'username': 'Unknown', 'clientIp': '', 'bootMenuEnable': 'false', 'copyPasteEnable': 'true', 'keyboardLayout': 'en-us', 'displayPort': '-1', 'smartcardEnable': 'false', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'elapsedTimeOffset': 15884.444510221481, 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'memballoon', 'specParams': {'model': 'none'}, 'type': 'balloon', 'target': 1048576, 'alias': u'balloon0'}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}, {'index': '0', 'alias': u'scsi0', 'specParams': {}, 'deviceId': '3959560b-27d1-4acf-acd9-c39f0c4148b2', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '68e21ff2-4b5a-4b29-8765-eec79f1b15dd', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'device': 'spice', 'specParams': {'displayNetwork': 'ovirtmgmt', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'keyMap': 'en-us', 'displayIp': '10.35.0.105', 'copyPasteEnable': 'true'}, 'type': 'graphics', 'tlsPort': u'5902'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:01:57', 'linkActive': True, 'network': 'ovirtmgmt', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1e5b18b9-16eb-4b96-83b6-4568b8bed355', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet2'}, {'index': '3', 'iface': 'ide', 'name': u'hdd', 'alias': u'ide0-1-1', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgIm5ldHdvcmstaW50ZXJmYWNlcyIgOiAiYXV0b1xuIiwKICAibmV0d29ya19jb25maWciIDog\newogICAgImNvbnRlbnRfcGF0aCIgOiAiL2NvbnRlbnQvMDAwMCIsCiAgICAicGF0aCIgOiAiL2V0\nYy9uZXR3b3JrL2ludGVyZmFjZXMiCiAgfSwKICAidXVpZCIgOiAiM2JiYzMxMWYtMmY2OS00YTc3\nLWIwZjAtNTJmNzJiZDIwZjA4IiwKICAibWV0YSIgOiB7CiAgICAiZXNzZW50aWFsIiA6ICJmYWxz\nZSIsCiAgICAicm9sZSIgOiAic2VydmVyIiwKICAgICJkc21vZGUiIDogImxvY2FsIgogIH0KfQ==\n', 'openstack/content/0000': 'YXV0bwo=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBp\ncmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0\nYy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwg\nIkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK\n'}}}, 'readonly': 'True', 'deviceId': '771ac016-6f1a-4974-a5bf-55a2f5c40f2c', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'device': 'cdrom', 'shared': 'false', 'path': '/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '496deb19-46c7-4b58-94a3-06b7fa34f7ac', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '10737418240', 'alias': u'virtio-disk0', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'readonly': 'False', 'shared': 'false', 'truesize': '512', 'type': 'disk', 'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'reqsize': '0', 'format': 'raw', 'deviceId': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'poolID': '00000002-0002-0002-0002-00000000037f', 'device': 'disk', 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '3f8b5bbe-741b-4a4f-9397-84123d530772', 'specParams': {}, 'volumeChain': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772'}]}], 'status': 'Up', 'timeOffset': '0', 'maxVCpus': '16', 'guestIPs': ''} >Thread-10237::DEBUG::2014-08-11 17:48:26,128::API::194::vds::(create) former conf {'acpiEnable': 'true', 'emulatedMachine': 'pc-1.0', 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'SandyBridge', 'custom': {}, 'numaTune': {'mode': 'interleave'}, 'smp': '1', 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm', 'nice': '0', 'restoreState': {'device': 'disk', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', 'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volumeID': '041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'poolID': '00000002-0002-0002-0002-00000000037f'}, 'bootMenuEnable': 'false', 'copyPasteEnable': 'true', 'smartcardEnable': 'false', 'fileTransferEnable': 'true', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'qxl', 'specParams': {'vram': '32768', 'heads': '1'}, 'type': 'video', 'deviceId': '68e21ff2-4b5a-4b29-8765-eec79f1b15dd', 'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}}, {'index': '2', 'iface': 'ide', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'specParams': {'path': ''}, 'readonly': 'true', 'deviceId': '496deb19-46c7-4b58-94a3-06b7fa34f7ac', 'path': '', 'device': 'cdrom', 'shared': 'false', 'type': 'disk'}, {'index': 0, 'iface': 'virtio', 'format': 'raw', 'optional': 'false', 'poolID': '00000002-0002-0002-0002-00000000037f', 'volumeID': '3f8b5bbe-741b-4a4f-9397-84123d530772', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'specParams': {}, 'readonly': 'false', 'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'deviceId': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'disk', 'shared': 'false', 'propagateErrors': 'off', 'type': 'disk'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:01:57', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1e5b18b9-16eb-4b96-83b6-4568b8bed355', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'index': '0', 'specParams': {}, 'deviceId': '3959560b-27d1-4acf-acd9-c39f0c4148b2', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}], 'timeOffset': '0', 'maxVCpus': '16', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'} >Thread-10237::DEBUG::2014-08-11 17:48:26,128::task::595::Storage.TaskManager.Task::(_updateState) Task=`06d261bf-d37d-497c-9a17-4b6e110618f7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:26,128::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', volUUID=None) >Thread-10237::DEBUG::2014-08-11 17:48:26,128::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`772e648f-e9a0-485e-b2b2-880ae6e5b11e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-10237::DEBUG::2014-08-11 17:48:26,128::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10237::DEBUG::2014-08-11 17:48:26,128::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10237::DEBUG::2014-08-11 17:48:26,128::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`772e648f-e9a0-485e-b2b2-880ae6e5b11e`::Granted request >Thread-10237::DEBUG::2014-08-11 17:48:26,129::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`06d261bf-d37d-497c-9a17-4b6e110618f7`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10237::DEBUG::2014-08-11 17:48:26,129::task::993::Storage.TaskManager.Task::(_decref) Task=`06d261bf-d37d-497c-9a17-4b6e110618f7`::ref 1 aborting False >Thread-10237::INFO::2014-08-11 17:48:26,129::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-10237::DEBUG::2014-08-11 17:48:26,129::task::1191::Storage.TaskManager.Task::(prepare) Task=`06d261bf-d37d-497c-9a17-4b6e110618f7`::finished: None >Thread-10237::DEBUG::2014-08-11 17:48:26,129::task::595::Storage.TaskManager.Task::(_updateState) Task=`06d261bf-d37d-497c-9a17-4b6e110618f7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:26,129::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10237::DEBUG::2014-08-11 17:48:26,129::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:26,129::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10237::DEBUG::2014-08-11 17:48:26,129::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10237::DEBUG::2014-08-11 17:48:26,129::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10237::DEBUG::2014-08-11 17:48:26,129::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10237::DEBUG::2014-08-11 17:48:26,130::task::993::Storage.TaskManager.Task::(_decref) Task=`06d261bf-d37d-497c-9a17-4b6e110618f7`::ref 0 aborting False >Thread-10237::INFO::2014-08-11 17:48:26,130::clientIF::391::vds::(createVm) vmContainerLock acquired by vm 14c0fa91-1814-438b-8d7a-4e7de1e1da25 >Thread-10237::DEBUG::2014-08-11 17:48:26,133::clientIF::404::vds::(createVm) Total desktops after creation of 14c0fa91-1814-438b-8d7a-4e7de1e1da25 is 4 >Thread-10254::DEBUG::2014-08-11 17:48:26,133::vm::2228::vm.Vm::(_startUnderlyingVm) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Start >Thread-10237::DEBUG::2014-08-11 17:48:26,134::BindingXMLRPC::1134::vds::(wrapper) return vmCreate with {'status': {'message': 'Done', 'code': 0}, 'vmList': {'username': 'Unknown', 'acpiEnable': 'true', 'emulatedMachine': 'pc-1.0', 'afterMigrationStatus': '', 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'memGuaranteedSize': 1024, 'transparentHugePages': 'true', 'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType': 'SandyBridge', 'smp': '1', 'numaTune': {'mode': 'interleave'}, 'custom': {}, 'vmType': 'kvm', 'memSize': 1024, 'smpCoresPerSocket': '1', 'vmName': 'vm', 'nice': '0', 'guestFQDN': '', 'restoreState': {'device': 'disk', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', 'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volumeID': '041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'poolID': '00000002-0002-0002-0002-00000000037f'}, 'bootMenuEnable': 'false', 'pid': '0', 'copyPasteEnable': 'true', 'displayIp': '10.35.0.105', 'displayPort': '-1', 'guestIPs': '', 'smartcardEnable': 'false', 'clientIp': '', 'fileTransferEnable': 'true', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-us', 'kvmEnable': 'true', 'displayNetwork': 'ovirtmgmt', 'devices': [{'device': 'memballoon', 'specParams': {'model': 'none'}, 'type': 'balloon', 'target': 1048576, 'alias': u'balloon0'}, {'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}, {'index': '0', 'alias': u'scsi0', 'specParams': {}, 'deviceId': '3959560b-27d1-4acf-acd9-c39f0c4148b2', 'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'device': u'usb', 'alias': u'usb0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device': u'ide', 'alias': u'ide0', 'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'device': u'virtio-serial', 'alias': u'virtio-serial0', 'type': 'controller', 'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {'alias': u'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId': '68e21ff2-4b5a-4b29-8765-eec79f1b15dd', 'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'qxl', 'type': 'video'}, {'device': 'spice', 'specParams': {'displayNetwork': 'ovirtmgmt', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'keyMap': 'en-us', 'displayIp': '10.35.0.105', 'copyPasteEnable': 'true'}, 'type': 'graphics', 'tlsPort': u'5902'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:16:01:57', 'linkActive': True, 'network': 'ovirtmgmt', 'alias': u'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId': '1e5b18b9-16eb-4b96-83b6-4568b8bed355', 'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet2'}, {'index': '3', 'iface': 'ide', 'name': u'hdd', 'alias': u'ide0-1-1', 'specParams': {'vmPayload': {'volId': 'config-2', 'file': {'openstack/latest/meta_data.json': 'ewogICJsYXVuY2hfaW5kZXgiIDogIjAiLAogICJhdmFpbGFiaWxpdHlfem9uZSIgOiAibm92YSIs\nCiAgIm5ldHdvcmstaW50ZXJmYWNlcyIgOiAiYXV0b1xuIiwKICAibmV0d29ya19jb25maWciIDog\newogICAgImNvbnRlbnRfcGF0aCIgOiAiL2NvbnRlbnQvMDAwMCIsCiAgICAicGF0aCIgOiAiL2V0\nYy9uZXR3b3JrL2ludGVyZmFjZXMiCiAgfSwKICAidXVpZCIgOiAiM2JiYzMxMWYtMmY2OS00YTc3\nLWIwZjAtNTJmNzJiZDIwZjA4IiwKICAibWV0YSIgOiB7CiAgICAiZXNzZW50aWFsIiA6ICJmYWxz\nZSIsCiAgICAicm9sZSIgOiAic2VydmVyIiwKICAgICJkc21vZGUiIDogImxvY2FsIgogIH0KfQ==\n', 'openstack/content/0000': 'YXV0bwo=\n', 'openstack/latest/user_data': 'I2Nsb3VkLWNvbmZpZwpzc2hfcHdhdXRoOiB0cnVlCmRpc2FibGVfcm9vdDogMApvdXRwdXQ6CiAg\nYWxsOiAnPj4gL3Zhci9sb2cvY2xvdWQtaW5pdC1vdXRwdXQubG9nJwpjaHBhc3N3ZDoKICBleHBp\ncmU6IGZhbHNlCnJ1bmNtZDoKLSAnc2VkIC1pICcnL15kYXRhc291cmNlX2xpc3Q6IC9kJycgL2V0\nYy9jbG91ZC9jbG91ZC5jZmc7IGVjaG8gJydkYXRhc291cmNlX2xpc3Q6CiAgWyJOb0Nsb3VkIiwg\nIkNvbmZpZ0RyaXZlIl0nJyA+PiAvZXRjL2Nsb3VkL2Nsb3VkLmNmZycK\n'}}}, 'readonly': 'True', 'deviceId': '771ac016-6f1a-4974-a5bf-55a2f5c40f2c', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'device': 'cdrom', 'shared': 'false', 'path': '/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img', 'type': 'disk'}, {'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0', 'specParams': {'path': ''}, 'readonly': 'True', 'deviceId': '496deb19-46c7-4b58-94a3-06b7fa34f7ac', 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'volumeInfo': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772'}, 'index': 0, 'iface': 'virtio', 'apparentsize': '10737418240', 'alias': u'virtio-disk0', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'readonly': 'False', 'shared': 'false', 'truesize': '512', 'type': 'disk', 'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'reqsize': '0', 'format': 'raw', 'deviceId': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'poolID': '00000002-0002-0002-0002-00000000037f', 'device': 'disk', 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'propagateErrors': 'off', 'optional': 'false', 'name': u'vda', 'volumeID': '3f8b5bbe-741b-4a4f-9397-84123d530772', 'specParams': {}, 'volumeChain': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772'}]}], 'status': 'Restoring state', 'timeOffset': '0', 'maxVCpus': '16', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'qxl'}} >Thread-10254::DEBUG::2014-08-11 17:48:26,134::vm::2232::vm.Vm::(_startUnderlyingVm) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::_ongoingCreations acquired >Thread-10254::INFO::2014-08-11 17:48:26,135::vm::3224::vm.Vm::(_run) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::VM wrapper has started >Thread-10254::WARNING::2014-08-11 17:48:26,136::vm::2020::vm.Vm::(buildConfDevices) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel0', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}' found >Thread-10254::WARNING::2014-08-11 17:48:26,137::vm::2020::vm.Vm::(buildConfDevices) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Unknown type found, device: '{'device': u'unix', 'alias': u'channel1', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}' found >Thread-10254::WARNING::2014-08-11 17:48:26,138::vm::2020::vm.Vm::(buildConfDevices) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Unknown type found, device: '{'device': u'spicevmc', 'alias': u'channel2', 'type': u'channel', 'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}' found >Thread-10254::DEBUG::2014-08-11 17:48:26,139::task::595::Storage.TaskManager.Task::(_updateState) Task=`65a64579-c536-4d5f-b0f6-1284d93da0d2`::moving from state init -> state preparing >Thread-10254::INFO::2014-08-11 17:48:26,140::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:48:26,141::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,142::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,142::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,143::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,143::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,144::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,145::__init__::225::IOProcess::(_processLogs) (543082) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,146::__init__::225::IOProcess::(_processLogs) (543082) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,147::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543082) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) (543082) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,148::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-10254::INFO::2014-08-11 17:48:26,148::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:48:26,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10254::DEBUG::2014-08-11 17:48:26,149::task::1191::Storage.TaskManager.Task::(prepare) Task=`65a64579-c536-4d5f-b0f6-1284d93da0d2`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:48:26,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10254::DEBUG::2014-08-11 17:48:26,150::task::595::Storage.TaskManager.Task::(_updateState) Task=`65a64579-c536-4d5f-b0f6-1284d93da0d2`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:48:26,150::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10254::DEBUG::2014-08-11 17:48:26,150::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:48:26,150::__init__::225::IOProcess::(_processLogs) (543083) Finding callback 'stat'... >Thread-10254::DEBUG::2014-08-11 17:48:26,150::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:48:26,151::__init__::225::IOProcess::(_processLogs) (543083) Got request for method 'stat' >Thread-10254::DEBUG::2014-08-11 17:48:26,151::task::993::Storage.TaskManager.Task::(_decref) Task=`65a64579-c536-4d5f-b0f6-1284d93da0d2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:48:26,151::__init__::225::IOProcess::(_processLogs) (543083) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,152::__init__::225::IOProcess::(_processLogs) (543083) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,152::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,153::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10254::INFO::2014-08-11 17:48:26,158::clientIF::332::vds::(prepareVolumePath) prepared volume path: /var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img >Thread-10254::INFO::2014-08-11 17:48:26,158::clientIF::332::vds::(prepareVolumePath) prepared volume path: >Thread-10254::DEBUG::2014-08-11 17:48:26,159::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68b003a-27f8-4e3d-a69f-30d68fbd4d95`::moving from state init -> state preparing >Thread-10254::INFO::2014-08-11 17:48:26,159::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', leafUUID='3f8b5bbe-741b-4a4f-9397-84123d530772') >Thread-10254::DEBUG::2014-08-11 17:48:26,159::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`99ca3574-8534-4a0e-b25a-91cf95133a12`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-10254::DEBUG::2014-08-11 17:48:26,159::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10254::DEBUG::2014-08-11 17:48:26,159::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10254::DEBUG::2014-08-11 17:48:26,159::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`99ca3574-8534-4a0e-b25a-91cf95133a12`::Granted request >Thread-10254::DEBUG::2014-08-11 17:48:26,159::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f68b003a-27f8-4e3d-a69f-30d68fbd4d95`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10254::DEBUG::2014-08-11 17:48:26,160::task::993::Storage.TaskManager.Task::(_decref) Task=`f68b003a-27f8-4e3d-a69f-30d68fbd4d95`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,160::__init__::225::IOProcess::(_processLogs) (543084) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:26,161::__init__::225::IOProcess::(_processLogs) (543084) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:26,171::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543084) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,171::__init__::225::IOProcess::(_processLogs) (543084) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,171::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,172::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Sending response sized 6355 >Thread-10254::DEBUG::2014-08-11 17:48:26,173::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-19::DEBUG::2014-08-11 17:48:26,173::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,173::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,173::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-10254::DEBUG::2014-08-11 17:48:26,173::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:48:26,174::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10254::WARNING::2014-08-11 17:48:26,174::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f already exists >Thread-19::DEBUG::2014-08-11 17:48:26,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10254::DEBUG::2014-08-11 17:48:26,174::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38 to /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/99e5cda5-262b-4469-b336-04e3f0cf7c38 >Thread-19::DEBUG::2014-08-11 17:48:26,175::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10254::DEBUG::2014-08-11 17:48:26,175::fileSD::477::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/99e5cda5-262b-4469-b336-04e3f0cf7c38 >Thread-19::DEBUG::2014-08-11 17:48:26,175::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,176::__init__::225::IOProcess::(_processLogs) (543085) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,176::__init__::225::IOProcess::(_processLogs) (543085) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,176::__init__::225::IOProcess::(_processLogs) (543085) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,176::__init__::225::IOProcess::(_processLogs) (543085) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,177::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) (543086) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) (543086) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) (543086) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) (543086) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:48:26,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10254::DEBUG::2014-08-11 17:48:26,179::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-19::DEBUG::2014-08-11 17:48:26,179::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,179::__init__::225::IOProcess::(_processLogs) (543087) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,179::__init__::225::IOProcess::(_processLogs) (543087) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) (543087) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) (543087) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Message size is 273 >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,181::__init__::225::IOProcess::(_processLogs) (543088) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,181::__init__::225::IOProcess::(_processLogs) (543088) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,181::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543088) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,181::__init__::225::IOProcess::(_processLogs) (543088) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,181::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,181::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) (543089) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,182::__init__::225::IOProcess::(_processLogs) (543089) Got request for method 'access' >Thread-10254::INFO::2014-08-11 17:48:26,183::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38'}]} >Thread-19::DEBUG::2014-08-11 17:48:26,183::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543089) Building response >Thread-10254::DEBUG::2014-08-11 17:48:26,183::task::1191::Storage.TaskManager.Task::(prepare) Task=`f68b003a-27f8-4e3d-a69f-30d68fbd4d95`::finished: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'volumeID': u'3f8b5bbe-741b-4a4f-9397-84123d530772', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772.lease', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38'}]} >Thread-19::DEBUG::2014-08-11 17:48:26,183::__init__::225::IOProcess::(_processLogs) (543089) Queuing response >Thread-10254::DEBUG::2014-08-11 17:48:26,184::task::595::Storage.TaskManager.Task::(_updateState) Task=`f68b003a-27f8-4e3d-a69f-30d68fbd4d95`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:48:26,184::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10254::DEBUG::2014-08-11 17:48:26,184::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:48:26,184::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10254::DEBUG::2014-08-11 17:48:26,184::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10254::DEBUG::2014-08-11 17:48:26,185::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10254::DEBUG::2014-08-11 17:48:26,185::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10254::DEBUG::2014-08-11 17:48:26,185::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10254::DEBUG::2014-08-11 17:48:26,185::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10254::DEBUG::2014-08-11 17:48:26,185::task::993::Storage.TaskManager.Task::(_decref) Task=`f68b003a-27f8-4e3d-a69f-30d68fbd4d95`::ref 0 aborting False >Thread-10254::INFO::2014-08-11 17:48:26,185::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-10254::DEBUG::2014-08-11 17:48:26,189::vm::1035::vm.Vm::(__init__) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Ignoring param (target, 1048576) in BalloonDevice >Thread-10254::DEBUG::2014-08-11 17:48:26,200::vm::3256::vm.Vm::(_run) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::<?xml version="1.0" encoding="utf-8"?> ><domain type="kvm"> > <name>vm</name> > <uuid>14c0fa91-1814-438b-8d7a-4e7de1e1da25</uuid> > <memory>1048576</memory> > <currentMemory>1048576</currentMemory> > <vcpu current="1">16</vcpu> > <memtune> > <min_guarantee>1048576</min_guarantee> > </memtune> > <devices> > <channel type="unix"> > <target name="com.redhat.rhevm.vdsm" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.com.redhat.rhevm.vdsm"/> > </channel> > <channel type="unix"> > <target name="org.qemu.guest_agent.0" type="virtio"/> > <source mode="bind" path="/var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.org.qemu.guest_agent.0"/> > </channel> > <input bus="ps2" type="mouse"/> > <memballoon model="none"/> > <channel type="unix"> > <address bus="0" controller="0" port="1" type="virtio-serial"/> > </channel> > <channel type="unix"> > <address bus="0" controller="0" port="2" type="virtio-serial"/> > </channel> > <channel type="spicevmc"> > <address bus="0" controller="0" port="3" type="virtio-serial"/> > </channel> > <controller index="0" model="virtio-scsi" type="scsi"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/> > </controller> > <controller type="usb"> > <address bus="0x00" domain="0x0000" function="0x2" slot="0x01" type="pci"/> > </controller> > <controller type="ide"> > <address bus="0x00" domain="0x0000" function="0x1" slot="0x01" type="pci"/> > </controller> > <controller index="0" ports="16" type="virtio-serial"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x05" type="pci"/> > </controller> > <video> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/> > <model heads="1" type="qxl" vram="32768"/> > </video> > <graphics autoport="yes" keymap="en-us" passwd="*****" passwdValidTo="1970-01-01T00:00:01" port="-1" tlsPort="-1" type="spice"> > <channel mode="secure" name="main"/> > <channel mode="secure" name="inputs"/> > <channel mode="secure" name="cursor"/> > <channel mode="secure" name="playback"/> > <channel mode="secure" name="record"/> > <channel mode="secure" name="display"/> > <channel mode="secure" name="usbredir"/> > <channel mode="secure" name="smartcard"/> > <listen network="vdsm-ovirtmgmt" type="network"/> > </graphics> > <interface type="bridge"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/> > <mac address="00:1a:4a:16:01:57"/> > <model type="virtio"/> > <source bridge="ovirtmgmt"/> > <filterref filter="vdsm-no-mac-spoofing"/> > <link state="up"/> > <bandwidth/> > </interface> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="1"/> > <source file="/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img" startupPolicy="optional"/> > <target bus="ide" dev="hdd"/> > <readonly/> > <serial/> > </disk> > <disk device="cdrom" snapshot="no" type="file"> > <address bus="1" controller="0" target="0" type="drive" unit="0"/> > <source file="" startupPolicy="optional"/> > <target bus="ide" dev="hdc"/> > <readonly/> > <serial/> > </disk> > <disk device="disk" snapshot="no" type="file"> > <address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/> > <source file="/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772"/> > <target bus="virtio" dev="vda"/> > <serial>99e5cda5-262b-4469-b336-04e3f0cf7c38</serial> > <driver cache="none" error_policy="stop" io="threads" name="qemu" type="raw"/> > </disk> > <channel type="spicevmc"> > <target name="com.redhat.spice.0" type="virtio"/> > </channel> > </devices> > <os> > <type arch="x86_64" machine="pc-1.0">hvm</type> > <smbios mode="sysinfo"/> > </os> > <sysinfo type="smbios"> > <system> > <entry name="manufacturer">oVirt</entry> > <entry name="product">oVirt Node</entry> > <entry name="version">20-3</entry> > <entry name="serial">4C4C4544-0048-3910-8046-B2C04F46354A</entry> > <entry name="uuid">14c0fa91-1814-438b-8d7a-4e7de1e1da25</entry> > </system> > </sysinfo> > <clock adjustment="0" offset="variable"> > <timer name="rtc" tickpolicy="catchup"/> > <timer name="pit" tickpolicy="delay"/> > <timer name="hpet" present="no"/> > </clock> > <features> > <acpi/> > </features> > <cpu match="exact"> > <model>SandyBridge</model> > <topology cores="1" sockets="16" threads="1"/> > </cpu> ></domain> > >Thread-10254::DEBUG::2014-08-11 17:48:26,200::task::595::Storage.TaskManager.Task::(_updateState) Task=`8407b259-256f-4113-a9ae-10efb0d8cb31`::moving from state init -> state preparing >Thread-10254::INFO::2014-08-11 17:48:26,200::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', leafUUID='041ad999-7aa9-4dcf-a3b1-bf962cc75c25') >Thread-10254::DEBUG::2014-08-11 17:48:26,200::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`2b4c32fa-681b-4636-8dfa-5ec7ae8266e5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3204' at 'prepareImage' >Thread-10254::DEBUG::2014-08-11 17:48:26,201::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10254::DEBUG::2014-08-11 17:48:26,201::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10254::DEBUG::2014-08-11 17:48:26,201::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`2b4c32fa-681b-4636-8dfa-5ec7ae8266e5`::Granted request >Thread-10254::DEBUG::2014-08-11 17:48:26,201::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8407b259-256f-4113-a9ae-10efb0d8cb31`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10254::DEBUG::2014-08-11 17:48:26,201::task::993::Storage.TaskManager.Task::(_decref) Task=`8407b259-256f-4113-a9ae-10efb0d8cb31`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:48:26,201::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,201::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) (543090) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:26,202::__init__::225::IOProcess::(_processLogs) (543090) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:26,216::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543090) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,216::__init__::225::IOProcess::(_processLogs) (543090) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,216::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,216::__init__::225::IOProcess::(_processLogs) Sending response sized 6355 >Thread-10254::DEBUG::2014-08-11 17:48:26,217::fileSD::497::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:48:26,217::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) (543091) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) (543091) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,218::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543091) Building response >Thread-10254::DEBUG::2014-08-11 17:48:26,218::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:48:26,219::__init__::225::IOProcess::(_processLogs) (543091) Queuing response >Thread-10254::WARNING::2014-08-11 17:48:26,219::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f already exists >Thread-19::DEBUG::2014-08-11 17:48:26,219::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10254::DEBUG::2014-08-11 17:48:26,220::fileSD::472::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 to /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 >Thread-19::DEBUG::2014-08-11 17:48:26,220::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10254::DEBUG::2014-08-11 17:48:26,220::fileSD::477::Storage.StorageDomain::(createImageLinks) img run dir already exists: /var/run/vdsm/storage/7158eae9-4886-4af7-af0b-d668ecee9e4f/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 >Thread-19::DEBUG::2014-08-11 17:48:26,221::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,221::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:26,221::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,221::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) (543092) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) (543092) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) (543092) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) (543092) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,222::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:48:26,223::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-10254::DEBUG::2014-08-11 17:48:26,223::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:48:26,223::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,223::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,223::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,223::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) (543093) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) (543093) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) (543093) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) (543093) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) Message size is 273 >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,224::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,225::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,225::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,225::__init__::225::IOProcess::(_processLogs) (543094) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,225::__init__::225::IOProcess::(_processLogs) (543094) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,225::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543094) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) (543094) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,226::__init__::225::IOProcess::(_processLogs) (543095) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,227::__init__::225::IOProcess::(_processLogs) (543095) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,227::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|(543095) Building response >Thread-10254::INFO::2014-08-11 17:48:26,227::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}]} >Thread-19::DEBUG::2014-08-11 17:48:26,227::__init__::225::IOProcess::(_processLogs) (543095) Queuing response >Thread-10254::DEBUG::2014-08-11 17:48:26,227::task::1191::Storage.TaskManager.Task::(prepare) Task=`8407b259-256f-4113-a9ae-10efb0d8cb31`::finished: {'info': {'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'imgVolumesInfo': [{'domainID': '7158eae9-4886-4af7-af0b-d668ecee9e4f', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'volumeID': u'041ad999-7aa9-4dcf-a3b1-bf962cc75c25', 'leasePath': u'/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease', 'imageID': 'a8e37c70-8fa4-46f7-bc12-f7b02e5b5856'}]} >Thread-19::DEBUG::2014-08-11 17:48:26,228::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10254::DEBUG::2014-08-11 17:48:26,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`8407b259-256f-4113-a9ae-10efb0d8cb31`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:48:26,228::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10254::DEBUG::2014-08-11 17:48:26,228::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10254::DEBUG::2014-08-11 17:48:26,229::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10254::DEBUG::2014-08-11 17:48:26,229::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10254::DEBUG::2014-08-11 17:48:26,229::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10254::DEBUG::2014-08-11 17:48:26,229::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10254::DEBUG::2014-08-11 17:48:26,229::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10254::DEBUG::2014-08-11 17:48:26,229::task::993::Storage.TaskManager.Task::(_decref) Task=`8407b259-256f-4113-a9ae-10efb0d8cb31`::ref 0 aborting False >Thread-10254::INFO::2014-08-11 17:48:26,229::clientIF::332::vds::(prepareVolumePath) prepared volume path: /rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856/041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >libvirtEventLoop::DEBUG::2014-08-11 17:48:26,648::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Started detail 2 opaque None >Thread-10254::DEBUG::2014-08-11 17:48:26,648::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3222898-73c3-419a-ad79-7935882c280e`::moving from state init -> state preparing >Thread-10254::INFO::2014-08-11 17:48:26,649::logUtils::44::dispatcher::(wrapper) Run and protect: teardownImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', volUUID=None) >libvirtEventLoop::DEBUG::2014-08-11 17:48:26,649::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Suspended detail 4 opaque None >Thread-10254::DEBUG::2014-08-11 17:48:26,650::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`d1dd56b7-1550-4229-ac60-4a5f0cb54d6e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3252' at 'teardownImage' >Thread-10254::DEBUG::2014-08-11 17:48:26,650::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10254::DEBUG::2014-08-11 17:48:26,650::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10254::DEBUG::2014-08-11 17:48:26,650::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`d1dd56b7-1550-4229-ac60-4a5f0cb54d6e`::Granted request >Thread-10254::DEBUG::2014-08-11 17:48:26,650::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a3222898-73c3-419a-ad79-7935882c280e`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10254::DEBUG::2014-08-11 17:48:26,650::task::993::Storage.TaskManager.Task::(_decref) Task=`a3222898-73c3-419a-ad79-7935882c280e`::ref 1 aborting False >Thread-10254::INFO::2014-08-11 17:48:26,650::logUtils::47::dispatcher::(wrapper) Run and protect: teardownImage, Return response: None >Thread-10254::DEBUG::2014-08-11 17:48:26,650::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3222898-73c3-419a-ad79-7935882c280e`::finished: None >Thread-10254::DEBUG::2014-08-11 17:48:26,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3222898-73c3-419a-ad79-7935882c280e`::moving from state preparing -> state finished >Thread-10254::DEBUG::2014-08-11 17:48:26,650::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-10254::DEBUG::2014-08-11 17:48:26,651::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10254::DEBUG::2014-08-11 17:48:26,651::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-10254::DEBUG::2014-08-11 17:48:26,651::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-10254::DEBUG::2014-08-11 17:48:26,651::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-10254::DEBUG::2014-08-11 17:48:26,651::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-10254::DEBUG::2014-08-11 17:48:26,651::task::993::Storage.TaskManager.Task::(_decref) Task=`a3222898-73c3-419a-ad79-7935882c280e`::ref 0 aborting False >Thread-10254::DEBUG::2014-08-11 17:48:26,666::vm::5190::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Looking for drive with attributes {'name': u'hdc', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'path': '', 'type': u'cdrom'} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5211::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Matched {'name': (u'hdc', u'hdc'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}), 'path': ('', ''), 'type': (u'cdrom', u'cdrom')} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5230::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Matched {'name': (u'hdc', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, None), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, None), 'path': ('', None), 'type': (u'cdrom', None)} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5190::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Looking for drive with attributes {'name': u'hdd', 'bootOrder': '', 'boot': [], 'readonly': True, 'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, 'path': u'/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img', 'type': u'cdrom'} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5211::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Matched {'name': (u'hdd', u'hdd'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, True), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}), 'path': (u'/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img', '/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img'), 'type': (u'cdrom', u'cdrom')} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5230::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Matched {'name': (u'hdd', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (True, None), 'address': ({u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'1'}, None), 'path': (u'/var/run/vdsm/payload/14c0fa91-1814-438b-8d7a-4e7de1e1da25.5bebcc8623a70ac89ee8e925a056295e.img', None), 'type': (u'cdrom', None)} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5190::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Looking for drive with attributes {'name': u'vda', 'bootOrder': '', 'boot': [], 'readonly': False, 'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, 'path': u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', 'type': u'disk'} >Thread-10254::DEBUG::2014-08-11 17:48:26,667::vm::5211::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Matched {'name': (u'vda', u'vda'), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, False), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}), 'path': (u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772'), 'type': (u'disk', u'disk')} >Thread-10254::DEBUG::2014-08-11 17:48:26,668::vm::5230::vm.Vm::(_getUnderlyingDriveInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Matched {'name': (u'vda', None), 'bootOrder': ('', None), 'boot': ([], None), 'readonly': (False, None), 'address': ({u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, None), 'path': (u'/rhev/data-center/00000002-0002-0002-0002-00000000037f/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/99e5cda5-262b-4469-b336-04e3f0cf7c38/3f8b5bbe-741b-4a4f-9397-84123d530772', None), 'type': (u'disk', None)} >Thread-10254::DEBUG::2014-08-11 17:48:26,709::vm::5666::vm.Vm::(_syncVolumeChain) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::vdsm chain: [u'3f8b5bbe-741b-4a4f-9397-84123d530772'], libvirt chain: [u'3f8b5bbe-741b-4a4f-9397-84123d530772'] >Thread-10254::DEBUG::2014-08-11 17:48:26,709::task::595::Storage.TaskManager.Task::(_updateState) Task=`196f9d62-52b7-4f9a-afe8-3cec20a5f0c9`::moving from state init -> state preparing >Thread-10254::INFO::2014-08-11 17:48:26,710::logUtils::44::dispatcher::(wrapper) Run and protect: imageSyncVolumeChain(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', newChain=[u'3f8b5bbe-741b-4a4f-9397-84123d530772']) >Thread-10254::DEBUG::2014-08-11 17:48:26,710::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38`ReqID=`3bda0f73-9999-47d0-9e2b-f9765b0242fc`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1821' at 'imageSyncVolumeChain' >Thread-10254::DEBUG::2014-08-11 17:48:26,710::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38' for lock type 'shared' >Thread-19::DEBUG::2014-08-11 17:48:26,710::__init__::225::IOProcess::(_processLogs) (543073) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,710::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:26,710::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) (543096) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) (543096) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:26,711::__init__::225::IOProcess::(_processLogs) DEBUG|(543096) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) (543096) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,712::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) (543097) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) (543097) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) (543097) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) (543097) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,713::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,714::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,714::__init__::225::IOProcess::(_processLogs) Message size is 236 >Thread-19::DEBUG::2014-08-11 17:48:26,714::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,714::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10254::DEBUG::2014-08-11 17:48:26,714::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-19::DEBUG::2014-08-11 17:48:26,714::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) (543098) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) (543098) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) (543098) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) (543098) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,715::__init__::225::IOProcess::(_processLogs) Message size is 273 >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) (543099) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) (543099) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,716::__init__::225::IOProcess::(_processLogs) (543099) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) (543099) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) Message size is 278 >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) (543100) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) (543100) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) (543100) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) (543100) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) Message size is 285 >Thread-19::DEBUG::2014-08-11 17:48:26,718::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,719::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,719::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,719::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,719::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,719::__init__::225::IOProcess::(_processLogs) (543101) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,719::__init__::225::IOProcess::(_processLogs) (543101) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,735::__init__::225::IOProcess::(_processLogs) DEBUG|(543101) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,735::__init__::225::IOProcess::(_processLogs) (543101) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,736::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,736::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-19::DEBUG::2014-08-11 17:48:26,736::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,736::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-19::DEBUG::2014-08-11 17:48:26,736::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) (543102) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) (543102) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) (543102) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) (543102) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,737::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,738::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,738::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-19::DEBUG::2014-08-11 17:48:26,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,738::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10254::DEBUG::2014-08-11 17:48:26,738::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-19::DEBUG::2014-08-11 17:48:26,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) (543103) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) (543103) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) (543103) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) (543103) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,739::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,740::__init__::225::IOProcess::(_processLogs) (543104) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) (543104) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) (543104) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) (543104) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,741::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) (543105) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) (543105) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) (543105) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) (543105) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,742::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) (543106) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,743::__init__::225::IOProcess::(_processLogs) (543106) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,744::__init__::225::IOProcess::(_processLogs) DEBUG|(543106) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,744::__init__::225::IOProcess::(_processLogs) (543106) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,744::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,745::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-19::DEBUG::2014-08-11 17:48:26,745::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,745::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-19::DEBUG::2014-08-11 17:48:26,745::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,745::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) (543107) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) (543107) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) (543107) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) (543107) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,746::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-19::DEBUG::2014-08-11 17:48:26,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,747::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10254::DEBUG::2014-08-11 17:48:26,747::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-19::DEBUG::2014-08-11 17:48:26,747::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) (543108) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) (543108) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) (543108) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) (543108) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-19::DEBUG::2014-08-11 17:48:26,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) (543109) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) (543109) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) (543109) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,749::__init__::225::IOProcess::(_processLogs) (543109) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) (543110) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) (543110) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) (543110) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) (543110) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-19::DEBUG::2014-08-11 17:48:26,751::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,752::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,752::__init__::225::IOProcess::(_processLogs) (543111) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,752::__init__::225::IOProcess::(_processLogs) (543111) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,753::__init__::225::IOProcess::(_processLogs) DEBUG|(543111) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,753::__init__::225::IOProcess::(_processLogs) (543111) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,753::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,754::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-19::DEBUG::2014-08-11 17:48:26,754::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,754::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-19::DEBUG::2014-08-11 17:48:26,754::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,754::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,754::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,755::__init__::225::IOProcess::(_processLogs) (543112) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,755::__init__::225::IOProcess::(_processLogs) (543112) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,756::__init__::225::IOProcess::(_processLogs) DEBUG|(543112) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,756::__init__::225::IOProcess::(_processLogs) (543112) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,756::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10254::INFO::2014-08-11 17:48:26,756::image::213::Storage.Image::(getChain) sdUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f imgUUID=99e5cda5-262b-4469-b336-04e3f0cf7c38 chain=[<storage.fileVolume.FileVolume object at 0x7f2d0d4da290>] >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,758::__init__::225::IOProcess::(_processLogs) (543113) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,758::__init__::225::IOProcess::(_processLogs) (543113) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,759::__init__::225::IOProcess::(_processLogs) DEBUG|(543113) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,759::__init__::225::IOProcess::(_processLogs) (543113) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,759::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,759::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-10254::DEBUG::2014-08-11 17:48:26,760::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772`ReqID=`5460cc54-e6a3-49dc-aa7f-28f93fa5be2b`::Request was made in '/usr/share/vdsm/storage/resourceFactories.py' line '172' at '__getResourceCandidatesList' >Thread-10254::DEBUG::2014-08-11 17:48:26,760::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772' for lock type 'shared' >Thread-10254::DEBUG::2014-08-11 17:48:26,760::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772' is free. Now locking as 'shared' (1 active user) >Thread-10254::DEBUG::2014-08-11 17:48:26,760::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772`ReqID=`5460cc54-e6a3-49dc-aa7f-28f93fa5be2b`::Granted request >Thread-10254::DEBUG::2014-08-11 17:48:26,760::resourceManager::601::Storage.ResourceManager::(registerResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38' is free. Now locking as 'shared' (1 active user) >Thread-10254::DEBUG::2014-08-11 17:48:26,761::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38`ReqID=`3bda0f73-9999-47d0-9e2b-f9765b0242fc`::Granted request >Thread-19::DEBUG::2014-08-11 17:48:26,761::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,761::__init__::225::IOProcess::(_processLogs) Message size is 193 >Thread-19::DEBUG::2014-08-11 17:48:26,761::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,761::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,761::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) (543114) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) (543114) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) (543114) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) (543114) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) Sending response sized 233 >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,762::__init__::225::IOProcess::(_processLogs) Message size is 206 >Thread-19::DEBUG::2014-08-11 17:48:26,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10254::DEBUG::2014-08-11 17:48:26,763::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 3f8b5bbe-741b-4a4f-9397-84123d530772 >Thread-19::DEBUG::2014-08-11 17:48:26,763::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) (543115) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) (543115) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) (543115) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) (543115) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,764::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) (543116) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) (543116) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) (543116) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) (543116) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,765::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) Message size is 248 >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,766::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) (543117) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) (543117) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) (543117) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) (543117) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,768::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,768::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,768::__init__::225::IOProcess::(_processLogs) (543118) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,768::__init__::225::IOProcess::(_processLogs) (543118) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,769::__init__::225::IOProcess::(_processLogs) DEBUG|(543118) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,769::__init__::225::IOProcess::(_processLogs) (543118) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,769::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,769::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-19::DEBUG::2014-08-11 17:48:26,769::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) Message size is 255 >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) (543119) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:48:26,770::__init__::225::IOProcess::(_processLogs) (543119) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:48:26,771::__init__::225::IOProcess::(_processLogs) DEBUG|(543119) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,771::__init__::225::IOProcess::(_processLogs) (543119) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,771::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10254::INFO::2014-08-11 17:48:26,772::image::213::Storage.Image::(getChain) sdUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f imgUUID=99e5cda5-262b-4469-b336-04e3f0cf7c38 chain=[<storage.fileVolume.FileVolume object at 0x7f2c804c6bd0>] >Thread-19::DEBUG::2014-08-11 17:48:26,772::__init__::225::IOProcess::(_processLogs) Sending response sized 404 >Thread-10254::DEBUG::2014-08-11 17:48:26,772::hsm::1829::Storage.HSM::(imageSyncVolumeChain) unlinking subchain: [] >Thread-10254::DEBUG::2014-08-11 17:48:26,772::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38' >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38' (0 active users) >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38' is free, finding out if anyone is waiting for it. >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772' >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772' (0 active users) >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772' is free, finding out if anyone is waiting for it. >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS.3f8b5bbe-741b-4a4f-9397-84123d530772', Clearing records. >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource '7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS.99e5cda5-262b-4469-b336-04e3f0cf7c38', Clearing records. >Thread-10254::INFO::2014-08-11 17:48:26,773::logUtils::47::dispatcher::(wrapper) Run and protect: imageSyncVolumeChain, Return response: None >Thread-10254::DEBUG::2014-08-11 17:48:26,773::task::1191::Storage.TaskManager.Task::(prepare) Task=`196f9d62-52b7-4f9a-afe8-3cec20a5f0c9`::finished: None >Thread-10254::DEBUG::2014-08-11 17:48:26,773::task::595::Storage.TaskManager.Task::(_updateState) Task=`196f9d62-52b7-4f9a-afe8-3cec20a5f0c9`::moving from state preparing -> state finished >Thread-10254::DEBUG::2014-08-11 17:48:26,773::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10254::DEBUG::2014-08-11 17:48:26,774::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10254::DEBUG::2014-08-11 17:48:26,774::task::993::Storage.TaskManager.Task::(_decref) Task=`196f9d62-52b7-4f9a-afe8-3cec20a5f0c9`::ref 0 aborting False >Thread-10254::DEBUG::2014-08-11 17:48:26,774::sampling::399::vm.Vm::(start) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Start statistics collection >Thread-10256::DEBUG::2014-08-11 17:48:26,774::sampling::428::vm.Vm::(run) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Stats thread started >Thread-10254::DEBUG::2014-08-11 17:48:26,775::vmchannels::199::vds::(register) Add fileno 50 to listener's channels. >Thread-10256::DEBUG::2014-08-11 17:48:26,775::task::595::Storage.TaskManager.Task::(_updateState) Task=`42d1b8a3-f415-4a4c-93c3-d58145b98d7a`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:48:26,775::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:48:26,776::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:26,776::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,776::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:26,776::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:26,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:26,777::__init__::225::IOProcess::(_processLogs) (543120) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:26,777::__init__::225::IOProcess::(_processLogs) (543120) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:26,777::__init__::225::IOProcess::(_processLogs) (543120) Building response >Thread-19::DEBUG::2014-08-11 17:48:26,777::__init__::225::IOProcess::(_processLogs) (543120) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:26,778::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,778::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:48:26,778::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:48:26,778::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:26,778::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10254::DEBUG::2014-08-11 17:48:26,778::vm::2254::vm.Vm::(_startUnderlyingVm) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::_ongoingCreations released >Thread-19::DEBUG::2014-08-11 17:48:26,779::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:26,779::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::INFO::2014-08-11 17:48:26,779::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:48:26,780::__init__::225::IOProcess::(_processLogs) (543121) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:48:26,780::task::1191::Storage.TaskManager.Task::(prepare) Task=`42d1b8a3-f415-4a4c-93c3-d58145b98d7a`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:48:26,781::__init__::225::IOProcess::(_processLogs) (543121) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:48:26,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`42d1b8a3-f415-4a4c-93c3-d58145b98d7a`::moving from state preparing -> state finished >Thread-10256::DEBUG::2014-08-11 17:48:26,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:48:26,781::__init__::225::IOProcess::(_processLogs) (543121) Building response >Thread-10256::DEBUG::2014-08-11 17:48:26,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:48:26,782::__init__::225::IOProcess::(_processLogs) (543121) Queuing response >Thread-10256::DEBUG::2014-08-11 17:48:26,782::task::993::Storage.TaskManager.Task::(_decref) Task=`42d1b8a3-f415-4a4c-93c3-d58145b98d7a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:48:26,782::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:26,783::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >libvirtEventLoop::DEBUG::2014-08-11 17:48:26,787::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Resumed detail 0 opaque None >libvirtEventLoop::DEBUG::2014-08-11 17:48:26,788::vm::5350::vm.Vm::(_onLibvirtLifecycleEvent) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::event Resumed detail 0 opaque None >Thread-10254::DEBUG::2014-08-11 17:48:26,797::vm::3959::vm.Vm::(_waitForIncomingMigrationFinish) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::End of migration >Thread-10256::DEBUG::2014-08-11 17:48:26,816::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-08-11 17:48:27,292::vmchannels::107::vds::(_do_add_channels) fileno 50 was added to unconnected channels. >VM Channels Listener::DEBUG::2014-08-11 17:48:27,292::vmchannels::133::vds::(_handle_unconnected) Trying to connect fileno 50. >VM Channels Listener::DEBUG::2014-08-11 17:48:27,292::guestagent::199::vm.Vm::(_connect) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Attempting connection to /var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-08-11 17:48:27,292::guestagent::202::vm.Vm::(_connect) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Connected to /var/lib/libvirt/qemu/channels/14c0fa91-1814-438b-8d7a-4e7de1e1da25.com.redhat.rhevm.vdsm >VM Channels Listener::DEBUG::2014-08-11 17:48:27,293::vmchannels::149::vds::(_handle_unconnected) Connecting to fileno 50 succeeded. >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:27,548::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:27,548::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:27,549::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) (543122) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:27,604::__init__::225::IOProcess::(_processLogs) (543122) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:27,605::__init__::225::IOProcess::(_processLogs) (543122) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:27,605::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:48:27,605::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:48:27,666::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000953056 s, 384 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) (543123) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:27,667::__init__::225::IOProcess::(_processLogs) (543123) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:27,668::__init__::225::IOProcess::(_processLogs) (543123) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:27,668::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:48:27,822::BindingXMLRPC::1127::vds::(wrapper) client [10.35.1.234]::call vmGetStats with ('14c0fa91-1814-438b-8d7a-4e7de1e1da25',) {} flowID [6c840493] >Thread-10237::DEBUG::2014-08-11 17:48:27,822::BindingXMLRPC::1134::vds::(wrapper) return vmGetStats with {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up', 'displayInfo': [{'tlsPort': u'5902', 'ipAddress': '10.35.0.105', 'type': 'spice', 'port': '-1'}], 'hash': '-4515992575005208697', 'acpiEnable': 'true', 'guestFQDN': '', 'pid': '22424', 'displayIp': '10.35.0.105', 'displayPort': '-1', 'session': 'Unknown', 'displaySecurePort': u'5902', 'timeOffset': '0', 'memUsage': '0', 'balloonInfo': {'balloon_max': '1048576', 'balloon_target': '0', 'balloon_cur': '0', 'balloon_min': '1048576'}, 'clientIp': '', 'elapsedTime': '15886', 'kvmEnable': 'true', 'network': {}, 'vmId': '14c0fa91-1814-438b-8d7a-4e7de1e1da25', 'vmType': 'kvm', 'cpuUser': '0.00', 'disks': {u'vda': {'readLatency': '0', 'apparentsize': '10737418240', 'writeLatency': '0', 'imageID': '99e5cda5-262b-4469-b336-04e3f0cf7c38', 'flushLatency': '0', 'truesize': '512'}, u'hdd': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}, u'hdc': {'flushLatency': '0', 'readLatency': '0', 'truesize': '0', 'apparentsize': '0', 'writeLatency': '0'}}, 'monitorResponse': '0', 'statsAge': '1.05', 'username': 'Unknown', 'displayType': 'qxl', 'cpuSys': '0.00', 'guestCPUCount': -1, 'appsList': [], 'guestIPs': ''}]} >Thread-10197::DEBUG::2014-08-11 17:48:28,093::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [1aa273ac] >Thread-10197::DEBUG::2014-08-11 17:48:28,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:28,094::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='a8e37c70-8fa4-46f7-bc12-f7b02e5b5856', postZero='false', force='false') >Thread-10197::DEBUG::2014-08-11 17:48:28,094::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`5cb5ade3-022f-4358-8592-cd9f3677d517`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1497' at 'deleteImage' >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'exclusive' >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'exclusive' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`5cb5ade3-022f-4358-8592-cd9f3677d517`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:28,095::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_resourcesAcquired: Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f (exclusive) >Thread-10197::DEBUG::2014-08-11 17:48:28,095::task::993::Storage.TaskManager.Task::(_decref) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::ref 1 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`10075a9b-4c38-434f-8b24-0c3431eb3244`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1498' at 'deleteImage' >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:28,095::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`10075a9b-4c38-434f-8b24-0c3431eb3244`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:28,096::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:28,096::task::993::Storage.TaskManager.Task::(_decref) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:48:28,096::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:48:28,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,097::__init__::225::IOProcess::(_processLogs) (543124) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:28,097::__init__::225::IOProcess::(_processLogs) (543124) Got request for method 'glob' >Dummy-51::DEBUG::2014-08-11 17:48:28,101::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:28,158::__init__::225::IOProcess::(_processLogs) (543124) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,159::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,159::__init__::225::IOProcess::(_processLogs) Sending response sized 6355 >Thread-10197::DEBUG::2014-08-11 17:48:28,162::fileSD::372::Storage.StorageDomain::(deleteImage) Renaming dir /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 to /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remooWxLov >Thread-10197::WARNING::2014-08-11 17:48:28,162::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,162::__init__::225::IOProcess::(_processLogs) Message size is 383 >Thread-19::DEBUG::2014-08-11 17:48:28,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,163::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,163::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,163::__init__::225::IOProcess::(_processLogs) (543125) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,163::__init__::225::IOProcess::(_processLogs) (543125) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,223::__init__::225::IOProcess::(_processLogs) (543125) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,223::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:48:28,224::fileSD::381::Storage.StorageDomain::(deleteImage) Removing file: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remooWxLov/041ad999-7aa9-4dcf-a3b1-bf962cc75c25 >Thread-19::DEBUG::2014-08-11 17:48:28,225::__init__::225::IOProcess::(_processLogs) Message size is 237 >Thread-19::DEBUG::2014-08-11 17:48:28,225::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,226::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,226::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,227::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,227::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,228::__init__::225::IOProcess::(_processLogs) (543126) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,228::__init__::225::IOProcess::(_processLogs) (543126) Got request for method 'unlink' >Dummy-51::DEBUG::2014-08-11 17:48:28,229::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0702074 s, 14.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:28,244::__init__::225::IOProcess::(_processLogs) (543126) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,244::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:48:28,245::fileSD::384::Storage.StorageDomain::(deleteImage) Removing file: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remooWxLov/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.meta >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) Message size is 242 >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) (543127) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,245::__init__::225::IOProcess::(_processLogs) (543127) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,258::__init__::225::IOProcess::(_processLogs) (543127) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,258::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,258::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,258::fileSD::387::Storage.StorageDomain::(deleteImage) Removing file: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remooWxLov/041ad999-7aa9-4dcf-a3b1-bf962cc75c25.lease >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,260::__init__::225::IOProcess::(_processLogs) (543128) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,260::__init__::225::IOProcess::(_processLogs) (543128) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,271::__init__::225::IOProcess::(_processLogs) DEBUG|(543128) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,271::__init__::225::IOProcess::(_processLogs) (543128) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,271::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10197::DEBUG::2014-08-11 17:48:28,271::fileSD::392::Storage.StorageDomain::(deleteImage) Removing directory: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remooWxLov >Thread-19::DEBUG::2014-08-11 17:48:28,271::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,272::__init__::225::IOProcess::(_processLogs) (543129) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,273::__init__::225::IOProcess::(_processLogs) (543129) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,283::__init__::225::IOProcess::(_processLogs) DEBUG|(543129) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,283::__init__::225::IOProcess::(_processLogs) (543129) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,283::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,283::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) Message size is 73 >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,284::__init__::225::IOProcess::(_processLogs) (543130) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) (543130) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) (543130) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) (543130) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) Message size is 77 >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) (543131) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) (543131) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) (543131) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) (543131) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,286::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) Message size is 89 >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) (543132) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) (543132) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,287::__init__::225::IOProcess::(_processLogs) (543132) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) (543132) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,288::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) (543133) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) (543133) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) (543133) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) (543133) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,289::__init__::225::IOProcess::(_processLogs) Message size is 135 >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) (543134) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) (543134) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) (543134) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,290::__init__::225::IOProcess::(_processLogs) (543134) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) (543135) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,291::__init__::225::IOProcess::(_processLogs) (543135) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) DEBUG|(543135) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) (543135) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,292::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) (543136) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) (543136) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) DEBUG|(543136) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) (543136) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,293::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Message size is 185 >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) (543137) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,294::__init__::225::IOProcess::(_processLogs) (543137) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,305::__init__::225::IOProcess::(_processLogs) DEBUG|(543137) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,305::__init__::225::IOProcess::(_processLogs) (543137) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,305::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) (543138) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,306::__init__::225::IOProcess::(_processLogs) (543138) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,307::__init__::225::IOProcess::(_processLogs) DEBUG|(543138) Building response >Thread-10197::DEBUG::2014-08-11 17:48:28,307::task::752::Storage.TaskManager.Task::(_save) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c.temp >Thread-19::DEBUG::2014-08-11 17:48:28,307::__init__::225::IOProcess::(_processLogs) (543138) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,307::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) (543139) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,308::__init__::225::IOProcess::(_processLogs) (543139) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) DEBUG|(543139) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) (543139) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,309::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) (543140) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) (543140) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) (543140) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) (543140) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,310::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) (543141) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,311::__init__::225::IOProcess::(_processLogs) (543141) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,317::__init__::225::IOProcess::(_processLogs) DEBUG|(543141) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,317::__init__::225::IOProcess::(_processLogs) (543141) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,317::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,319::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,319::__init__::225::IOProcess::(_processLogs) (543142) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,319::__init__::225::IOProcess::(_processLogs) (543142) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,342::__init__::225::IOProcess::(_processLogs) DEBUG|(543142) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,342::__init__::225::IOProcess::(_processLogs) (543142) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,342::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,342::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,342::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) (543143) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) (543143) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543143) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,343::__init__::225::IOProcess::(_processLogs) (543143) Queuing response >Thread-10197::WARNING::2014-08-11 17:48:28,343::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,344::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,344::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) (543143) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) (543144) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,345::__init__::225::IOProcess::(_processLogs) (543144) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,354::__init__::225::IOProcess::(_processLogs) (543144) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,354::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:48:28,354::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,355::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:28,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,355::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,355::__init__::225::IOProcess::(_processLogs) (543145) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,356::__init__::225::IOProcess::(_processLogs) (543145) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,367::__init__::225::IOProcess::(_processLogs) (543145) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,367::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,367::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) (543146) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,368::__init__::225::IOProcess::(_processLogs) (543146) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) (543146) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,375::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,376::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,376::__init__::225::IOProcess::(_processLogs) (543147) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,376::__init__::225::IOProcess::(_processLogs) (543147) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,394::__init__::225::IOProcess::(_processLogs) (543147) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,394::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,394::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,394::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:28,394::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,395::__init__::225::IOProcess::(_processLogs) (543148) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:28,395::__init__::225::IOProcess::(_processLogs) (543148) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:28,398::__init__::225::IOProcess::(_processLogs) (543148) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,398::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,398::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,398::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job deleteImage_a8e37c70-8fa4-46f7-bc12-f7b02e5b5856 for task 924b5ab1-5479-4d41-a5b3-e436dbbee96c >Thread-10197::INFO::2014-08-11 17:48:28,398::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-10197::DEBUG::2014-08-11 17:48:28,398::task::1183::Storage.TaskManager.Task::(prepare) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::Prepare: 1 jobs exist, move to acquiring >Thread-10197::DEBUG::2014-08-11 17:48:28,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) (543149) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,399::__init__::225::IOProcess::(_processLogs) (543149) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) (543149) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,400::task::752::Storage.TaskManager.Task::(_save) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c.temp >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,401::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,401::__init__::225::IOProcess::(_processLogs) (543150) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,401::__init__::225::IOProcess::(_processLogs) (543150) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,401::__init__::225::IOProcess::(_processLogs) (543150) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,402::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,402::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,402::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,402::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,402::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,402::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) (543151) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) (543151) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) (543151) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) (543151) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,403::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,404::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,404::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,404::__init__::225::IOProcess::(_processLogs) (543152) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,404::__init__::225::IOProcess::(_processLogs) (543152) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,412::__init__::225::IOProcess::(_processLogs) (543152) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,413::__init__::225::IOProcess::(_processLogs) (543153) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,414::__init__::225::IOProcess::(_processLogs) (543153) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,436::__init__::225::IOProcess::(_processLogs) (543153) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,436::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,436::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:28,436::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,437::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,437::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,437::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,437::__init__::225::IOProcess::(_processLogs) (543154) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,437::__init__::225::IOProcess::(_processLogs) (543154) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,454::__init__::225::IOProcess::(_processLogs) (543154) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,454::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,454::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,454::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,454::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10197::WARNING::2014-08-11 17:48:28,455::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) (543155) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) (543155) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) (543155) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) (543155) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,456::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,457::__init__::225::IOProcess::(_processLogs) (543156) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,457::__init__::225::IOProcess::(_processLogs) (543156) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,467::__init__::225::IOProcess::(_processLogs) (543156) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,467::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:48:28,467::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) (543157) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,468::__init__::225::IOProcess::(_processLogs) (543157) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,478::__init__::225::IOProcess::(_processLogs) (543157) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,478::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,478::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,478::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,478::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,479::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,479::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,479::__init__::225::IOProcess::(_processLogs) (543158) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,479::__init__::225::IOProcess::(_processLogs) (543158) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,481::__init__::225::IOProcess::(_processLogs) (543158) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,481::__init__::225::IOProcess::(_processLogs) Sending response sized 99 >Thread-19::DEBUG::2014-08-11 17:48:28,481::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:28,481::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,481::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,481::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) (543159) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) (543159) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) (543159) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) (543159) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,482::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,483::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,483::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,483::__init__::225::IOProcess::(_processLogs) (543160) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,483::__init__::225::IOProcess::(_processLogs) (543160) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,494::__init__::225::IOProcess::(_processLogs) DEBUG|(543160) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,494::__init__::225::IOProcess::(_processLogs) (543160) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,494::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,494::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,494::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,494::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) (543161) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,495::__init__::225::IOProcess::(_processLogs) (543161) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,505::__init__::225::IOProcess::(_processLogs) (543161) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,505::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) (543162) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) (543162) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:28,506::__init__::225::IOProcess::(_processLogs) (543162) Queuing response >Thread-10197::DEBUG::2014-08-11 17:48:28,507::task::595::Storage.TaskManager.Task::(_updateState) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-08-11 17:48:28,507::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,507::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,507::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) (543163) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) (543163) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) (543163) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,508::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,508::task::752::Storage.TaskManager.Task::(_save) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c.temp >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) (543164) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,509::__init__::225::IOProcess::(_processLogs) (543164) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,510::__init__::225::IOProcess::(_processLogs) (543164) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,510::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,510::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,510::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,510::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) (543165) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) (543165) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) (543165) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) (543165) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,512::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,512::__init__::225::IOProcess::(_processLogs) (543166) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,512::__init__::225::IOProcess::(_processLogs) (543166) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,518::__init__::225::IOProcess::(_processLogs) (543166) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,518::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,519::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:48:28,519::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,519::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,520::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,520::__init__::225::IOProcess::(_processLogs) (543167) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,520::__init__::225::IOProcess::(_processLogs) (543167) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,538::__init__::225::IOProcess::(_processLogs) (543167) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,538::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,538::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:28,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,538::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,539::__init__::225::IOProcess::(_processLogs) (543168) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,539::__init__::225::IOProcess::(_processLogs) (543168) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,560::__init__::225::IOProcess::(_processLogs) (543168) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,560::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,560::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,560::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::WARNING::2014-08-11 17:48:28,560::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,561::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,561::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,561::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) (543169) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) (543169) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) (543169) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) (543169) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,562::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,563::__init__::225::IOProcess::(_processLogs) (543170) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,563::__init__::225::IOProcess::(_processLogs) (543170) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,570::__init__::225::IOProcess::(_processLogs) (543170) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,570::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:48:28,570::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) (543171) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,571::__init__::225::IOProcess::(_processLogs) (543171) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,585::__init__::225::IOProcess::(_processLogs) (543171) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,585::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) (543172) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,586::__init__::225::IOProcess::(_processLogs) (543172) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,588::__init__::225::IOProcess::(_processLogs) (543172) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,589::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:48:28,589::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:28,589::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,589::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,589::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) (543173) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) (543173) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) (543173) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) (543173) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:28,590::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,591::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,591::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,591::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,591::__init__::225::IOProcess::(_processLogs) (543174) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,591::__init__::225::IOProcess::(_processLogs) (543174) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,599::__init__::225::IOProcess::(_processLogs) (543174) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,599::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) (543175) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:28,600::__init__::225::IOProcess::(_processLogs) (543175) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) (543175) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) (543175) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) (543176) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,601::__init__::225::IOProcess::(_processLogs) (543176) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,606::__init__::225::IOProcess::(_processLogs) (543176) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,606::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) (543177) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,607::__init__::225::IOProcess::(_processLogs) (543177) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,612::__init__::225::IOProcess::(_processLogs) (543177) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,612::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) (543178) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) (543178) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:28,613::__init__::225::IOProcess::(_processLogs) (543178) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,614::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,614::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 924b5ab1-5479-4d41-a5b3-e436dbbee96c >Thread-10197::DEBUG::2014-08-11 17:48:28,614::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 924b5ab1-5479-4d41-a5b3-e436dbbee96c >d1919e29-2350-4faa-8241-34d8964ddb72::DEBUG::2014-08-11 17:48:28,614::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-10197::DEBUG::2014-08-11 17:48:28,615::task::1188::Storage.TaskManager.Task::(prepare) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::returning >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,615::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 924b5ab1-5479-4d41-a5b3-e436dbbee96c running: <bound method Task.commit of <storage.task.Task instance at 0x7f2d10fe35a8>> with: None >Thread-10197::DEBUG::2014-08-11 17:48:28,615::task::993::Storage.TaskManager.Task::(_decref) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::ref 0 aborting False >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,615::task::1200::Storage.TaskManager.Task::(commit) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::committing task: 924b5ab1-5479-4d41-a5b3-e436dbbee96c >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,616::task::595::Storage.TaskManager.Task::(_updateState) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::moving from state queued -> state running >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) (543179) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) (543179) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,617::__init__::225::IOProcess::(_processLogs) (543179) Queuing response >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,618::task::752::Storage.TaskManager.Task::(_save) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c.temp >Thread-19::DEBUG::2014-08-11 17:48:28,618::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,618::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,618::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) (543180) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) (543180) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) (543180) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,619::__init__::225::IOProcess::(_processLogs) (543180) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,620::__init__::225::IOProcess::(_processLogs) (543181) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) (543181) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) (543181) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) (543181) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,621::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,622::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,622::__init__::225::IOProcess::(_processLogs) (543182) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,622::__init__::225::IOProcess::(_processLogs) (543182) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) (543182) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,630::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,631::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,631::__init__::225::IOProcess::(_processLogs) (543183) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,631::__init__::225::IOProcess::(_processLogs) (543183) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543183) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,648::__init__::225::IOProcess::(_processLogs) (543183) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,648::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,648::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,649::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,649::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:28,649::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,649::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,649::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,649::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,650::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,650::__init__::225::IOProcess::(_processLogs) (543184) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,650::__init__::225::IOProcess::(_processLogs) (543184) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,662::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543184) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) (543184) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,663::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::WARNING::2014-08-11 17:48:28,664::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,664::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,664::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) (543185) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) (543185) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) (543185) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) (543185) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,666::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,666::__init__::225::IOProcess::(_processLogs) (543186) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,666::__init__::225::IOProcess::(_processLogs) (543186) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,673::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543186) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,673::__init__::225::IOProcess::(_processLogs) (543186) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,673::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::WARNING::2014-08-11 17:48:28,673::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,674::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,674::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,674::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) (543187) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,675::__init__::225::IOProcess::(_processLogs) (543187) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,692::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543187) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,692::__init__::225::IOProcess::(_processLogs) (543187) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,692::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,693::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,694::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,694::__init__::225::IOProcess::(_processLogs) (543188) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,694::__init__::225::IOProcess::(_processLogs) (543188) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543188) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,711::__init__::225::IOProcess::(_processLogs) (543188) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,711::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:48:28,711::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,711::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) (543189) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) (543189) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:28,712::__init__::225::IOProcess::(_processLogs) (543189) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) (543189) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,713::__init__::225::IOProcess::(_processLogs) (543190) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,714::__init__::225::IOProcess::(_processLogs) (543190) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543190) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,737::__init__::225::IOProcess::(_processLogs) (543190) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,737::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,738::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,738::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,738::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:28,739::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::DEBUG::2014-08-11 17:48:28,739::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [1aa273ac] >Thread-19::DEBUG::2014-08-11 17:48:28,740::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10197::DEBUG::2014-08-11 17:48:28,740::task::595::Storage.TaskManager.Task::(_updateState) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:48:28,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::INFO::2014-08-11 17:48:28,741::logUtils::44::dispatcher::(wrapper) Run and protect: deleteImage(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='812042c3-6adc-4cf2-aaf4-e3f90efd5e5f', postZero='false', force='false') >Thread-19::DEBUG::2014-08-11 17:48:28,742::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10197::DEBUG::2014-08-11 17:48:28,743::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`e670424f-8019-4c21-a41a-79b9a83e82a5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1497' at 'deleteImage' >Thread-19::DEBUG::2014-08-11 17:48:28,743::__init__::225::IOProcess::(_processLogs) (543191) Finding callback 'stat'... >Thread-10197::DEBUG::2014-08-11 17:48:28,743::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'exclusive' >Thread-19::DEBUG::2014-08-11 17:48:28,744::__init__::225::IOProcess::(_processLogs) (543191) Got request for method 'stat' >Thread-10197::DEBUG::2014-08-11 17:48:28,744::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f' is free. Now locking as 'exclusive' (1 active user) >Thread-19::DEBUG::2014-08-11 17:48:28,744::__init__::225::IOProcess::(_processLogs) (543191) Building response >Thread-10197::DEBUG::2014-08-11 17:48:28,745::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`e670424f-8019-4c21-a41a-79b9a83e82a5`::Granted request >Thread-19::DEBUG::2014-08-11 17:48:28,745::__init__::225::IOProcess::(_processLogs) (543191) Queuing response >Thread-10197::DEBUG::2014-08-11 17:48:28,746::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_resourcesAcquired: Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f (exclusive) >Thread-19::DEBUG::2014-08-11 17:48:28,746::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:48:28,746::task::993::Storage.TaskManager.Task::(_decref) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:48:28,746::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:28,747::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-10197::DEBUG::2014-08-11 17:48:28,747::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`b4676cc7-3450-41bd-8de1-78d5b4f1839f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1498' at 'deleteImage' >Thread-10197::DEBUG::2014-08-11 17:48:28,748::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' for lock type 'shared' >Thread-19::DEBUG::2014-08-11 17:48:28,748::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-10197::DEBUG::2014-08-11 17:48:28,749::resourceManager::566::Storage.ResourceManager::(registerResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' found in shared state and queue is empty, Joining current shared lock (2 active users) >Thread-19::DEBUG::2014-08-11 17:48:28,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::DEBUG::2014-08-11 17:48:28,749::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f`ReqID=`b4676cc7-3450-41bd-8de1-78d5b4f1839f`::Granted request >Thread-19::DEBUG::2014-08-11 17:48:28,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::DEBUG::2014-08-11 17:48:28,750::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_resourcesAcquired: Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f (shared) >Thread-19::DEBUG::2014-08-11 17:48:28,751::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10197::DEBUG::2014-08-11 17:48:28,751::task::993::Storage.TaskManager.Task::(_decref) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:48:28,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) (543192) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) (543192) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) Message size is 198 >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) (543193) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:48:28,752::__init__::225::IOProcess::(_processLogs) (543193) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:48:28,754::__init__::225::IOProcess::(_processLogs) (543192) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,754::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) (543194) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,755::__init__::225::IOProcess::(_processLogs) (543194) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,766::__init__::225::IOProcess::(_processLogs) (543194) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,766::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) (543195) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:28,767::__init__::225::IOProcess::(_processLogs) (543195) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:28,768::__init__::225::IOProcess::(_processLogs) (543195) Queuing response >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,768::task::905::Storage.TaskManager.Task::(_runJobs) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::Task.run: running job 0: deleteImage_a8e37c70-8fa4-46f7-bc12-f7b02e5b5856: <function <lambda> at 0x7f2c804da410> (args: () kwargs: {}) >Thread-19::DEBUG::2014-08-11 17:48:28,768::__init__::225::IOProcess::(_processLogs) Generating json... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,768::task::331::Storage.TaskManager.Task::(run) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::Job.run: running deleteImage_a8e37c70-8fa4-46f7-bc12-f7b02e5b5856: <function <lambda> at 0x7f2c804da410> (args: () kwargs: {}) callback None >Thread-19::DEBUG::2014-08-11 17:48:28,769::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::moving from state running -> state finished >Thread-19::DEBUG::2014-08-11 17:48:28,769::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,769::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,769::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,770::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,770::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,770::__init__::225::IOProcess::(_processLogs) (543196) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,770::__init__::225::IOProcess::(_processLogs) (543196) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,770::__init__::225::IOProcess::(_processLogs) (543196) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,770::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,770::task::752::Storage.TaskManager.Task::(_save) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/924b5ab1-5479-4d41-a5b3-e436dbbee96c.temp >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) (543197) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,771::__init__::225::IOProcess::(_processLogs) (543197) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,772::__init__::225::IOProcess::(_processLogs) (543197) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,772::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) (543198) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,773::__init__::225::IOProcess::(_processLogs) (543198) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) (543198) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) (543198) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,776::__init__::225::IOProcess::(_processLogs) (543199) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,776::__init__::225::IOProcess::(_processLogs) (543199) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,777::__init__::225::IOProcess::(_processLogs) (543193) Building response >Thread-10197::DEBUG::2014-08-11 17:48:28,778::fileSD::372::Storage.StorageDomain::(deleteImage) Renaming dir /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/812042c3-6adc-4cf2-aaf4-e3f90efd5e5f to /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remo3krxgc >Thread-19::DEBUG::2014-08-11 17:48:28,778::__init__::225::IOProcess::(_processLogs) (543193) Queuing response >Thread-10197::WARNING::2014-08-11 17:48:28,778::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,779::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,779::__init__::225::IOProcess::(_processLogs) Sending response sized 6145 >Thread-19::DEBUG::2014-08-11 17:48:28,779::__init__::225::IOProcess::(_processLogs) Message size is 383 >Thread-19::DEBUG::2014-08-11 17:48:28,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,780::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,780::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,780::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,780::__init__::225::IOProcess::(_processLogs) (543200) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,780::__init__::225::IOProcess::(_processLogs) (543200) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,787::__init__::225::IOProcess::(_processLogs) (543200) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,788::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,788::fileSD::381::Storage.StorageDomain::(deleteImage) Removing file: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remo3krxgc/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff >Thread-19::DEBUG::2014-08-11 17:48:28,788::__init__::225::IOProcess::(_processLogs) (543199) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,789::__init__::225::IOProcess::(_processLogs) Message size is 237 >Thread-19::DEBUG::2014-08-11 17:48:28,789::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,789::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,789::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) (543201) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) (543201) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,790::__init__::225::IOProcess::(_processLogs) (543202) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,791::__init__::225::IOProcess::(_processLogs) (543202) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,802::__init__::225::IOProcess::(_processLogs) (543201) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,802::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,802::fileSD::384::Storage.StorageDomain::(deleteImage) Removing file: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remo3krxgc/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.meta >Thread-19::DEBUG::2014-08-11 17:48:28,803::__init__::225::IOProcess::(_processLogs) Message size is 242 >Thread-19::DEBUG::2014-08-11 17:48:28,803::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,803::__init__::225::IOProcess::(_processLogs) (543203) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,804::__init__::225::IOProcess::(_processLogs) (543203) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,815::__init__::225::IOProcess::(_processLogs) (543203) Queuing response >Thread-10197::DEBUG::2014-08-11 17:48:28,815::fileSD::387::Storage.StorageDomain::(deleteImage) Removing file: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remo3krxgc/cd41aaf7-4ca5-4c68-bbdc-1ae1690705ff.lease >Thread-19::DEBUG::2014-08-11 17:48:28,815::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,815::__init__::225::IOProcess::(_processLogs) Message size is 243 >Thread-19::DEBUG::2014-08-11 17:48:28,815::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,816::__init__::225::IOProcess::(_processLogs) (543204) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,816::__init__::225::IOProcess::(_processLogs) (543204) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,821::__init__::225::IOProcess::(_processLogs) (543202) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,821::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,821::__init__::225::IOProcess::(_processLogs) Message size is 338 >Thread-19::DEBUG::2014-08-11 17:48:28,821::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,822::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,822::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,822::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,822::__init__::225::IOProcess::(_processLogs) (543205) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,822::__init__::225::IOProcess::(_processLogs) (543205) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,829::__init__::225::IOProcess::(_processLogs) (543204) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,829::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,829::fileSD::392::Storage.StorageDomain::(deleteImage) Removing directory: /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/images/_remo3krxgc >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) (543206) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,830::__init__::225::IOProcess::(_processLogs) (543206) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,840::__init__::225::IOProcess::(_processLogs) (543206) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,840::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) Message size is 73 >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) (543207) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) (543207) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,841::__init__::225::IOProcess::(_processLogs) (543207) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) (543207) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Message size is 77 >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) (543208) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) (543208) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,842::__init__::225::IOProcess::(_processLogs) (543208) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,843::__init__::225::IOProcess::(_processLogs) (543208) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,843::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,843::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,843::__init__::225::IOProcess::(_processLogs) Message size is 89 >Thread-19::DEBUG::2014-08-11 17:48:28,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) (543209) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) (543209) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) (543209) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) (543209) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) Message size is 126 >Thread-19::DEBUG::2014-08-11 17:48:28,844::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) (543210) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) (543210) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) (543210) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) (543210) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,845::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) Message size is 135 >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) (543211) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) (543211) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) (543211) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,846::__init__::225::IOProcess::(_processLogs) (543211) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,847::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,847::__init__::225::IOProcess::(_processLogs) (543205) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,847::__init__::225::IOProcess::(_processLogs) (543205) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,847::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) Message size is 142 >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) (543212) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) (543212) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,848::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) (543213) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) (543213) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) (543212) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,849::__init__::225::IOProcess::(_processLogs) (543212) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Message size is 148 >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) (543214) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,850::__init__::225::IOProcess::(_processLogs) (543214) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) DEBUG|(543214) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) (543214) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) Sending response sized 64 >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) Message size is 185 >Thread-19::DEBUG::2014-08-11 17:48:28,851::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,852::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,852::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,852::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,852::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,852::__init__::225::IOProcess::(_processLogs) (543215) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,852::__init__::225::IOProcess::(_processLogs) (543215) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,875::__init__::225::IOProcess::(_processLogs) DEBUG|(543213) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,875::__init__::225::IOProcess::(_processLogs) (543213) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,875::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,875::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,875::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,876::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,876::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,876::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,876::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,876::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::WARNING::2014-08-11 17:48:28,876::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) (543216) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) (543216) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) (543216) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) (543216) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) (543215) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) (543215) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,877::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,878::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:28,878::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,878::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,878::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,878::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:28,878::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) (543217) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) (543217) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,879::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,880::__init__::225::IOProcess::(_processLogs) (543218) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,880::__init__::225::IOProcess::(_processLogs) (543218) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,890::__init__::225::IOProcess::(_processLogs) (543218) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,890::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,890::task::752::Storage.TaskManager.Task::(_save) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4.temp >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) (543219) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,891::__init__::225::IOProcess::(_processLogs) (543219) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,897::__init__::225::IOProcess::(_processLogs) (543217) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,897::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >924b5ab1-5479-4d41-a5b3-e436dbbee96c::WARNING::2014-08-11 17:48:28,897::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) (543220) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) (543220) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,898::__init__::225::IOProcess::(_processLogs) (543219) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) (543219) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,899::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) (543221) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) (543221) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) (543221) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) (543221) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,900::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,901::__init__::225::IOProcess::(_processLogs) (543222) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,901::__init__::225::IOProcess::(_processLogs) (543222) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,904::__init__::225::IOProcess::(_processLogs) (543220) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,904::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) (543223) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,905::__init__::225::IOProcess::(_processLogs) (543223) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,906::__init__::225::IOProcess::(_processLogs) (543223) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,906::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:48:28,906::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:48:28,906::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,906::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) (543224) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) (543224) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) (543224) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,907::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) (543225) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,908::__init__::225::IOProcess::(_processLogs) (543225) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,910::__init__::225::IOProcess::(_processLogs) (543222) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,910::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) (543226) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,911::__init__::225::IOProcess::(_processLogs) (543226) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:28,918::__init__::225::IOProcess::(_processLogs) (543225) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,918::__init__::225::IOProcess::(_processLogs) (543225) Queuing responseDEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,918::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) (543225) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,919::__init__::225::IOProcess::(_processLogs) (543227) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) (543227) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) (543227) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) (543227) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,920::__init__::225::IOProcess::(_processLogs) (543228) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:28,921::__init__::225::IOProcess::(_processLogs) (543228) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:28,929::__init__::225::IOProcess::(_processLogs) (543228) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) (543229) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,930::__init__::225::IOProcess::(_processLogs) (543229) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,937::__init__::225::IOProcess::(_processLogs) (543226) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) (543230) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,938::__init__::225::IOProcess::(_processLogs) (543230) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,943::__init__::225::IOProcess::(_processLogs) (543229) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,943::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:48:28,943::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,944::__init__::225::IOProcess::(_processLogs) (543230) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,944::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,944::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:28,944::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:28,945::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,945::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,945::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,945::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,945::__init__::225::IOProcess::(_processLogs) (543231) Finding callback 'lexists'... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,945::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>, 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:48:28,946::__init__::225::IOProcess::(_processLogs) (543231) Got request for method 'lexists' >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:48:28,946::__init__::225::IOProcess::(_processLogs) (543231) Building response >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,947::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-19::DEBUG::2014-08-11 17:48:28,947::__init__::225::IOProcess::(_processLogs) (543231) Queuing response >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,947::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (1 active users) >Thread-19::DEBUG::2014-08-11 17:48:28,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,948::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,948::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-19::DEBUG::2014-08-11 17:48:28,949::__init__::225::IOProcess::(_processLogs) Receiving request... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,949::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >Thread-19::DEBUG::2014-08-11 17:48:28,949::__init__::225::IOProcess::(_processLogs) Message size is 311 >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,950::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-08-11 17:48:28,950::__init__::225::IOProcess::(_processLogs) Marshaling message... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,950::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.a8e37c70-8fa4-46f7-bc12-f7b02e5b5856_7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >Thread-19::DEBUG::2014-08-11 17:48:28,950::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,951::__init__::225::IOProcess::(_processLogs) Waiting for next request... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,951::task::916::Storage.TaskManager.Task::(_runJobs) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::Task.run: exit - success: result True >Thread-19::DEBUG::2014-08-11 17:48:28,951::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,952::task::993::Storage.TaskManager.Task::(_decref) Task=`924b5ab1-5479-4d41-a5b3-e436dbbee96c`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:48:28,952::__init__::225::IOProcess::(_processLogs) Extracting request information... >924b5ab1-5479-4d41-a5b3-e436dbbee96c::DEBUG::2014-08-11 17:48:28,952::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Thread-19::DEBUG::2014-08-11 17:48:28,953::__init__::225::IOProcess::(_processLogs) (543232) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,953::__init__::225::IOProcess::(_processLogs) (543232) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,954::__init__::225::IOProcess::(_processLogs) (543232) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::WARNING::2014-08-11 17:48:28,955::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,955::__init__::225::IOProcess::(_processLogs) (543233) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:28,956::__init__::225::IOProcess::(_processLogs) (543233) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) (543233) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,964::__init__::225::IOProcess::(_processLogs) (543234) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,964::__init__::225::IOProcess::(_processLogs) (543234) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:28,966::__init__::225::IOProcess::(_processLogs) (543234) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,966::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) (543235) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,967::__init__::225::IOProcess::(_processLogs) (543235) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:28,974::__init__::225::IOProcess::(_processLogs) (543235) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,974::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) (543236) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:28,975::__init__::225::IOProcess::(_processLogs) (543236) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:28,976::__init__::225::IOProcess::(_processLogs) (543236) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,976::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:28,976::taskManager::78::Storage.TaskManager::(scheduleJob) scheduled job deleteImage_812042c3-6adc-4cf2-aaf4-e3f90efd5e5f for task 28435af6-8b8c-43f9-9d73-5ff28ee984c4 >Thread-10197::INFO::2014-08-11 17:48:28,976::logUtils::47::dispatcher::(wrapper) Run and protect: deleteImage, Return response: None >Thread-10197::DEBUG::2014-08-11 17:48:28,976::task::1183::Storage.TaskManager.Task::(prepare) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::Prepare: 1 jobs exist, move to acquiring >Thread-10197::DEBUG::2014-08-11 17:48:28,977::task::595::Storage.TaskManager.Task::(_updateState) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::moving from state preparing -> state acquiring >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) (543237) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) (543237) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,977::__init__::225::IOProcess::(_processLogs) (543237) Queuing response >Thread-10197::DEBUG::2014-08-11 17:48:28,978::task::752::Storage.TaskManager.Task::(_save) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4.temp >Thread-19::DEBUG::2014-08-11 17:48:28,978::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,978::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,978::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,978::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,978::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) (543238) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) (543238) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) (543238) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,979::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) (543239) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) (543239) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) (543239) Building response >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) (543239) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,980::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) (543240) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:28,981::__init__::225::IOProcess::(_processLogs) (543240) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:28,993::__init__::225::IOProcess::(_processLogs) (543240) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:28,993::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) (543241) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:28,994::__init__::225::IOProcess::(_processLogs) (543241) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,013::__init__::225::IOProcess::(_processLogs) (543241) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,013::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,013::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:29,013::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,014::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,014::__init__::225::IOProcess::(_processLogs) (543242) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,014::__init__::225::IOProcess::(_processLogs) (543242) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,035::__init__::225::IOProcess::(_processLogs) (543242) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,035::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,035::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,035::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,035::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::WARNING::2014-08-11 17:48:29,036::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) (543243) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) (543243) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) (543243) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) (543243) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,037::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,038::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,038::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,038::__init__::225::IOProcess::(_processLogs) (543244) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,038::__init__::225::IOProcess::(_processLogs) (543244) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,044::__init__::225::IOProcess::(_processLogs) (543244) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,044::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:48:29,044::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,045::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:29,045::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,045::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,045::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,045::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,045::__init__::225::IOProcess::(_processLogs) (543245) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,046::__init__::225::IOProcess::(_processLogs) (543245) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) (543245) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,066::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,067::__init__::225::IOProcess::(_processLogs) (543246) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,067::__init__::225::IOProcess::(_processLogs) (543246) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,075::__init__::225::IOProcess::(_processLogs) (543246) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,075::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,076::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:29,076::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,076::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,076::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,076::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) (543247) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) (543247) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) (543247) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) (543247) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,078::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,078::__init__::225::IOProcess::(_processLogs) (543248) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,078::__init__::225::IOProcess::(_processLogs) (543248) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,085::__init__::225::IOProcess::(_processLogs) (543248) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,085::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,085::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:29,085::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,085::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,086::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,086::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,086::__init__::225::IOProcess::(_processLogs) (543249) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,086::__init__::225::IOProcess::(_processLogs) (543249) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:29,094::__init__::225::IOProcess::(_processLogs) (543249) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,094::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,094::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:29,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,095::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,095::__init__::225::IOProcess::(_processLogs) (543250) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:29,095::__init__::225::IOProcess::(_processLogs) (543250) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:29,095::__init__::225::IOProcess::(_processLogs) (543250) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,095::__init__::225::IOProcess::(_processLogs) (543250) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,095::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:29,095::task::595::Storage.TaskManager.Task::(_updateState) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::moving from state acquiring -> state queued >Thread-19::DEBUG::2014-08-11 17:48:29,096::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:29,096::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10197::DEBUG::2014-08-11 17:48:29,096::task::752::Storage.TaskManager.Task::(_save) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4.temp >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) (543251) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) (543251) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) (543251) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) (543251) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,097::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) (543252) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) (543252) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) (543252) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,098::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) (543253) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,099::__init__::225::IOProcess::(_processLogs) (543253) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) (543253) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) (543253) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) (543254) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,100::__init__::225::IOProcess::(_processLogs) (543254) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:29,111::__init__::225::IOProcess::(_processLogs) (543254) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,111::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) (543255) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,112::__init__::225::IOProcess::(_processLogs) (543255) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,127::__init__::225::IOProcess::(_processLogs) DEBUG|(543255) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,127::__init__::225::IOProcess::(_processLogs) (543255) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,127::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) (543256) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,128::__init__::225::IOProcess::(_processLogs) (543256) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,146::__init__::225::IOProcess::(_processLogs) (543256) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,146::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,146::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,147::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,147::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,147::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,147::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::WARNING::2014-08-11 17:48:29,147::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,148::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,148::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,148::__init__::225::IOProcess::(_processLogs) (543257) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,148::__init__::225::IOProcess::(_processLogs) (543257) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,148::__init__::225::IOProcess::(_processLogs) (543257) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,148::__init__::225::IOProcess::(_processLogs) (543257) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) (543258) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,149::__init__::225::IOProcess::(_processLogs) (543258) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,157::__init__::225::IOProcess::(_processLogs) (543258) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,158::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::WARNING::2014-08-11 17:48:29,158::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,158::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:29,158::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,158::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,158::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,159::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,159::__init__::225::IOProcess::(_processLogs) (543259) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,159::__init__::225::IOProcess::(_processLogs) (543259) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,169::__init__::225::IOProcess::(_processLogs) (543259) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,169::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,169::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,170::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,170::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,170::__init__::225::IOProcess::(_processLogs) (543260) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,170::__init__::225::IOProcess::(_processLogs) (543260) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,172::__init__::225::IOProcess::(_processLogs) (543260) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,172::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:48:29,172::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) (543261) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) (543261) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) (543261) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) (543261) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,173::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) (543262) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,174::__init__::225::IOProcess::(_processLogs) (543262) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,177::__init__::225::IOProcess::(_processLogs) (543262) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,178::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,178::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:48:29,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) (543263) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) (543263) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) (543263) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) (543263) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:29,179::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,180::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,180::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,180::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,180::__init__::225::IOProcess::(_processLogs) (543264) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,180::__init__::225::IOProcess::(_processLogs) (543264) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,188::__init__::225::IOProcess::(_processLogs) (543264) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,188::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,188::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:29,188::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,189::__init__::225::IOProcess::(_processLogs) (543265) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,189::__init__::225::IOProcess::(_processLogs) (543265) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:29,197::__init__::225::IOProcess::(_processLogs) (543265) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,197::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) (543266) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) (543266) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) (543266) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,198::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10197::DEBUG::2014-08-11 17:48:29,199::taskManager::56::Storage.TaskManager::(_queueTask) queuing task: 28435af6-8b8c-43f9-9d73-5ff28ee984c4 >Thread-10197::DEBUG::2014-08-11 17:48:29,199::taskManager::64::Storage.TaskManager::(_queueTask) task queued: 28435af6-8b8c-43f9-9d73-5ff28ee984c4 >e7b5e918-f0f7-4123-b4a4-0ca147dc4752::DEBUG::2014-08-11 17:48:29,199::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 1 >Thread-10197::DEBUG::2014-08-11 17:48:29,200::task::1188::Storage.TaskManager.Task::(prepare) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::returning >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,200::threadPool::200::Storage.ThreadPool.WorkerThread::(_processNextTask) Task: 28435af6-8b8c-43f9-9d73-5ff28ee984c4 running: <bound method Task.commit of <storage.task.Task instance at 0x7f2d10fe9cf8>> with: None >Thread-10197::DEBUG::2014-08-11 17:48:29,200::task::993::Storage.TaskManager.Task::(_decref) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::ref 0 aborting False >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,200::task::1200::Storage.TaskManager.Task::(commit) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::committing task: 28435af6-8b8c-43f9-9d73-5ff28ee984c4 >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,201::task::595::Storage.TaskManager.Task::(_updateState) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::moving from state queued -> state running >Thread-19::DEBUG::2014-08-11 17:48:29,201::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:29,201::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) (543267) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) (543267) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) (543267) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,202::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,202::task::752::Storage.TaskManager.Task::(_save) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4.temp >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) (543268) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) (543268) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,203::__init__::225::IOProcess::(_processLogs) (543268) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) (543269) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) (543269) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) (543269) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) (543269) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,206::__init__::225::IOProcess::(_processLogs) (543270) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,206::__init__::225::IOProcess::(_processLogs) (543270) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:29,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543270) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,211::__init__::225::IOProcess::(_processLogs) (543270) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Message size is 648 >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,213::__init__::225::IOProcess::(_processLogs) (543271) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,213::__init__::225::IOProcess::(_processLogs) (543271) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543271) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,230::__init__::225::IOProcess::(_processLogs) (543271) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,230::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,230::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) (543272) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,231::__init__::225::IOProcess::(_processLogs) (543272) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543272) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,257::__init__::225::IOProcess::(_processLogs) (543272) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,257::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,257::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,258::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Marshaling message... >28435af6-8b8c-43f9-9d73-5ff28ee984c4::WARNING::2014-08-11 17:48:29,258::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,258::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) (543273) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) (543273) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) (543273) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) (543273) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,259::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) (543274) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,260::__init__::225::IOProcess::(_processLogs) (543274) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,287::__init__::225::IOProcess::(_processLogs) (543274) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,287::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >28435af6-8b8c-43f9-9d73-5ff28ee984c4::WARNING::2014-08-11 17:48:29,287::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,288::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:29,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,288::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,289::__init__::225::IOProcess::(_processLogs) (543275) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,289::__init__::225::IOProcess::(_processLogs) (543275) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,316::__init__::225::IOProcess::(_processLogs) (543275) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,316::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,318::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,319::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,319::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,320::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,321::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,321::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,322::__init__::225::IOProcess::(_processLogs) (543276) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,322::__init__::225::IOProcess::(_processLogs) (543276) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,322::__init__::225::IOProcess::(_processLogs) (543276) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,323::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,324::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:48:29,324::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:48:29,325::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,325::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,325::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,327::__init__::225::IOProcess::(_processLogs) (543277) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,327::__init__::225::IOProcess::(_processLogs) (543277) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,327::__init__::225::IOProcess::(_processLogs) (543277) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,327::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) (543278) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,328::__init__::225::IOProcess::(_processLogs) (543278) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,336::__init__::225::IOProcess::(_processLogs) (543278) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,336::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) (543279) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,337::__init__::225::IOProcess::(_processLogs) (543279) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) (543279) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) (543279) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,339::__init__::225::IOProcess::(_processLogs) (543280) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,339::__init__::225::IOProcess::(_processLogs) (543280) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,344::__init__::225::IOProcess::(_processLogs) (543280) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,344::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,344::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:29,344::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,344::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,344::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,345::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,345::__init__::225::IOProcess::(_processLogs) (543281) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,345::__init__::225::IOProcess::(_processLogs) (543281) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:29,352::__init__::225::IOProcess::(_processLogs) (543281) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,352::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) (543282) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) (543282) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:29,353::__init__::225::IOProcess::(_processLogs) (543282) Queuing response >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,354::task::905::Storage.TaskManager.Task::(_runJobs) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::Task.run: running job 0: deleteImage_812042c3-6adc-4cf2-aaf4-e3f90efd5e5f: <function <lambda> at 0x7f2c804da488> (args: () kwargs: {}) >Thread-19::DEBUG::2014-08-11 17:48:29,354::__init__::225::IOProcess::(_processLogs) Generating json... >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,354::task::331::Storage.TaskManager.Task::(run) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::Job.run: running deleteImage_812042c3-6adc-4cf2-aaf4-e3f90efd5e5f: <function <lambda> at 0x7f2c804da488> (args: () kwargs: {}) callback None >Thread-19::DEBUG::2014-08-11 17:48:29,354::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::moving from state running -> state finished >Thread-19::DEBUG::2014-08-11 17:48:29,355::__init__::225::IOProcess::(_processLogs) Message size is 184 >Thread-19::DEBUG::2014-08-11 17:48:29,355::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,355::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,355::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,355::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,356::__init__::225::IOProcess::(_processLogs) (543283) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,356::__init__::225::IOProcess::(_processLogs) (543283) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,356::__init__::225::IOProcess::(_processLogs) (543283) Queuing response >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,356::task::752::Storage.TaskManager.Task::(_save) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::_save: orig /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4 temp /rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/master/tasks/28435af6-8b8c-43f9-9d73-5ff28ee984c4.temp >Thread-19::DEBUG::2014-08-11 17:48:29,356::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) (543284) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) (543284) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,357::__init__::225::IOProcess::(_processLogs) (543284) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,358::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,358::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:29,358::__init__::225::IOProcess::(_processLogs) Message size is 189 >Thread-19::DEBUG::2014-08-11 17:48:29,358::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,358::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,358::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) (543285) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) (543285) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) (543285) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) (543285) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Sending response sized 77 >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Message size is 190 >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,359::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,360::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,360::__init__::225::IOProcess::(_processLogs) (543286) Finding callback 'mkdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,360::__init__::225::IOProcess::(_processLogs) (543286) Got request for method 'mkdir' >Thread-19::DEBUG::2014-08-11 17:48:29,370::__init__::225::IOProcess::(_processLogs) (543286) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,370::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,370::__init__::225::IOProcess::(_processLogs) Message size is 652 >Thread-19::DEBUG::2014-08-11 17:48:29,371::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,371::__init__::225::IOProcess::(_processLogs) (543287) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,371::__init__::225::IOProcess::(_processLogs) (543287) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,394::__init__::225::IOProcess::(_processLogs) (543287) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,394::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,394::__init__::225::IOProcess::(_processLogs) Message size is 338 >Thread-19::DEBUG::2014-08-11 17:48:29,395::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,395::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,395::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,395::__init__::225::IOProcess::(_processLogs) (543288) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,395::__init__::225::IOProcess::(_processLogs) (543288) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,413::__init__::225::IOProcess::(_processLogs) (543288) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,414::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:48:29,414::__init__::225::IOProcess::(_processLogs) Message size is 421 >Thread-19::DEBUG::2014-08-11 17:48:29,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,415::__init__::225::IOProcess::(_processLogs) (543289) Finding callback 'writefile'... >Thread-19::DEBUG::2014-08-11 17:48:29,415::__init__::225::IOProcess::(_processLogs) (543289) Got request for method 'writefile' >Thread-19::DEBUG::2014-08-11 17:48:29,489::__init__::225::IOProcess::(_processLogs) (543289) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,489::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,489::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,489::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,489::__init__::225::IOProcess::(_processLogs) Waiting for next request... >28435af6-8b8c-43f9-9d73-5ff28ee984c4::WARNING::2014-08-11 17:48:29,489::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,490::__init__::225::IOProcess::(_processLogs) (543290) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) (543290) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) (543290) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) (543290) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Sending response sized 74 >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Message size is 311 >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,491::__init__::225::IOProcess::(_processLogs) (543291) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,492::__init__::225::IOProcess::(_processLogs) (543291) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,503::__init__::225::IOProcess::(_processLogs) (543291) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,503::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >28435af6-8b8c-43f9-9d73-5ff28ee984c4::WARNING::2014-08-11 17:48:29,503::outOfProcess::221::oop::(rename) renaming a directory is not an atomic operation >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) Message size is 309 >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) (543292) Finding callback 'rename'... >Thread-19::DEBUG::2014-08-11 17:48:29,504::__init__::225::IOProcess::(_processLogs) (543292) Got request for method 'rename' >Thread-19::DEBUG::2014-08-11 17:48:29,514::__init__::225::IOProcess::(_processLogs) DEBUG|(543292) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,514::__init__::225::IOProcess::(_processLogs) (543292) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,514::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) Message size is 181 >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) (543293) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,515::__init__::225::IOProcess::(_processLogs) (543293) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:48:29,516::__init__::225::IOProcess::(_processLogs) DEBUG|(543293) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,516::__init__::225::IOProcess::(_processLogs) (543293) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,516::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) Sending response sized 144 >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) Message size is 221 >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,517::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) (543294) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) (543294) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) (543294) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) (543294) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) Message size is 223 >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,518::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,519::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,519::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,519::__init__::225::IOProcess::(_processLogs) (543295) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,519::__init__::225::IOProcess::(_processLogs) (543295) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,528::__init__::225::IOProcess::(_processLogs) DEBUG|(543295) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,528::__init__::225::IOProcess::(_processLogs) (543295) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,528::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,529::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,529::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,529::__init__::225::IOProcess::(_processLogs) Message size is 220 >Thread-19::DEBUG::2014-08-11 17:48:29,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,529::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) (543296) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) (543296) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) (543296) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) (543296) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,530::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) Message size is 222 >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) (543297) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:48:29,531::__init__::225::IOProcess::(_processLogs) (543297) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:48:29,536::__init__::225::IOProcess::(_processLogs) DEBUG|(543297) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,536::__init__::225::IOProcess::(_processLogs) (543297) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,536::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,536::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,536::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,536::__init__::225::IOProcess::(_processLogs) Message size is 179 >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) (543298) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:48:29,537::__init__::225::IOProcess::(_processLogs) (543298) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:48:29,546::__init__::225::IOProcess::(_processLogs) DEBUG|(543298) Building response >Thread-19::DEBUG::2014-08-11 17:48:29,546::__init__::225::IOProcess::(_processLogs) (543298) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:29,546::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) (543299) Finding callback 'lexists'... >Thread-19::DEBUG::2014-08-11 17:48:29,547::__init__::225::IOProcess::(_processLogs) (543299) Got request for method 'lexists' >Thread-19::DEBUG::2014-08-11 17:48:29,548::__init__::225::IOProcess::(_processLogs) DEBUG|(543299) Building response >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,548::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>, 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f': < ResourceRef 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', isValid: 'True' obj: 'None'>} >Thread-19::DEBUG::2014-08-11 17:48:29,548::__init__::225::IOProcess::(_processLogs) (543299) Queuing response >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,548::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:48:29,549::__init__::225::IOProcess::(_processLogs) Generating json... >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,549::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f' >Thread-19::DEBUG::2014-08-11 17:48:29,549::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.812042c3-6adc-4cf2-aaf4-e3f90efd5e5f_7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' (0 active users) >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f' is free, finding out if anyone is waiting for it. >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.7158eae9-4886-4af7-af0b-d668ecee9e4f', Clearing records. >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,550::task::916::Storage.TaskManager.Task::(_runJobs) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::Task.run: exit - success: result True >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,551::task::993::Storage.TaskManager.Task::(_decref) Task=`28435af6-8b8c-43f9-9d73-5ff28ee984c4`::ref 0 aborting False >28435af6-8b8c-43f9-9d73-5ff28ee984c4::DEBUG::2014-08-11 17:48:29,551::threadPool::57::Storage.ThreadPool::(setRunningTask) Number of running tasks: 0 >Dummy-51::DEBUG::2014-08-11 17:48:30,236::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:30,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0217117 s, 47.2 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:48:32,325::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:32,402::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0167235 s, 61.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:32,552::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:32,554::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:32,556::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) (543300) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) (543300) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:33,474::__init__::225::IOProcess::(_processLogs) DEBUG|(543300) Building response >Thread-19::DEBUG::2014-08-11 17:48:33,475::__init__::225::IOProcess::(_processLogs) (543300) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:33,475::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:33,475::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:48:33,475::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:48:33,534::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000405662 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:33,535::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:33,535::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:33,535::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:33,535::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) (543301) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) (543301) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) (543301) Building response >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) (543301) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:33,536::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:33,537::__init__::225::IOProcess::(_processLogs) (543302) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) (543302) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) (543302) Building response >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) (543302) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:33,538::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) (543303) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) (543303) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) (543303) Building response >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) (543303) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:33,539::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:33,540::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:48:33,540::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:33,540::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:33,540::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:33,540::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:33,540::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:33,541::__init__::225::IOProcess::(_processLogs) (543304) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:33,541::__init__::225::IOProcess::(_processLogs) (543304) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:33,541::__init__::225::IOProcess::(_processLogs) (543304) Building response >Thread-19::DEBUG::2014-08-11 17:48:33,541::__init__::225::IOProcess::(_processLogs) (543304) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:33,541::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:33,541::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:48:34,300::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:48:34,464::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:34,536::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013439 s, 76.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:48:34,558::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:48:34,559::task::595::Storage.TaskManager.Task::(_updateState) Task=`895b9335-073a-4c89-a833-300ff3c151b2`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:34,559::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:48:34,574::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:34,574::task::1191::Storage.TaskManager.Task::(prepare) Task=`895b9335-073a-4c89-a833-300ff3c151b2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:34,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`895b9335-073a-4c89-a833-300ff3c151b2`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:34,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:34,574::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:34,574::task::993::Storage.TaskManager.Task::(_decref) Task=`895b9335-073a-4c89-a833-300ff3c151b2`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:34,584::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:48:34,585::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e11d2f0-9d9a-4295-8cf1-31bbb4cca09b`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:34,585::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:48:34,585::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4971b2f8-a3c0-4b60-b0b6-48a2fc042e13`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:48:34,585::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:34,585::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:34,585::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4971b2f8-a3c0-4b60-b0b6-48a2fc042e13`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:34,586::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9e11d2f0-9d9a-4295-8cf1-31bbb4cca09b`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:34,586::task::993::Storage.TaskManager.Task::(_decref) Task=`9e11d2f0-9d9a-4295-8cf1-31bbb4cca09b`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:48:34,602::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:34,602::task::1191::Storage.TaskManager.Task::(prepare) Task=`9e11d2f0-9d9a-4295-8cf1-31bbb4cca09b`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:34,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`9e11d2f0-9d9a-4295-8cf1-31bbb4cca09b`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:48:34,602::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:48:34,602::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:48:34,602::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:48:34,602::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:48:34,602::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:48:34,602::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:48:34,603::task::993::Storage.TaskManager.Task::(_decref) Task=`9e11d2f0-9d9a-4295-8cf1-31bbb4cca09b`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:48:35,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`546ce1ff-a6f5-4607-be7a-c5b83c169550`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:35,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:48:35,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000953056', 'lastCheck': '7.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405662', 'lastCheck': '1.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:35,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`546ce1ff-a6f5-4607-be7a-c5b83c169550`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000953056', 'lastCheck': '7.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000405662', 'lastCheck': '1.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:35,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`546ce1ff-a6f5-4607-be7a-c5b83c169550`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:35,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:35,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:35,418::task::993::Storage.TaskManager.Task::(_decref) Task=`546ce1ff-a6f5-4607-be7a-c5b83c169550`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:48:35,431::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:36,544::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:36,617::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.015289 s, 67.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:37,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:37,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:37,563::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:37,669::__init__::225::IOProcess::(_processLogs) (543305) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:37,670::__init__::225::IOProcess::(_processLogs) (543305) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:37,670::__init__::225::IOProcess::(_processLogs) DEBUG|(543305) Building response >Thread-19::DEBUG::2014-08-11 17:48:37,670::__init__::225::IOProcess::(_processLogs) (543305) Queuing response >Thread-27::DEBUG::2014-08-11 17:48:37,670::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:37,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:37,729::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:48:37,730::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000579175 s, 632 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) (543306) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:37,731::__init__::225::IOProcess::(_processLogs) (543306) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:37,732::__init__::225::IOProcess::(_processLogs) DEBUG|(543306) Building response >Thread-19::DEBUG::2014-08-11 17:48:37,732::__init__::225::IOProcess::(_processLogs) (543306) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:37,732::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:37,733::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:48:38,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:38,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0365496 s, 28.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:48:40,671::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:48:40,748::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:40,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0592797 s, 17.3 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:48:41,824::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:42,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:42,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:42,566::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:42,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:42,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014095 s, 72.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:43,541::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:43,541::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:43,541::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:43,541::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:43,542::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:43,542::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:43,542::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:43,542::__init__::225::IOProcess::(_processLogs) (543307) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:43,542::__init__::225::IOProcess::(_processLogs) (543307) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:43,542::__init__::225::IOProcess::(_processLogs) DEBUG|(543307) Building response >Thread-28::DEBUG::2014-08-11 17:48:43,543::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:43,543::__init__::225::IOProcess::(_processLogs) (543307) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:43,602::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:43,602::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:48:43,603::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00104112 s, 475 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:43,603::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) (543308) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) (543308) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:43,604::__init__::225::IOProcess::(_processLogs) DEBUG|(543308) Building response >Thread-19::DEBUG::2014-08-11 17:48:43,605::__init__::225::IOProcess::(_processLogs) (543308) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:43,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:43,605::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:43,605::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:43,605::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) (543309) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) (543309) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) (543309) Building response >Thread-19::DEBUG::2014-08-11 17:48:43,606::__init__::225::IOProcess::(_processLogs) (543309) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:43,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) (543310) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) (543310) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) (543310) Building response >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) (543310) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:43,608::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) (543311) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:43,609::__init__::225::IOProcess::(_processLogs) (543311) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:43,610::__init__::225::IOProcess::(_processLogs) (543311) Building response >Thread-19::DEBUG::2014-08-11 17:48:43,610::__init__::225::IOProcess::(_processLogs) (543311) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:43,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:43,610::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:48:44,660::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:48:44,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`86a4a586-86c2-4597-aa87-049cae615fec`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:44,661::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:48:44,729::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:44,729::task::1191::Storage.TaskManager.Task::(prepare) Task=`86a4a586-86c2-4597-aa87-049cae615fec`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:44,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`86a4a586-86c2-4597-aa87-049cae615fec`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:44,729::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:44,729::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:44,729::task::993::Storage.TaskManager.Task::(_decref) Task=`86a4a586-86c2-4597-aa87-049cae615fec`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:44,736::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:48:44,736::task::595::Storage.TaskManager.Task::(_updateState) Task=`2303a680-6447-4b34-9d31-8b6f35304fbc`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:44,736::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:48:44,736::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9889f832-e5b6-4b5c-89cf-939574d8011c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:48:44,736::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:44,737::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:44,737::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9889f832-e5b6-4b5c-89cf-939574d8011c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:44,737::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2303a680-6447-4b34-9d31-8b6f35304fbc`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:44,737::task::993::Storage.TaskManager.Task::(_decref) Task=`2303a680-6447-4b34-9d31-8b6f35304fbc`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:48:44,767::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:44,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`2303a680-6447-4b34-9d31-8b6f35304fbc`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:44,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`2303a680-6447-4b34-9d31-8b6f35304fbc`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:48:44,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:48:44,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:48:44,768::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:48:44,768::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:48:44,768::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:48:44,768::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:48:44,768::task::993::Storage.TaskManager.Task::(_decref) Task=`2303a680-6447-4b34-9d31-8b6f35304fbc`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:48:44,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:45,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0130218 s, 78.6 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:48:47,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:47,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0499833 s, 20.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:47,569::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:47,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:47,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:48:47,733::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) (543312) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:47,734::__init__::225::IOProcess::(_processLogs) (543312) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:47,735::__init__::225::IOProcess::(_processLogs) DEBUG|(543312) Building response >Thread-19::DEBUG::2014-08-11 17:48:47,735::__init__::225::IOProcess::(_processLogs) (543312) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:47,735::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:47,736::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:48:47,736::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:48:47,807::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00223458 s, 164 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:47,807::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) (543313) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:47,808::__init__::225::IOProcess::(_processLogs) (543313) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:47,810::__init__::225::IOProcess::(_processLogs) DEBUG|(543313) Building response >Thread-19::DEBUG::2014-08-11 17:48:47,810::__init__::225::IOProcess::(_processLogs) (543313) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:47,810::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:48:47,810::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:48:49,154::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:49,280::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0664264 s, 15.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:48:50,335::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:48:50,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:48:50,339::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:48:50,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`adb9593f-646e-4c41-adc7-3aa6ed0a637b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:50,655::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:48:50,656::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00223458', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104112', 'lastCheck': '7.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:50,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`adb9593f-646e-4c41-adc7-3aa6ed0a637b`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00223458', 'lastCheck': '2.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00104112', 'lastCheck': '7.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:48:50,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`adb9593f-646e-4c41-adc7-3aa6ed0a637b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:50,656::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:50,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:50,656::task::993::Storage.TaskManager.Task::(_decref) Task=`adb9593f-646e-4c41-adc7-3aa6ed0a637b`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:48:50,676::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:48:50,677::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:51,288::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:51,368::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0213642 s, 47.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:52,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:52,576::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:52,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:53,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:53,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.065126 s, 15.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:53,609::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) (543314) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:53,610::__init__::225::IOProcess::(_processLogs) (543314) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:53,611::__init__::225::IOProcess::(_processLogs) DEBUG|(543314) Building response >Thread-19::DEBUG::2014-08-11 17:48:53,611::__init__::225::IOProcess::(_processLogs) (543314) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:53,611::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:48:53,611::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:53,612::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:48:53,674::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00216889 s, 228 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:53,675::__init__::225::IOProcess::(_processLogs) (543315) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:53,676::__init__::225::IOProcess::(_processLogs) (543315) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:53,677::__init__::225::IOProcess::(_processLogs) DEBUG|(543315) Building response >Thread-19::DEBUG::2014-08-11 17:48:53,677::__init__::225::IOProcess::(_processLogs) (543315) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:53,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:53,677::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:48:53,678::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:53,678::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:48:53,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:53,678::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:53,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:53,678::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) (543316) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) (543316) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) (543316) Building response >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) (543316) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:53,679::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) DEBUG|(543317) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:53,680::__init__::225::IOProcess::(_processLogs) (543317) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) (543317) Building response >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) (543317) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:53,681::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:53,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:53,682::__init__::225::IOProcess::(_processLogs) (543318) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:48:53,682::__init__::225::IOProcess::(_processLogs) (543318) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:48:53,682::__init__::225::IOProcess::(_processLogs) (543318) Building response >Thread-19::DEBUG::2014-08-11 17:48:53,682::__init__::225::IOProcess::(_processLogs) (543318) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:53,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:48:53,683::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:48:54,814::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:48:54,814::task::595::Storage.TaskManager.Task::(_updateState) Task=`15dba147-d81a-4613-a544-bc309c656a71`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:48:54,814::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:48:54,828::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:54,828::task::1191::Storage.TaskManager.Task::(prepare) Task=`15dba147-d81a-4613-a544-bc309c656a71`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:48:54,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`15dba147-d81a-4613-a544-bc309c656a71`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:48:54,828::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:48:54,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:48:54,829::task::993::Storage.TaskManager.Task::(_decref) Task=`15dba147-d81a-4613-a544-bc309c656a71`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:48:54,837::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:48:54,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc8e9b59-a175-4c42-aead-cc77c1562827`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:48:54,837::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:48:54,837::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0d89de4d-0d92-4093-8e5c-26413046062b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:48:54,837::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:48:54,838::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:48:54,838::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`0d89de4d-0d92-4093-8e5c-26413046062b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:48:54,838::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fc8e9b59-a175-4c42-aead-cc77c1562827`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:48:54,838::task::993::Storage.TaskManager.Task::(_decref) Task=`fc8e9b59-a175-4c42-aead-cc77c1562827`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:48:54,856::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:54,856::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc8e9b59-a175-4c42-aead-cc77c1562827`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:48:54,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc8e9b59-a175-4c42-aead-cc77c1562827`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:48:54,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:48:54,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:48:54,857::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:48:54,857::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:48:54,857::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:48:54,857::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:48:54,857::task::993::Storage.TaskManager.Task::(_decref) Task=`fc8e9b59-a175-4c42-aead-cc77c1562827`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:48:55,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:48:55,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:48:55,345::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:55,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:55,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0598817 s, 17.1 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:48:55,679::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:48:56,832::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-08-11 17:48:57,351::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:57,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:57,583::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:48:57,584::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:48:57,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:57,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028156 s, 36.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:57,811::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:57,811::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:57,811::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) (543319) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) (543319) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) DEBUG|(543319) Building response >Thread-19::DEBUG::2014-08-11 17:48:57,812::__init__::225::IOProcess::(_processLogs) (543319) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:57,813::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:48:57,813::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:48:57,814::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:48:57,881::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00261599 s, 140 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:48:57,881::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:48:57,881::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:48:57,881::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) (543320) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) (543320) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:48:57,882::__init__::225::IOProcess::(_processLogs) (543320) Queuing response >Thread-19::DEBUG::2014-08-11 17:48:57,883::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:48:59,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:48:59,853::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0618599 s, 16.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:00,349::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:00,350::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:00,350::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:01,861::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:01,977::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541786 s, 18.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:02,587::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:02,589::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:02,591::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:03,682::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:03,683::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:03,683::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:03,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:03,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:03,683::__init__::225::IOProcess::(_processLogs) (543321) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:03,683::__init__::225::IOProcess::(_processLogs) (543321) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:03,685::__init__::225::IOProcess::(_processLogs) (543321) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:03,685::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:49:03,685::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:49:03,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000324132 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) (543322) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) (543322) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) (543322) Building response >Thread-19::DEBUG::2014-08-11 17:49:03,746::__init__::225::IOProcess::(_processLogs) (543322) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:03,747::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:49:03,747::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:49:03,747::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) (543323) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) (543323) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) (543323) Building response >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) (543323) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:03,748::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:03,749::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:49:03,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:03,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:03,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:03,749::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:03,749::__init__::225::IOProcess::(_processLogs) (543324) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) (543324) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) (543324) Building response >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) (543324) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:03,750::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) (543325) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) (543325) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) (543325) Building response >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) (543325) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:03,751::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:49:04,068::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:04,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0141144 s, 72.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:49:04,358::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10237::DEBUG::2014-08-11 17:49:04,905::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:04,905::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0aac202-a6db-46af-abbe-7ddd68ed829d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:04,905::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:49:04,969::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:04,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`f0aac202-a6db-46af-abbe-7ddd68ed829d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:04,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`f0aac202-a6db-46af-abbe-7ddd68ed829d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:04,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:04,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:04,969::task::993::Storage.TaskManager.Task::(_decref) Task=`f0aac202-a6db-46af-abbe-7ddd68ed829d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:49:04,981::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:49:04,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c17fa23-ec1f-4a78-84bf-e6a1e66c5b18`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:49:04,981::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:49:04,982::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`35fbab82-d965-458f-845e-a86d72dfc92b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:49:04,982::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:49:04,982::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:49:04,982::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`35fbab82-d965-458f-845e-a86d72dfc92b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:49:04,982::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2c17fa23-ec1f-4a78-84bf-e6a1e66c5b18`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:49:04,982::task::993::Storage.TaskManager.Task::(_decref) Task=`2c17fa23-ec1f-4a78-84bf-e6a1e66c5b18`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:49:05,048::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:05,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c17fa23-ec1f-4a78-84bf-e6a1e66c5b18`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:05,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c17fa23-ec1f-4a78-84bf-e6a1e66c5b18`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:49:05,048::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:49:05,048::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:49:05,049::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:49:05,049::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:49:05,049::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:49:05,049::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:49:05,049::task::993::Storage.TaskManager.Task::(_decref) Task=`2c17fa23-ec1f-4a78-84bf-e6a1e66c5b18`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:49:05,351::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:05,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:05,352::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:05,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`55920c2f-32ef-48cd-baa6-fecd3ec68735`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:05,911::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:49:05,911::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261599', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324132', 'lastCheck': '2.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:05,911::task::1191::Storage.TaskManager.Task::(prepare) Task=`55920c2f-32ef-48cd-baa6-fecd3ec68735`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00261599', 'lastCheck': '8.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000324132', 'lastCheck': '2.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:05,911::task::595::Storage.TaskManager.Task::(_updateState) Task=`55920c2f-32ef-48cd-baa6-fecd3ec68735`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:05,911::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:05,912::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:05,912::task::993::Storage.TaskManager.Task::(_decref) Task=`55920c2f-32ef-48cd-baa6-fecd3ec68735`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:49:05,929::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:05,929::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:06,148::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:06,231::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0235863 s, 43.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:07,598::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:07,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:07,599::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) (543326) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:07,884::__init__::225::IOProcess::(_processLogs) (543326) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:07,885::__init__::225::IOProcess::(_processLogs) (543326) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:07,885::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:49:07,885::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:49:07,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00126695 s, 289 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) (543327) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) (543327) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:07,946::__init__::225::IOProcess::(_processLogs) (543327) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:07,947::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:07,947::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:49:08,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:08,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122759 s, 83.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:49:10,318::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:49:10,378::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:10,380::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:10,383::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:10,389::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012404 s, 82.6 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:49:10,750::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:49:11,840::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:49:12,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:12,518::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0368855 s, 27.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:12,605::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:12,605::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:12,606::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:13,751::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) (543328) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) (543328) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:13,752::__init__::225::IOProcess::(_processLogs) (543328) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:13,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:49:13,753::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:49:13,753::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:49:13,813::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00107754 s, 459 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:13,814::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:13,814::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:13,814::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:13,814::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:13,814::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:13,814::__init__::225::IOProcess::(_processLogs) (543329) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:13,815::__init__::225::IOProcess::(_processLogs) (543329) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:13,815::__init__::225::IOProcess::(_processLogs) (543329) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:13,815::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:13,815::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) (543330) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) (543330) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:13,816::__init__::225::IOProcess::(_processLogs) (543330) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) (543331) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:13,817::__init__::225::IOProcess::(_processLogs) (543331) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:13,818::__init__::225::IOProcess::(_processLogs) (543331) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:13,818::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:13,818::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:49:13,818::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:13,818::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) (543332) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) (543332) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) (543332) Building response >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) (543332) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:13,819::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:49:14,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:14,603::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0191079 s, 53.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:49:15,084::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:15,084::task::595::Storage.TaskManager.Task::(_updateState) Task=`885fee09-f7b4-41d6-b52f-a3dc071669fa`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:15,084::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:49:15,099::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:15,100::task::1191::Storage.TaskManager.Task::(prepare) Task=`885fee09-f7b4-41d6-b52f-a3dc071669fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:15,100::task::595::Storage.TaskManager.Task::(_updateState) Task=`885fee09-f7b4-41d6-b52f-a3dc071669fa`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:15,100::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:15,100::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:15,100::task::993::Storage.TaskManager.Task::(_decref) Task=`885fee09-f7b4-41d6-b52f-a3dc071669fa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:49:15,108::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:49:15,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e58426e-03ac-484c-8e4a-bd9a2e3913d2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:49:15,109::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:49:15,109::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`beb2640b-9ea0-422e-97a7-ef71ec55bc0f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:49:15,109::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:49:15,109::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:49:15,109::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`beb2640b-9ea0-422e-97a7-ef71ec55bc0f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:49:15,109::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0e58426e-03ac-484c-8e4a-bd9a2e3913d2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:49:15,109::task::993::Storage.TaskManager.Task::(_decref) Task=`0e58426e-03ac-484c-8e4a-bd9a2e3913d2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:49:15,126::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:15,126::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e58426e-03ac-484c-8e4a-bd9a2e3913d2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:15,126::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e58426e-03ac-484c-8e4a-bd9a2e3913d2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:49:15,126::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:49:15,126::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:49:15,126::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:49:15,126::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:49:15,126::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:49:15,126::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:49:15,127::task::993::Storage.TaskManager.Task::(_decref) Task=`0e58426e-03ac-484c-8e4a-bd9a2e3913d2`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:49:15,389::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:15,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:15,390::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:16,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:16,685::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0143871 s, 71.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:17,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:17,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:17,609::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) (543333) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:17,948::__init__::225::IOProcess::(_processLogs) (543333) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:17,952::__init__::225::IOProcess::(_processLogs) (543333) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:17,952::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:49:17,953::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:49:18,011::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00040706 s, 899 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) (543334) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:18,012::__init__::225::IOProcess::(_processLogs) (543334) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:18,013::__init__::225::IOProcess::(_processLogs) (543334) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:18,013::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:18,013::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:49:18,693::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:18,786::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0168591 s, 60.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:20,394::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:20,396::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:20,399::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:20,794::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:20,870::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0144595 s, 70.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:49:21,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`517f33e3-aaef-4a01-bae2-13679fd11479`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:21,223::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:49:21,223::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040706', 'lastCheck': '3.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107754', 'lastCheck': '7.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:21,223::task::1191::Storage.TaskManager.Task::(prepare) Task=`517f33e3-aaef-4a01-bae2-13679fd11479`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00040706', 'lastCheck': '3.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00107754', 'lastCheck': '7.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:21,223::task::595::Storage.TaskManager.Task::(_updateState) Task=`517f33e3-aaef-4a01-bae2-13679fd11479`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:21,224::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:21,224::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:21,224::task::993::Storage.TaskManager.Task::(_decref) Task=`517f33e3-aaef-4a01-bae2-13679fd11479`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:49:21,243::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:21,243::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:22,615::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:22,615::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:22,616::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:22,879::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:22,950::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133166 s, 76.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:23,819::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:23,819::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:23,820::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:23,820::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:23,820::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:23,820::__init__::225::IOProcess::(_processLogs) (543335) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:23,820::__init__::225::IOProcess::(_processLogs) (543335) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:23,824::__init__::225::IOProcess::(_processLogs) (543335) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:23,824::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:49:23,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:49:23,885::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000887177 s, 558 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:23,885::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:23,885::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:23,885::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:23,886::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:23,886::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:23,886::__init__::225::IOProcess::(_processLogs) (543336) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:23,886::__init__::225::IOProcess::(_processLogs) (543336) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:23,886::__init__::225::IOProcess::(_processLogs) (543336) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:23,886::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:23,887::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:23,887::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:23,887::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:23,887::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:23,887::__init__::225::IOProcess::(_processLogs) (543337) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:23,887::__init__::225::IOProcess::(_processLogs) (543337) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) (543337) Building response >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) (543337) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:23,888::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) (543338) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) (543338) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) (543338) Building response >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) (543338) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:23,889::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) (543339) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) (543339) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:23,890::__init__::225::IOProcess::(_processLogs) (543339) Building response >Thread-19::DEBUG::2014-08-11 17:49:23,891::__init__::225::IOProcess::(_processLogs) (543339) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:23,891::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:23,891::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:49:24,959::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:25,048::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0308974 s, 33.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:49:25,183::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:25,183::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6cf768b-62bc-4be7-9d48-1d63c252c3b0`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:25,184::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:49:25,218::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:25,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`a6cf768b-62bc-4be7-9d48-1d63c252c3b0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:25,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`a6cf768b-62bc-4be7-9d48-1d63c252c3b0`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:25,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:25,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:25,219::task::993::Storage.TaskManager.Task::(_decref) Task=`a6cf768b-62bc-4be7-9d48-1d63c252c3b0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:49:25,231::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:49:25,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`21dbb0f5-7732-4524-932a-62cf5b62ef2e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:49:25,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:49:25,231::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f4865994-f79d-40ef-9366-ce59b18bce10`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:49:25,231::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:49:25,232::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:49:25,232::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f4865994-f79d-40ef-9366-ce59b18bce10`::Granted request >Thread-10197::DEBUG::2014-08-11 17:49:25,232::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`21dbb0f5-7732-4524-932a-62cf5b62ef2e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:49:25,232::task::993::Storage.TaskManager.Task::(_decref) Task=`21dbb0f5-7732-4524-932a-62cf5b62ef2e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:49:25,249::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:25,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`21dbb0f5-7732-4524-932a-62cf5b62ef2e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:25,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`21dbb0f5-7732-4524-932a-62cf5b62ef2e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:49:25,250::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:49:25,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:49:25,250::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:49:25,250::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:49:25,250::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:49:25,250::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:49:25,250::task::993::Storage.TaskManager.Task::(_decref) Task=`21dbb0f5-7732-4524-932a-62cf5b62ef2e`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:49:25,402::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:25,403::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:25,405::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:49:25,752::task::595::Storage.TaskManager.Task::(_updateState) Task=`40d2aa9d-e2cd-4051-b436-1604af4c2033`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:49:25,752::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:49:25,752::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:49:25,753::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:25,753::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:25,753::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:25,753::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:25,753::__init__::225::IOProcess::(_processLogs) (543340) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:25,753::__init__::225::IOProcess::(_processLogs) (543340) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:25,756::__init__::225::IOProcess::(_processLogs) (543340) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:25,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:25,756::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:49:25,756::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:25,756::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::INFO::2014-08-11 17:49:25,757::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:49:25,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:49:25,757::task::1191::Storage.TaskManager.Task::(prepare) Task=`40d2aa9d-e2cd-4051-b436-1604af4c2033`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:49:25,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:49:25,758::task::595::Storage.TaskManager.Task::(_updateState) Task=`40d2aa9d-e2cd-4051-b436-1604af4c2033`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:49:25,758::__init__::225::IOProcess::(_processLogs) (543341) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:49:25,758::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:49:25,759::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:49:25,759::__init__::225::IOProcess::(_processLogs) (543341) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:49:25,759::task::993::Storage.TaskManager.Task::(_decref) Task=`40d2aa9d-e2cd-4051-b436-1604af4c2033`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:49:25,759::__init__::225::IOProcess::(_processLogs) (543341) Building response >Thread-19::DEBUG::2014-08-11 17:49:25,760::__init__::225::IOProcess::(_processLogs) (543341) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:25,760::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:25,760::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:49:25,781::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:49:26,852::task::595::Storage.TaskManager.Task::(_updateState) Task=`7488a72f-edce-4314-9392-d139fa5cd5da`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:49:26,853::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) (543342) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:26,853::__init__::225::IOProcess::(_processLogs) (543342) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:26,855::__init__::225::IOProcess::(_processLogs) (543342) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:26,855::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:49:26,856::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:49:26,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:26,856::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10256::INFO::2014-08-11 17:49:26,856::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:49:26,857::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10256::DEBUG::2014-08-11 17:49:26,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`7488a72f-edce-4314-9392-d139fa5cd5da`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:49:26,857::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:49:26,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`7488a72f-edce-4314-9392-d139fa5cd5da`::moving from state preparing -> state finished >Thread-10256::DEBUG::2014-08-11 17:49:26,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:49:26,858::__init__::225::IOProcess::(_processLogs) (543343) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:49:26,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:49:26,858::__init__::225::IOProcess::(_processLogs) (543343) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:49:26,859::task::993::Storage.TaskManager.Task::(_decref) Task=`7488a72f-edce-4314-9392-d139fa5cd5da`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:49:26,859::__init__::225::IOProcess::(_processLogs) (543343) Building response >Thread-19::DEBUG::2014-08-11 17:49:26,859::__init__::225::IOProcess::(_processLogs) (543343) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:26,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:26,860::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:49:26,881::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:49:27,056::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:27,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0540169 s, 19.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:49:27,394::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:27,630::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:27,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:27,631::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:28,014::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:28,014::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:28,014::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:28,014::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:28,014::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:28,015::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:28,015::__init__::225::IOProcess::(_processLogs) (543344) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:28,015::__init__::225::IOProcess::(_processLogs) (543344) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:28,015::__init__::225::IOProcess::(_processLogs) (543344) Queuing response >Thread-27::DEBUG::2014-08-11 17:49:28,016::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:49:28,016::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:28,075::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:49:28,076::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000621589 s, 589 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) (543345) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:28,077::__init__::225::IOProcess::(_processLogs) (543345) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:28,078::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543345) Building response >Thread-19::DEBUG::2014-08-11 17:49:28,078::__init__::225::IOProcess::(_processLogs) (543345) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:28,079::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:28,079::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:49:29,175::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:29,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0406745 s, 25.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:30,408::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:30,408::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:30,409::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:31,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:31,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0632869 s, 16.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:32,636::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:32,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:32,640::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:33,414::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:33,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.060161 s, 17.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) (543346) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:33,891::__init__::225::IOProcess::(_processLogs) (543346) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:33,892::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543346) Building response >Thread-19::DEBUG::2014-08-11 17:49:33,893::__init__::225::IOProcess::(_processLogs) (543346) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:33,893::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:33,893::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:49:33,893::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:49:33,956::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:33,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`330ed115-bfe4-4509-bf9c-cedba5235465`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:33,957::logUtils::44::dispatcher::(wrapper) Run and protect: getAllTasksStatuses(spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:49:33,957::taskManager::112::Storage.TaskManager::(getAllTasksStatuses) Entry. >Thread-10237::DEBUG::2014-08-11 17:49:33,957::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 28435af6-8b8c-43f9-9d73-5ff28ee984c4 >Thread-10237::DEBUG::2014-08-11 17:49:33,957::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '28435af6-8b8c-43f9-9d73-5ff28ee984c4'} >Thread-10237::DEBUG::2014-08-11 17:49:33,957::taskManager::103::Storage.TaskManager::(getTaskStatus) Entry. taskID: 924b5ab1-5479-4d41-a5b3-e436dbbee96c >Thread-10237::DEBUG::2014-08-11 17:49:33,957::taskManager::106::Storage.TaskManager::(getTaskStatus) Return. Response: {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '924b5ab1-5479-4d41-a5b3-e436dbbee96c'} >Thread-10237::DEBUG::2014-08-11 17:49:33,957::taskManager::123::Storage.TaskManager::(getAllTasksStatuses) Return: {'924b5ab1-5479-4d41-a5b3-e436dbbee96c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '924b5ab1-5479-4d41-a5b3-e436dbbee96c'}, '28435af6-8b8c-43f9-9d73-5ff28ee984c4': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '28435af6-8b8c-43f9-9d73-5ff28ee984c4'}} >Thread-10237::INFO::2014-08-11 17:49:33,957::logUtils::47::dispatcher::(wrapper) Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'924b5ab1-5479-4d41-a5b3-e436dbbee96c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '924b5ab1-5479-4d41-a5b3-e436dbbee96c'}, '28435af6-8b8c-43f9-9d73-5ff28ee984c4': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '28435af6-8b8c-43f9-9d73-5ff28ee984c4'}}} >Thread-10237::DEBUG::2014-08-11 17:49:33,957::task::1191::Storage.TaskManager.Task::(prepare) Task=`330ed115-bfe4-4509-bf9c-cedba5235465`::finished: {'allTasksStatus': {'924b5ab1-5479-4d41-a5b3-e436dbbee96c': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '924b5ab1-5479-4d41-a5b3-e436dbbee96c'}, '28435af6-8b8c-43f9-9d73-5ff28ee984c4': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '28435af6-8b8c-43f9-9d73-5ff28ee984c4'}}} >Thread-10237::DEBUG::2014-08-11 17:49:33,957::task::595::Storage.TaskManager.Task::(_updateState) Task=`330ed115-bfe4-4509-bf9c-cedba5235465`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:33,958::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:33,958::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:33,958::task::993::Storage.TaskManager.Task::(_decref) Task=`330ed115-bfe4-4509-bf9c-cedba5235465`::ref 0 aborting False >Thread-28::DEBUG::2014-08-11 17:49:33,962::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00214222 s, 231 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:33,963::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:33,964::__init__::225::IOProcess::(_processLogs) (543347) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:33,964::__init__::225::IOProcess::(_processLogs) (543347) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:33,964::__init__::225::IOProcess::(_processLogs) (543347) Building response >Thread-19::DEBUG::2014-08-11 17:49:33,964::__init__::225::IOProcess::(_processLogs) (543347) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:33,964::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:33,964::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:49:33,965::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:33,965::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:49:33,965::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:33,965::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:33,965::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:33,965::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) (543348) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) (543348) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) (543348) Building response >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) (543348) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:33,966::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) (543349) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) (543349) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) (543349) Building response >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) (543349) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:33,967::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:33,968::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:33,969::__init__::225::IOProcess::(_processLogs) (543350) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:33,969::__init__::225::IOProcess::(_processLogs) (543350) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:33,969::__init__::225::IOProcess::(_processLogs) (543350) Building response >Thread-19::DEBUG::2014-08-11 17:49:33,969::__init__::225::IOProcess::(_processLogs) (543350) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:33,969::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:33,969::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:49:34,051::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:34,051::task::595::Storage.TaskManager.Task::(_updateState) Task=`21767d84-2c92-425b-8cba-83c98dfaf76d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:34,051::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='924b5ab1-5479-4d41-a5b3-e436dbbee96c', spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:49:34,051::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 924b5ab1-5479-4d41-a5b3-e436dbbee96c >Thread-19::DEBUG::2014-08-11 17:49:34,051::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) (543351) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:49:34,052::__init__::225::IOProcess::(_processLogs) (543351) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:49:34,053::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543351) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,053::__init__::225::IOProcess::(_processLogs) (543351) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,053::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,053::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 190 >Thread-19::DEBUG::2014-08-11 17:49:34,053::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) (543352) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:34,054::__init__::225::IOProcess::(_processLogs) (543352) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) (543352) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) (543352) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,055::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,056::__init__::225::IOProcess::(_processLogs) (543353) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:49:34,056::__init__::225::IOProcess::(_processLogs) (543353) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:49:34,070::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543353) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,071::__init__::225::IOProcess::(_processLogs) (543353) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,071::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:34,071::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,071::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-08-11 17:49:34,071::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) (543354) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) (543354) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) (543354) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,072::__init__::225::IOProcess::(_processLogs) (543354) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) (543355) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:49:34,073::__init__::225::IOProcess::(_processLogs) (543355) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:49:34,090::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543355) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,090::__init__::225::IOProcess::(_processLogs) (543355) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,090::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,091::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:34,091::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,091::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:49:34,091::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,091::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,091::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) (543356) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) (543356) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) (543356) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) (543356) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Sending response sized 234 >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Message size is 217 >Thread-19::DEBUG::2014-08-11 17:49:34,092::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,093::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,093::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,093::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,093::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,093::__init__::225::IOProcess::(_processLogs) (543357) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:49:34,093::__init__::225::IOProcess::(_processLogs) (543357) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:49:34,106::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543357) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,106::__init__::225::IOProcess::(_processLogs) (543357) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,106::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,106::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:34,106::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,106::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) (543358) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:49:34,107::__init__::225::IOProcess::(_processLogs) (543358) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:49:34,128::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543358) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,128::__init__::225::IOProcess::(_processLogs) (543358) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,128::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Generating json... >Thread-10237::DEBUG::2014-08-11 17:49:34,129::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-19::DEBUG::2014-08-11 17:49:34,129::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::INFO::2014-08-11 17:49:34,129::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-10237::DEBUG::2014-08-11 17:49:34,130::task::1191::Storage.TaskManager.Task::(prepare) Task=`21767d84-2c92-425b-8cba-83c98dfaf76d`::finished: None >Thread-10237::DEBUG::2014-08-11 17:49:34,130::task::595::Storage.TaskManager.Task::(_updateState) Task=`21767d84-2c92-425b-8cba-83c98dfaf76d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:34,130::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:34,130::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:34,130::task::993::Storage.TaskManager.Task::(_decref) Task=`21767d84-2c92-425b-8cba-83c98dfaf76d`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:49:34,177::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:34,177::task::595::Storage.TaskManager.Task::(_updateState) Task=`0fbc6608-5990-4116-9d72-fd39e65ec1c7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:34,178::logUtils::44::dispatcher::(wrapper) Run and protect: clearTask(taskID='28435af6-8b8c-43f9-9d73-5ff28ee984c4', spUUID=None, options=None) >Thread-10237::DEBUG::2014-08-11 17:49:34,178::taskManager::171::Storage.TaskManager::(clearTask) Entry. taskID: 28435af6-8b8c-43f9-9d73-5ff28ee984c4 >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Message size is 174 >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,178::__init__::225::IOProcess::(_processLogs) (543359) Finding callback 'listdir'... >Thread-19::DEBUG::2014-08-11 17:49:34,179::__init__::225::IOProcess::(_processLogs) (543359) Got request for method 'listdir' >Thread-19::DEBUG::2014-08-11 17:49:34,203::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|(543359) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,203::__init__::225::IOProcess::(_processLogs) (543359) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,204::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Sending response sized 190 >Thread-19::DEBUG::2014-08-11 17:49:34,204::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,204::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:49:34,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,204::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) (543360) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) (543360) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) (543360) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) (543360) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,205::__init__::225::IOProcess::(_processLogs) Sending response sized 234 >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Queuing request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Message size is 217 >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) (543361) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:49:34,206::__init__::225::IOProcess::(_processLogs) (543361) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:49:34,218::__init__::225::IOProcess::(_processLogs) DEBUG|(543361) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,218::__init__::225::IOProcess::(_processLogs) (543361) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,218::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) Message size is 214 >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,219::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) (543362) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) (543362) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) (543362) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) (543362) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) Message size is 216 >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,220::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,221::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,221::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,221::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,221::__init__::225::IOProcess::(_processLogs) (543363) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:49:34,221::__init__::225::IOProcess::(_processLogs) (543363) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:49:34,231::__init__::225::IOProcess::(_processLogs) DEBUG|(543363) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,231::__init__::225::IOProcess::(_processLogs) (543363) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,231::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,232::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:34,232::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,232::__init__::225::IOProcess::(_processLogs) Message size is 213 >Thread-19::DEBUG::2014-08-11 17:49:34,232::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,232::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) (543364) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) (543364) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) (543364) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) (543364) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) Sending response sized 235 >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,233::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) (543365) Finding callback 'unlink'... >Thread-19::DEBUG::2014-08-11 17:49:34,234::__init__::225::IOProcess::(_processLogs) (543365) Got request for method 'unlink' >Thread-19::DEBUG::2014-08-11 17:49:34,240::__init__::225::IOProcess::(_processLogs) DEBUG|(543365) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,240::__init__::225::IOProcess::(_processLogs) (543365) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,240::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) Message size is 172 >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) (543366) Finding callback 'rmdir'... >Thread-19::DEBUG::2014-08-11 17:49:34,241::__init__::225::IOProcess::(_processLogs) (543366) Got request for method 'rmdir' >Thread-19::DEBUG::2014-08-11 17:49:34,250::__init__::225::IOProcess::(_processLogs) DEBUG|(543366) Building response >Thread-19::DEBUG::2014-08-11 17:49:34,250::__init__::225::IOProcess::(_processLogs) (543366) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:34,251::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-10237::DEBUG::2014-08-11 17:49:34,251::taskManager::176::Storage.TaskManager::(clearTask) Return. >Thread-19::DEBUG::2014-08-11 17:49:34,251::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::INFO::2014-08-11 17:49:34,251::logUtils::47::dispatcher::(wrapper) Run and protect: clearTask, Return response: None >Thread-10237::DEBUG::2014-08-11 17:49:34,252::task::1191::Storage.TaskManager.Task::(prepare) Task=`0fbc6608-5990-4116-9d72-fd39e65ec1c7`::finished: None >Thread-10237::DEBUG::2014-08-11 17:49:34,252::task::595::Storage.TaskManager.Task::(_updateState) Task=`0fbc6608-5990-4116-9d72-fd39e65ec1c7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:34,252::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:34,252::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:34,252::task::993::Storage.TaskManager.Task::(_decref) Task=`0fbc6608-5990-4116-9d72-fd39e65ec1c7`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:49:34,401::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-10237::DEBUG::2014-08-11 17:49:35,306::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:35,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`38f0dedf-4dfd-45bb-962b-52ba49dfe729`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:35,306::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:49:35,387::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:35,387::task::1191::Storage.TaskManager.Task::(prepare) Task=`38f0dedf-4dfd-45bb-962b-52ba49dfe729`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:35,387::task::595::Storage.TaskManager.Task::(_updateState) Task=`38f0dedf-4dfd-45bb-962b-52ba49dfe729`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:35,387::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:35,387::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:35,387::task::993::Storage.TaskManager.Task::(_decref) Task=`38f0dedf-4dfd-45bb-962b-52ba49dfe729`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:49:35,399::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:49:35,399::task::595::Storage.TaskManager.Task::(_updateState) Task=`675eeaa7-37ea-4620-837a-e2a2ce86e669`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:49:35,399::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:49:35,399::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3e8c773f-8cf4-4a68-b600-1d540227d15c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:49:35,399::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:49:35,399::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:49:35,399::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`3e8c773f-8cf4-4a68-b600-1d540227d15c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:49:35,400::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`675eeaa7-37ea-4620-837a-e2a2ce86e669`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:49:35,400::task::993::Storage.TaskManager.Task::(_decref) Task=`675eeaa7-37ea-4620-837a-e2a2ce86e669`::ref 1 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:49:35,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:35,415::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10197::INFO::2014-08-11 17:49:35,418::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:35,420::task::1191::Storage.TaskManager.Task::(prepare) Task=`675eeaa7-37ea-4620-837a-e2a2ce86e669`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >GuestMonitor-vm::DEBUG::2014-08-11 17:49:35,420::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:49:35,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`675eeaa7-37ea-4620-837a-e2a2ce86e669`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:49:35,422::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:49:35,422::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:49:35,424::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:49:35,424::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:49:35,424::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:49:35,424::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:49:35,424::task::993::Storage.TaskManager.Task::(_decref) Task=`675eeaa7-37ea-4620-837a-e2a2ce86e669`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:49:35,543::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:35,625::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.021665 s, 47.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:49:36,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b2828ff-0a65-46da-8207-32b219614381`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:36,489::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:49:36,490::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621589', 'lastCheck': '8.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00214222', 'lastCheck': '2.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:36,490::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b2828ff-0a65-46da-8207-32b219614381`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000621589', 'lastCheck': '8.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00214222', 'lastCheck': '2.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:36,490::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b2828ff-0a65-46da-8207-32b219614381`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:36,490::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:36,490::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:36,490::task::993::Storage.TaskManager.Task::(_decref) Task=`0b2828ff-0a65-46da-8207-32b219614381`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:49:36,509::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:36,510::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:37,631::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:37,689::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:37,690::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:37,690::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:37,781::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0907497 s, 11.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:38,079::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:49:38,079::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:38,079::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:38,079::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) (543367) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) (543367) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) DEBUG|(543367) Building response >Thread-19::DEBUG::2014-08-11 17:49:38,080::__init__::225::IOProcess::(_processLogs) (543367) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:38,081::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:38,081::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:49:38,081::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:49:38,144::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00181405 s, 202 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) (543368) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:38,145::__init__::225::IOProcess::(_processLogs) (543368) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:38,146::__init__::225::IOProcess::(_processLogs) (543368) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:38,146::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:49:39,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:39,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0709622 s, 14.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:40,428::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:40,428::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:40,429::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:49:40,788::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:49:41,889::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:49:41,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:42,002::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0147675 s, 69.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:42,695::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:42,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:42,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:43,969::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:43,969::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:43,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:43,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:43,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:43,970::__init__::225::IOProcess::(_processLogs) (543369) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:43,970::__init__::225::IOProcess::(_processLogs) (543369) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:43,971::__init__::225::IOProcess::(_processLogs) (543369) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:43,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:49:43,971::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:44,029::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:49:44,088::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00145519 s, 340 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) (543370) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:44,089::__init__::225::IOProcess::(_processLogs) (543370) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:44,103::__init__::225::IOProcess::(_processLogs) (543370) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:44,103::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) (543371) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:44,104::__init__::225::IOProcess::(_processLogs) (543371) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:44,105::__init__::225::IOProcess::(_processLogs) (543371) Building response >Thread-19::DEBUG::2014-08-11 17:49:44,105::__init__::225::IOProcess::(_processLogs) (543371) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:44,105::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:44,105::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:44,105::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:49:44,105::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) (543372) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) (543372) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) (543372) Building response >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) (543372) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:44,106::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:49:44,107::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:44,107::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:44,107::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:44,107::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:44,107::__init__::225::IOProcess::(_processLogs) (543373) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:44,108::__init__::225::IOProcess::(_processLogs) (543373) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:44,108::__init__::225::IOProcess::(_processLogs) (543373) Building response >Thread-19::DEBUG::2014-08-11 17:49:44,108::__init__::225::IOProcess::(_processLogs) (543373) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:44,108::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:44,108::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:49:44,140::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0385468 s, 26.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:45,434::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:45,435::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:45,435::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:45,485::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:45,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5d0514b-4443-48a7-a54a-66f15125f4e1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:45,485::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:49:45,500::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:45,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5d0514b-4443-48a7-a54a-66f15125f4e1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:45,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5d0514b-4443-48a7-a54a-66f15125f4e1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:45,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:45,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:45,501::task::993::Storage.TaskManager.Task::(_decref) Task=`e5d0514b-4443-48a7-a54a-66f15125f4e1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:49:45,512::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:49:45,512::task::595::Storage.TaskManager.Task::(_updateState) Task=`aad10817-f0dc-43fb-9fed-d31afdad2077`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:49:45,512::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:49:45,512::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e5c910a1-69f0-4b36-9d10-5de801b0a56b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:49:45,512::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:49:45,512::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:49:45,512::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e5c910a1-69f0-4b36-9d10-5de801b0a56b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:49:45,513::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`aad10817-f0dc-43fb-9fed-d31afdad2077`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:49:45,513::task::993::Storage.TaskManager.Task::(_decref) Task=`aad10817-f0dc-43fb-9fed-d31afdad2077`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:49:45,529::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:45,529::task::1191::Storage.TaskManager.Task::(prepare) Task=`aad10817-f0dc-43fb-9fed-d31afdad2077`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:45,530::task::595::Storage.TaskManager.Task::(_updateState) Task=`aad10817-f0dc-43fb-9fed-d31afdad2077`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:49:45,530::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:49:45,530::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:49:45,530::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:49:45,530::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:49:45,530::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:49:45,530::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:49:45,530::task::993::Storage.TaskManager.Task::(_decref) Task=`aad10817-f0dc-43fb-9fed-d31afdad2077`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:49:46,146::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:46,217::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0125563 s, 81.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:47,700::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:47,700::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:47,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:48,168::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:48,169::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:48,169::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:48,169::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:48,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:48,170::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:48,170::__init__::225::IOProcess::(_processLogs) (543374) Got request for method 'statvfs' >Thread-27::DEBUG::2014-08-11 17:49:48,171::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:49:48,171::__init__::225::IOProcess::(_processLogs) (543374) Building response >Thread-19::DEBUG::2014-08-11 17:49:48,314::__init__::225::IOProcess::(_processLogs) (543374) Queuing response >Dummy-51::DEBUG::2014-08-11 17:49:48,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:49:48,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:49:48,317::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00356879 s, 103 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:48,377::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:49:48,378::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:48,378::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:48,379::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:48,379::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:48,379::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:48,379::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:48,379::__init__::225::IOProcess::(_processLogs) (543375) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:48,379::__init__::225::IOProcess::(_processLogs) (543375) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:48,381::__init__::225::IOProcess::(_processLogs) (543375) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:48,382::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:49:48,437::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0595604 s, 17.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:50,441::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:50,441::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:50,441::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:50,445::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:50,519::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0151136 s, 67.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:49:51,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`2297389e-a2c6-467d-87b8-ce75182a67e4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:51,688::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:49:51,688::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00356879', 'lastCheck': '3.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145519', 'lastCheck': '7.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:51,688::task::1191::Storage.TaskManager.Task::(prepare) Task=`2297389e-a2c6-467d-87b8-ce75182a67e4`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00356879', 'lastCheck': '3.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145519', 'lastCheck': '7.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:49:51,688::task::595::Storage.TaskManager.Task::(_updateState) Task=`2297389e-a2c6-467d-87b8-ce75182a67e4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:51,689::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:51,689::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:51,689::task::993::Storage.TaskManager.Task::(_decref) Task=`2297389e-a2c6-467d-87b8-ce75182a67e4`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:49:51,704::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:51,705::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:49:52,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:52,637::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.049532 s, 20.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:52,702::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:52,702::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:52,703::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) (543376) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:54,108::__init__::225::IOProcess::(_processLogs) (543376) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:54,109::__init__::225::IOProcess::(_processLogs) (543376) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:54,109::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:49:54,109::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:49:54,193::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0027805 s, 178 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:54,194::__init__::225::IOProcess::(_processLogs) (543377) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:54,195::__init__::225::IOProcess::(_processLogs) (543377) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:54,195::__init__::225::IOProcess::(_processLogs) (543377) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:54,195::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:54,195::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) (543378) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) (543378) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:54,196::__init__::225::IOProcess::(_processLogs) (543378) Building response >Thread-19::DEBUG::2014-08-11 17:49:54,197::__init__::225::IOProcess::(_processLogs) (543378) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:54,197::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:54,197::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:54,197::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:49:54,197::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:54,197::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) (543379) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) (543379) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) (543379) Building response >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) (543379) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:54,198::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) (543380) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) (543380) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) (543380) Building response >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) (543380) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:54,199::__init__::225::IOProcess::(_processLogs) Generating json... >Dummy-51::DEBUG::2014-08-11 17:49:54,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:54,776::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0712912 s, 14.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:49:55,446::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:55,447::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:49:55,447::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:49:55,580::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:49:55,581::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a4e02b1-29ea-4576-8624-29ce58e8902a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:49:55,581::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:49:55,607::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:55,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a4e02b1-29ea-4576-8624-29ce58e8902a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:49:55,607::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a4e02b1-29ea-4576-8624-29ce58e8902a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:49:55,607::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:49:55,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:49:55,608::task::993::Storage.TaskManager.Task::(_decref) Task=`0a4e02b1-29ea-4576-8624-29ce58e8902a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:49:55,620::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:49:55,620::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f57a5fa-4f0a-4965-b502-c014cc333c19`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:49:55,620::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:49:55,620::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ab3dd784-6c01-4883-8d91-7b3a41d2a0c0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:49:55,620::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:49:55,621::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:49:55,621::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`ab3dd784-6c01-4883-8d91-7b3a41d2a0c0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:49:55,621::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1f57a5fa-4f0a-4965-b502-c014cc333c19`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:49:55,621::task::993::Storage.TaskManager.Task::(_decref) Task=`1f57a5fa-4f0a-4965-b502-c014cc333c19`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:49:55,637::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:55,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f57a5fa-4f0a-4965-b502-c014cc333c19`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:49:55,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f57a5fa-4f0a-4965-b502-c014cc333c19`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:49:55,638::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:49:55,638::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:49:55,638::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:49:55,638::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:49:55,638::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:49:55,638::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:49:55,638::task::993::Storage.TaskManager.Task::(_decref) Task=`1f57a5fa-4f0a-4965-b502-c014cc333c19`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:49:55,795::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:49:56,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:56,855::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012499 s, 81.9 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:49:56,897::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-08-11 17:49:57,426::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:57,708::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:57,709::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:49:57,709::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:49:58,383::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:58,383::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:58,383::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:58,383::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:58,383::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-27::DEBUG::2014-08-11 17:49:58,384::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:49:58,384::__init__::225::IOProcess::(_processLogs) (543381) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:58,444::__init__::225::IOProcess::(_processLogs) (543381) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:58,444::__init__::225::IOProcess::(_processLogs) (543381) Building response >Thread-19::DEBUG::2014-08-11 17:49:58,444::__init__::225::IOProcess::(_processLogs) (543381) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:58,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:58,444::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:49:58,445::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00174202 s, 210 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) (543382) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:49:58,446::__init__::225::IOProcess::(_processLogs) (543382) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:49:58,447::__init__::225::IOProcess::(_processLogs) (543382) Queuing response >Thread-19::DEBUG::2014-08-11 17:49:58,448::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:49:58,448::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:49:58,864::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:49:58,987::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0630052 s, 16.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:00,452::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:00,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:00,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:00,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:01,108::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0533341 s, 19.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:02,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:02,714::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:02,716::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:03,116::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:03,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0221343 s, 46.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:04,200::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:04,200::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:04,200::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:04,200::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:04,200::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:04,201::__init__::225::IOProcess::(_processLogs) (543383) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:04,201::__init__::225::IOProcess::(_processLogs) (543383) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:04,203::__init__::225::IOProcess::(_processLogs) (543383) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:04,203::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:50:04,204::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:50:04,268::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000416326 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) (543384) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) (543384) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:04,269::__init__::225::IOProcess::(_processLogs) (543384) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:04,270::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:04,270::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:50:04,270::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:50:04,270::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) (543385) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) (543385) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) (543385) Building response >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) (543385) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:04,271::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) (543386) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) (543386) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:04,272::__init__::225::IOProcess::(_processLogs) (543386) Building response >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) (543386) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) (543387) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:04,273::__init__::225::IOProcess::(_processLogs) (543387) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:04,274::__init__::225::IOProcess::(_processLogs) (543387) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:04,274::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:04,275::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:50:04,449::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:50:05,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:05,295::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128238 s, 79.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:05,456::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:05,457::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:05,457::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:05,711::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:50:05,712::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe49f3e0-388b-4f08-aaa2-4138588526e2`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:05,712::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:50:05,726::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:05,726::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe49f3e0-388b-4f08-aaa2-4138588526e2`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:05,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe49f3e0-388b-4f08-aaa2-4138588526e2`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:05,726::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:05,726::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:05,726::task::993::Storage.TaskManager.Task::(_decref) Task=`fe49f3e0-388b-4f08-aaa2-4138588526e2`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:50:05,737::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:50:05,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`a80830fa-a01b-4013-b7ec-4f2f266fcb00`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:50:05,738::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:50:05,738::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`35674325-752e-4c1b-a642-3d3b8473e0a6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:50:05,738::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:50:05,738::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:50:05,738::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`35674325-752e-4c1b-a642-3d3b8473e0a6`::Granted request >Thread-10197::DEBUG::2014-08-11 17:50:05,738::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a80830fa-a01b-4013-b7ec-4f2f266fcb00`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:50:05,738::task::993::Storage.TaskManager.Task::(_decref) Task=`a80830fa-a01b-4013-b7ec-4f2f266fcb00`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:50:05,755::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:05,755::task::1191::Storage.TaskManager.Task::(prepare) Task=`a80830fa-a01b-4013-b7ec-4f2f266fcb00`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:05,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`a80830fa-a01b-4013-b7ec-4f2f266fcb00`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:50:05,755::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:50:05,755::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:50:05,755::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:50:05,756::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:50:05,756::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:50:05,756::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:50:05,756::task::993::Storage.TaskManager.Task::(_decref) Task=`a80830fa-a01b-4013-b7ec-4f2f266fcb00`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:50:06,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`63d8555e-1552-4970-bd5c-9ab777b6bc1e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:06,885::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:50:06,885::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00174202', 'lastCheck': '8.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416326', 'lastCheck': '2.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:06,885::task::1191::Storage.TaskManager.Task::(prepare) Task=`63d8555e-1552-4970-bd5c-9ab777b6bc1e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00174202', 'lastCheck': '8.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416326', 'lastCheck': '2.6', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:06,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`63d8555e-1552-4970-bd5c-9ab777b6bc1e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:06,885::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:06,885::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:06,885::task::993::Storage.TaskManager.Task::(_decref) Task=`63d8555e-1552-4970-bd5c-9ab777b6bc1e`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:50:06,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:06,898::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:07,304::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:07,408::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0458402 s, 22.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:07,722::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:07,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:07,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:50:08,448::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:08,448::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:08,448::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:08,448::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:08,449::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:08,449::__init__::225::IOProcess::(_processLogs) (543388) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:08,449::__init__::225::IOProcess::(_processLogs) (543388) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:08,451::__init__::225::IOProcess::(_processLogs) (543388) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:08,451::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:50:08,452::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:50:08,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0110354 s, 33.2 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:08,527::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:08,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:08,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:08,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:08,527::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:08,528::__init__::225::IOProcess::(_processLogs) (543389) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:08,528::__init__::225::IOProcess::(_processLogs) (543389) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:08,544::__init__::225::IOProcess::(_processLogs) (543389) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:08,544::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:50:09,416::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:09,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127522 s, 80.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:10,459::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:10,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:10,460::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:50:10,803::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:50:11,496::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:11,567::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0127238 s, 80.5 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:50:11,929::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:12,729::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:12,729::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:12,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:13,575::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:13,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0492431 s, 20.8 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) (543390) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:14,276::__init__::225::IOProcess::(_processLogs) (543390) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:14,277::__init__::225::IOProcess::(_processLogs) (543390) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:14,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:50:14,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:50:14,337::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00139826 s, 354 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) (543391) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:14,338::__init__::225::IOProcess::(_processLogs) (543391) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) (543391) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:14,339::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) (543392) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) (543392) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) (543392) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:14,340::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) (543393) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) (543393) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:14,341::__init__::225::IOProcess::(_processLogs) (543393) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:14,342::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:14,342::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:14,342::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:50:14,342::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:14,342::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) (543394) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) (543394) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) (543394) Building response >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) (543394) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:14,343::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:15,465::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:15,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:15,466::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:15,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:15,841::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0866391 s, 11.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:50:15,859::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:50:15,860::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb893a5b-7a48-41e5-aa12-22e8bd75f62b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:15,860::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:50:15,888::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:15,888::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb893a5b-7a48-41e5-aa12-22e8bd75f62b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:15,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb893a5b-7a48-41e5-aa12-22e8bd75f62b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:15,888::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:15,888::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:15,888::task::993::Storage.TaskManager.Task::(_decref) Task=`fb893a5b-7a48-41e5-aa12-22e8bd75f62b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:50:15,900::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:50:15,900::task::595::Storage.TaskManager.Task::(_updateState) Task=`791150bc-32bc-43ec-b011-731bc2db396d`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:50:15,900::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:50:15,901::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e14b028f-8244-43d4-87fb-1cbcd76a843e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:50:15,901::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:50:15,901::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:50:15,901::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e14b028f-8244-43d4-87fb-1cbcd76a843e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:50:15,901::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`791150bc-32bc-43ec-b011-731bc2db396d`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:50:15,901::task::993::Storage.TaskManager.Task::(_decref) Task=`791150bc-32bc-43ec-b011-731bc2db396d`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:50:15,918::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:15,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`791150bc-32bc-43ec-b011-731bc2db396d`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55986618368', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:15,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`791150bc-32bc-43ec-b011-731bc2db396d`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:50:15,918::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:50:15,918::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:50:15,919::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:50:15,919::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:50:15,919::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:50:15,919::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:50:15,919::task::993::Storage.TaskManager.Task::(_decref) Task=`791150bc-32bc-43ec-b011-731bc2db396d`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:17,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:17,734::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:17,735::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:17,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:17,921::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013463 s, 76.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:18,545::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:18,545::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:18,545::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:18,545::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:18,545::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:18,546::__init__::225::IOProcess::(_processLogs) (543395) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:18,546::__init__::225::IOProcess::(_processLogs) (543395) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:18,546::__init__::225::IOProcess::(_processLogs) (543395) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:18,546::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:50:18,547::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:50:18,606::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000900062 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:18,607::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:18,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:18,607::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:18,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:18,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:18,607::__init__::225::IOProcess::(_processLogs) (543396) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:18,608::__init__::225::IOProcess::(_processLogs) (543396) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:18,608::__init__::225::IOProcess::(_processLogs) (543396) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:18,608::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:18,609::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:50:19,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:20,028::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0405115 s, 25.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:20,471::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:20,472::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:20,472::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:22,036::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:22,142::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0471693 s, 21.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:50:22,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07d0db3-96f9-4a00-957b-fede8e2ef86d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:22,155::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:50:22,155::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900062', 'lastCheck': '3.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139826', 'lastCheck': '7.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:22,155::task::1191::Storage.TaskManager.Task::(prepare) Task=`b07d0db3-96f9-4a00-957b-fede8e2ef86d`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000900062', 'lastCheck': '3.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00139826', 'lastCheck': '7.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:22,155::task::595::Storage.TaskManager.Task::(_updateState) Task=`b07d0db3-96f9-4a00-957b-fede8e2ef86d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:22,155::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:22,156::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:22,156::task::993::Storage.TaskManager.Task::(_decref) Task=`b07d0db3-96f9-4a00-957b-fede8e2ef86d`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:50:22,169::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:22,170::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:22,740::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:22,741::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:22,741::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:24,149::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:24,255::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.046212 s, 22.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:24,343::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:24,343::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:24,343::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:24,343::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:24,344::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:24,344::__init__::225::IOProcess::(_processLogs) (543397) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:24,344::__init__::225::IOProcess::(_processLogs) (543397) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:24,344::__init__::225::IOProcess::(_processLogs) (543397) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:24,345::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:50:24,345::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:50:24,408::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00226915 s, 218 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:24,408::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:24,408::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:24,408::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:24,409::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:24,409::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:24,409::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:24,409::__init__::225::IOProcess::(_processLogs) (543398) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:24,409::__init__::225::IOProcess::(_processLogs) (543398) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:24,409::__init__::225::IOProcess::(_processLogs) (543398) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:24,410::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:50:24,410::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:50:24,411::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:24,411::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:24,411::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:24,411::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:24,411::__init__::225::IOProcess::(_processLogs) (543399) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) (543399) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) (543399) Building response >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) (543399) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:24,412::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) (543400) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) (543400) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) (543400) Building response >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) (543400) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:24,413::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:50:24,414::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:24,414::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:24,414::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) (543401) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) (543401) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) (543401) Building response >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) (543401) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:24,415::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:25,478::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:25,478::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:25,478::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:50:25,805::task::595::Storage.TaskManager.Task::(_updateState) Task=`b029d19e-a3c8-40d4-92d1-870f49b17be8`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:50:25,805::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:50:25,805::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:50:25,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:25,806::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:25,806::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:25,806::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:25,806::__init__::225::IOProcess::(_processLogs) (543402) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:50:25,806::__init__::225::IOProcess::(_processLogs) (543402) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:50:25,825::__init__::225::IOProcess::(_processLogs) (543402) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:25,825::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:25,825::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:50:25,826::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10017::INFO::2014-08-11 17:50:25,826::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:50:25,826::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:50:25,826::task::1191::Storage.TaskManager.Task::(prepare) Task=`b029d19e-a3c8-40d4-92d1-870f49b17be8`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:50:25,827::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:50:25,827::task::595::Storage.TaskManager.Task::(_updateState) Task=`b029d19e-a3c8-40d4-92d1-870f49b17be8`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:50:25,827::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:50:25,827::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:50:25,828::__init__::225::IOProcess::(_processLogs) (543403) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:50:25,828::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:50:25,828::__init__::225::IOProcess::(_processLogs) (543403) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:50:25,828::task::993::Storage.TaskManager.Task::(_decref) Task=`b029d19e-a3c8-40d4-92d1-870f49b17be8`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:50:25,829::__init__::225::IOProcess::(_processLogs) (543403) Building response >Thread-19::DEBUG::2014-08-11 17:50:25,829::__init__::225::IOProcess::(_processLogs) (543403) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:25,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:25,829::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:50:25,851::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:50:25,990::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:50:25,990::task::595::Storage.TaskManager.Task::(_updateState) Task=`8931f7de-3c7a-42b3-8cf8-b718cc0c5f0d`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:25,990::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:50:26,016::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:26,016::task::1191::Storage.TaskManager.Task::(prepare) Task=`8931f7de-3c7a-42b3-8cf8-b718cc0c5f0d`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:26,016::task::595::Storage.TaskManager.Task::(_updateState) Task=`8931f7de-3c7a-42b3-8cf8-b718cc0c5f0d`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:26,016::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:26,016::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:26,016::task::993::Storage.TaskManager.Task::(_decref) Task=`8931f7de-3c7a-42b3-8cf8-b718cc0c5f0d`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:50:26,028::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:50:26,029::task::595::Storage.TaskManager.Task::(_updateState) Task=`5433b152-823d-458f-9329-5aa0dfe2ff36`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:50:26,029::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:50:26,029::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`71278c96-4035-4f29-ab37-f45db8519d0d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:50:26,029::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:50:26,029::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:50:26,029::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`71278c96-4035-4f29-ab37-f45db8519d0d`::Granted request >Thread-10197::DEBUG::2014-08-11 17:50:26,029::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5433b152-823d-458f-9329-5aa0dfe2ff36`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:50:26,029::task::993::Storage.TaskManager.Task::(_decref) Task=`5433b152-823d-458f-9329-5aa0dfe2ff36`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:50:26,047::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:26,047::task::1191::Storage.TaskManager.Task::(prepare) Task=`5433b152-823d-458f-9329-5aa0dfe2ff36`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:26,047::task::595::Storage.TaskManager.Task::(_updateState) Task=`5433b152-823d-458f-9329-5aa0dfe2ff36`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:50:26,047::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:50:26,047::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:50:26,047::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:50:26,048::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:50:26,048::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:50:26,048::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:50:26,048::task::993::Storage.TaskManager.Task::(_decref) Task=`5433b152-823d-458f-9329-5aa0dfe2ff36`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:50:26,263::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:26,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0545682 s, 18.8 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:50:26,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`f748eb78-c1bc-4e7a-9299-11809fd050d7`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:50:26,931::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) (543404) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:50:26,932::__init__::225::IOProcess::(_processLogs) (543404) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:50:26,962::__init__::225::IOProcess::(_processLogs) (543404) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:26,962::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:26,962::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:50:26,963::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:26,963::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10256::INFO::2014-08-11 17:50:26,963::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:50:26,963::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10256::DEBUG::2014-08-11 17:50:26,964::task::1191::Storage.TaskManager.Task::(prepare) Task=`f748eb78-c1bc-4e7a-9299-11809fd050d7`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:50:26,964::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:50:26,964::task::595::Storage.TaskManager.Task::(_updateState) Task=`f748eb78-c1bc-4e7a-9299-11809fd050d7`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:50:26,964::__init__::225::IOProcess::(_processLogs) (543405) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:50:26,965::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10256::DEBUG::2014-08-11 17:50:26,965::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:50:26,965::__init__::225::IOProcess::(_processLogs) (543405) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:50:26,965::task::993::Storage.TaskManager.Task::(_decref) Task=`f748eb78-c1bc-4e7a-9299-11809fd050d7`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:50:26,966::__init__::225::IOProcess::(_processLogs) (543405) Building response >Thread-19::DEBUG::2014-08-11 17:50:26,966::__init__::225::IOProcess::(_processLogs) (543405) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:26,966::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:26,966::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:50:26,988::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >VM Channels Listener::DEBUG::2014-08-11 17:50:27,614::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:27,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:27,746::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:27,747::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:28,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:28,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0307392 s, 33.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:28,609::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:28,609::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:28,609::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:28,610::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:28,610::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:28,610::__init__::225::IOProcess::(_processLogs) (543406) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:28,610::__init__::225::IOProcess::(_processLogs) (543406) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:28,610::__init__::225::IOProcess::(_processLogs) (543406) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:28,610::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:50:28,611::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:50:28,672::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000921785 s, 397 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:28,672::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) (543407) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) (543407) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:28,673::__init__::225::IOProcess::(_processLogs) (543407) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:28,674::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:28,674::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:50:30,483::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:50:30,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:30,542::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:30,543::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:30,553::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122907 s, 83.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:50:32,562::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:32,684::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0611059 s, 16.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:32,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:32,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:32,754::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:50:34,415::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:34,415::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:34,415::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:34,415::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:34,416::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:34,416::__init__::225::IOProcess::(_processLogs) (543408) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:34,416::__init__::225::IOProcess::(_processLogs) (543408) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:34,416::__init__::225::IOProcess::(_processLogs) (543408) Queuing response >Thread-28::DEBUG::2014-08-11 17:50:34,416::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:50:34,417::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:34,476::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:50:34,561::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00109071 s, 454 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:34,562::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:34,562::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) (543409) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) (543409) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) DEBUG|(543409) Building response >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) (543409) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:34,563::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:50:34,564::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:50:34,564::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:34,564::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) (543410) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:34,565::__init__::225::IOProcess::(_processLogs) (543410) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) (543410) Building response >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) (543410) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:34,566::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) (543411) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) (543411) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) (543411) Building response >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) (543411) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:34,567::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:50:34,568::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:34,568::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:34,568::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:34,568::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:34,568::__init__::225::IOProcess::(_processLogs) (543412) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:34,569::__init__::225::IOProcess::(_processLogs) (543412) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:34,569::__init__::225::IOProcess::(_processLogs) (543412) Building response >Thread-19::DEBUG::2014-08-11 17:50:34,569::__init__::225::IOProcess::(_processLogs) (543412) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:34,569::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:34,569::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:50:34,676::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:50:34,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:34,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0424181 s, 24.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:35,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:35,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:35,546::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:36,094::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:50:36,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4d37bb2-5b25-4f8a-ade3-8c131d7585ed`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:36,095::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:50:36,152::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:36,152::task::1191::Storage.TaskManager.Task::(prepare) Task=`f4d37bb2-5b25-4f8a-ade3-8c131d7585ed`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:36,152::task::595::Storage.TaskManager.Task::(_updateState) Task=`f4d37bb2-5b25-4f8a-ade3-8c131d7585ed`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:36,152::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:36,152::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:36,152::task::993::Storage.TaskManager.Task::(_decref) Task=`f4d37bb2-5b25-4f8a-ade3-8c131d7585ed`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:50:36,163::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:50:36,164::task::595::Storage.TaskManager.Task::(_updateState) Task=`305e4ed8-3ecc-49ee-ad3c-33bcb46531f5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:50:36,164::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:50:36,164::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`641e6607-8d52-4a18-8dba-ddc2e1403295`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:50:36,164::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:50:36,164::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:50:36,164::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`641e6607-8d52-4a18-8dba-ddc2e1403295`::Granted request >Thread-10197::DEBUG::2014-08-11 17:50:36,165::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`305e4ed8-3ecc-49ee-ad3c-33bcb46531f5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:50:36,165::task::993::Storage.TaskManager.Task::(_decref) Task=`305e4ed8-3ecc-49ee-ad3c-33bcb46531f5`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:50:36,181::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:36,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`305e4ed8-3ecc-49ee-ad3c-33bcb46531f5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:36,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`305e4ed8-3ecc-49ee-ad3c-33bcb46531f5`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:50:36,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:50:36,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:50:36,182::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:50:36,182::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:50:36,182::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:50:36,182::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:50:36,182::task::993::Storage.TaskManager.Task::(_decref) Task=`305e4ed8-3ecc-49ee-ad3c-33bcb46531f5`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:50:36,834::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:36,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0562636 s, 18.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:50:37,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`046d4716-64ab-41fc-8d3e-c5e1073c07b5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:37,361::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:50:37,361::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000921785', 'lastCheck': '8.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109071', 'lastCheck': '2.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:37,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`046d4716-64ab-41fc-8d3e-c5e1073c07b5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000921785', 'lastCheck': '8.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00109071', 'lastCheck': '2.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:37,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`046d4716-64ab-41fc-8d3e-c5e1073c07b5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:37,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:37,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:37,362::task::993::Storage.TaskManager.Task::(_decref) Task=`046d4716-64ab-41fc-8d3e-c5e1073c07b5`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:50:37,379::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:37,380::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:37,759::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:37,759::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:37,760::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) (543413) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:38,675::__init__::225::IOProcess::(_processLogs) (543413) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:38,676::__init__::225::IOProcess::(_processLogs) (543413) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:38,676::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:38,676::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:50:38,677::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:50:38,737::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00085907 s, 426 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:38,738::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:38,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:38,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:38,738::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:38,738::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:38,738::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:38,739::__init__::225::IOProcess::(_processLogs) (543414) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:38,739::__init__::225::IOProcess::(_processLogs) (543414) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:38,739::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543414) Building response >Thread-19::DEBUG::2014-08-11 17:50:38,739::__init__::225::IOProcess::(_processLogs) (543414) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:38,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:38,740::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:50:38,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:39,044::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028956 s, 35.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:40,551::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:40,552::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:40,552::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:50:40,858::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:50:41,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:41,172::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0611333 s, 16.8 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:50:42,020::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:42,764::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:42,764::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:42,765::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:43,181::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:43,285::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0454784 s, 22.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) (543415) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:44,569::__init__::225::IOProcess::(_processLogs) (543415) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:44,570::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543415) Building response >Thread-19::DEBUG::2014-08-11 17:50:44,570::__init__::225::IOProcess::(_processLogs) (543415) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:44,570::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:50:44,571::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:50:44,571::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:50:44,631::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000993213 s, 498 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) (543416) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:44,632::__init__::225::IOProcess::(_processLogs) (543416) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:44,633::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543416) Building response >Thread-19::DEBUG::2014-08-11 17:50:44,633::__init__::225::IOProcess::(_processLogs) (543416) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:44,633::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:44,633::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:44,634::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) (543417) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) (543417) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) (543417) Building response >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) (543417) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:44,635::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) (543418) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) (543418) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) (543418) Building response >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) (543418) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:44,636::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:44,637::__init__::225::IOProcess::(_processLogs) (543419) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:44,638::__init__::225::IOProcess::(_processLogs) (543419) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:44,638::__init__::225::IOProcess::(_processLogs) (543419) Building response >Thread-19::DEBUG::2014-08-11 17:50:44,638::__init__::225::IOProcess::(_processLogs) (543419) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:44,638::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:44,638::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:50:45,294::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:45,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0437478 s, 23.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:45,557::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:45,558::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:45,558::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:46,217::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:50:46,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8cf5f74-fccc-4916-a59a-ad424c815b4f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:46,217::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:50:46,306::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:46,306::task::1191::Storage.TaskManager.Task::(prepare) Task=`d8cf5f74-fccc-4916-a59a-ad424c815b4f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:46,306::task::595::Storage.TaskManager.Task::(_updateState) Task=`d8cf5f74-fccc-4916-a59a-ad424c815b4f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:46,306::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:46,307::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:46,307::task::993::Storage.TaskManager.Task::(_decref) Task=`d8cf5f74-fccc-4916-a59a-ad424c815b4f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:50:46,319::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:50:46,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d5234e8-eee1-49b6-ab6e-eb62732b9e98`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:50:46,319::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:50:46,319::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7f8ffcca-1be6-41fd-bacd-6022b9c21cdd`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:50:46,319::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:50:46,320::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:50:46,320::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7f8ffcca-1be6-41fd-bacd-6022b9c21cdd`::Granted request >Thread-10197::DEBUG::2014-08-11 17:50:46,320::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5d5234e8-eee1-49b6-ab6e-eb62732b9e98`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:50:46,320::task::993::Storage.TaskManager.Task::(_decref) Task=`5d5234e8-eee1-49b6-ab6e-eb62732b9e98`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:50:46,336::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:46,337::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d5234e8-eee1-49b6-ab6e-eb62732b9e98`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:46,337::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d5234e8-eee1-49b6-ab6e-eb62732b9e98`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:50:46,337::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:50:46,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:50:46,337::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:50:46,337::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:50:46,337::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:50:46,337::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:50:46,338::task::993::Storage.TaskManager.Task::(_decref) Task=`5d5234e8-eee1-49b6-ab6e-eb62732b9e98`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:50:47,405::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:47,475::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121926 s, 84.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:47,766::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:47,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:47,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:50:48,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:48,740::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:48,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:48,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:48,740::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) (543420) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) (543420) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543420) Building response >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) (543420) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:48,741::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:50:48,742::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:50:48,802::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000753837 s, 486 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:48,802::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:48,802::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:48,802::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:48,802::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:48,803::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:48,803::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:48,803::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:48,803::__init__::225::IOProcess::(_processLogs) (543421) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:48,803::__init__::225::IOProcess::(_processLogs) (543421) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:48,803::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543421) Building response >Thread-19::DEBUG::2014-08-11 17:50:48,804::__init__::225::IOProcess::(_processLogs) (543421) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:48,804::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:48,804::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:50:49,484::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:49,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0608102 s, 16.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:50,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:50,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:50,564::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:51,613::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:51,686::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133537 s, 76.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:50:52,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`a135b309-2119-49c5-8ba8-68c6c1435177`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:52,556::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:50:52,556::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753837', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000993213', 'lastCheck': '7.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:52,556::task::1191::Storage.TaskManager.Task::(prepare) Task=`a135b309-2119-49c5-8ba8-68c6c1435177`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000753837', 'lastCheck': '3.8', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000993213', 'lastCheck': '7.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:50:52,556::task::595::Storage.TaskManager.Task::(_updateState) Task=`a135b309-2119-49c5-8ba8-68c6c1435177`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:52,556::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:52,556::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:52,556::task::993::Storage.TaskManager.Task::(_decref) Task=`a135b309-2119-49c5-8ba8-68c6c1435177`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:50:52,573::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:50:52,573::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:52,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:52,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:52,774::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:53,695::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:53,805::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0511724 s, 20.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:54,638::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:54,638::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:54,638::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:54,638::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) (543422) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) (543422) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543422) Building response >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) (543422) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:54,639::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:54,640::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:50:54,640::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:50:54,700::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000895 s, 553 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) (543423) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:54,701::__init__::225::IOProcess::(_processLogs) (543423) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:54,702::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543423) Building response >Thread-19::DEBUG::2014-08-11 17:50:54,702::__init__::225::IOProcess::(_processLogs) (543423) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:54,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:54,702::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:50:54,702::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) (543424) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:54,703::__init__::225::IOProcess::(_processLogs) (543424) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) (543424) Building response >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) (543424) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:54,704::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) (543425) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) (543425) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) (543425) Building response >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) (543425) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:54,705::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:50:54,706::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:54,706::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:54,706::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:54,706::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:54,706::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:54,707::__init__::225::IOProcess::(_processLogs) (543426) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:50:54,707::__init__::225::IOProcess::(_processLogs) (543426) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:50:54,707::__init__::225::IOProcess::(_processLogs) (543426) Building response >Thread-19::DEBUG::2014-08-11 17:50:54,707::__init__::225::IOProcess::(_processLogs) (543426) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:54,707::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:54,707::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:50:55,570::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:55,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:50:55,571::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:50:55,813::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:50:55,876::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:50:55,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0155663 s, 65.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:50:56,404::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:50:56,405::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeba34bb-980e-4955-81d0-0681e4ca72a4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:50:56,405::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:50:56,471::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:56,471::task::1191::Storage.TaskManager.Task::(prepare) Task=`eeba34bb-980e-4955-81d0-0681e4ca72a4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:50:56,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`eeba34bb-980e-4955-81d0-0681e4ca72a4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:50:56,471::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:50:56,471::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:50:56,471::task::993::Storage.TaskManager.Task::(_decref) Task=`eeba34bb-980e-4955-81d0-0681e4ca72a4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:50:56,483::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:50:56,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`28546075-81a7-4221-9ca4-339bd358e88f`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:50:56,483::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:50:56,484::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dd0eb845-82a0-4b0f-9985-f8fae0331172`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:50:56,484::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:50:56,484::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:50:56,484::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`dd0eb845-82a0-4b0f-9985-f8fae0331172`::Granted request >Thread-10197::DEBUG::2014-08-11 17:50:56,484::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`28546075-81a7-4221-9ca4-339bd358e88f`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:50:56,484::task::993::Storage.TaskManager.Task::(_decref) Task=`28546075-81a7-4221-9ca4-339bd358e88f`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:50:56,500::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:56,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`28546075-81a7-4221-9ca4-339bd358e88f`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:50:56,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`28546075-81a7-4221-9ca4-339bd358e88f`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:50:56,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:50:56,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:50:56,501::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:50:56,501::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:50:56,501::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:50:56,501::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:50:56,501::task::993::Storage.TaskManager.Task::(_decref) Task=`28546075-81a7-4221-9ca4-339bd358e88f`::ref 0 aborting False >Thread-10256::DEBUG::2014-08-11 17:50:57,029::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:57,779::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:57,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:50:57,780::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:50:57,810::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:50:57,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:50:58,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0567243 s, 18.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:58,804::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) (543427) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:58,805::__init__::225::IOProcess::(_processLogs) (543427) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:58,806::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543427) Building response >Thread-19::DEBUG::2014-08-11 17:50:58,806::__init__::225::IOProcess::(_processLogs) (543427) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:58,806::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:58,806::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:50:58,807::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:50:58,867::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000800193 s, 457 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:50:58,867::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:50:58,867::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:50:58,867::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) (543428) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) (543428) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:50:58,868::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543428) Building response >Thread-19::DEBUG::2014-08-11 17:50:58,869::__init__::225::IOProcess::(_processLogs) (543428) Queuing response >Thread-19::DEBUG::2014-08-11 17:50:58,869::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:50:58,869::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:51:00,018::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:00,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0272391 s, 37.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:00,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:00,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:00,577::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:02,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:02,315::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0611254 s, 16.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:02,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:02,786::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:02,787::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:04,380::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:04,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0329079 s, 31.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:04,707::__init__::225::IOProcess::(_processLogs) (543429) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:04,708::__init__::225::IOProcess::(_processLogs) (543429) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:04,711::__init__::225::IOProcess::(_processLogs) (543429) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:04,711::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:51:04,711::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:51:04,772::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00239473 s, 207 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:04,772::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:04,772::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:04,772::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:04,772::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:04,773::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:04,773::__init__::225::IOProcess::(_processLogs) (543430) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:04,773::__init__::225::IOProcess::(_processLogs) (543430) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:04,773::__init__::225::IOProcess::(_processLogs) (543430) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:04,773::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:04,774::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:51:04,774::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:04,774::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:04,774::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:04,774::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) (543431) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) (543431) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) (543431) Building response >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) (543431) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:04,775::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) (543432) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) (543432) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) (543432) Building response >Thread-19::DEBUG::2014-08-11 17:51:04,776::__init__::225::IOProcess::(_processLogs) (543432) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) (543433) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:04,777::__init__::225::IOProcess::(_processLogs) (543433) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:04,778::__init__::225::IOProcess::(_processLogs) DEBUG|(543433) Building response >Thread-19::DEBUG::2014-08-11 17:51:04,778::__init__::225::IOProcess::(_processLogs) (543433) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:04,778::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:51:04,778::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >VM Channels Listener::DEBUG::2014-08-11 17:51:04,872::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >GuestMonitor-vm::DEBUG::2014-08-11 17:51:05,581::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:05,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:05,582::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:06,487::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:51:06,601::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:51:06,602::task::595::Storage.TaskManager.Task::(_updateState) Task=`db898b32-5535-4695-b773-34bb17ea1ba7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:06,603::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:51:06,604::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0574462 s, 17.8 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:51:06,621::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:06,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`db898b32-5535-4695-b773-34bb17ea1ba7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:06,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`db898b32-5535-4695-b773-34bb17ea1ba7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:06,621::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:06,621::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:06,622::task::993::Storage.TaskManager.Task::(_decref) Task=`db898b32-5535-4695-b773-34bb17ea1ba7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:51:06,633::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:51:06,633::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a81eb27-4a1f-4ad7-8249-7d6ba0d28190`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:51:06,633::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:51:06,633::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7e87e0d3-d037-47e6-a1f2-92d69aba7e90`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:51:06,633::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:51:06,634::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:51:06,634::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7e87e0d3-d037-47e6-a1f2-92d69aba7e90`::Granted request >Thread-10197::DEBUG::2014-08-11 17:51:06,635::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2a81eb27-4a1f-4ad7-8249-7d6ba0d28190`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:51:06,635::task::993::Storage.TaskManager.Task::(_decref) Task=`2a81eb27-4a1f-4ad7-8249-7d6ba0d28190`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:51:06,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:06,694::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a81eb27-4a1f-4ad7-8249-7d6ba0d28190`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:06,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a81eb27-4a1f-4ad7-8249-7d6ba0d28190`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:51:06,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:51:06,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:51:06,694::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:51:06,694::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:51:06,694::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:51:06,694::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:51:06,694::task::993::Storage.TaskManager.Task::(_decref) Task=`2a81eb27-4a1f-4ad7-8249-7d6ba0d28190`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:51:07,785::task::595::Storage.TaskManager.Task::(_updateState) Task=`f730e2e8-f527-469d-826d-7d7b1df229b1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:07,785::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:51:07,785::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800193', 'lastCheck': '8.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00239473', 'lastCheck': '3.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:07,786::task::1191::Storage.TaskManager.Task::(prepare) Task=`f730e2e8-f527-469d-826d-7d7b1df229b1`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000800193', 'lastCheck': '8.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00239473', 'lastCheck': '3.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:07,786::task::595::Storage.TaskManager.Task::(_updateState) Task=`f730e2e8-f527-469d-826d-7d7b1df229b1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:07,786::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:07,786::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:07,786::task::993::Storage.TaskManager.Task::(_decref) Task=`f730e2e8-f527-469d-826d-7d7b1df229b1`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:07,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:07,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:07,792::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:07,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:07,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:08,611::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:08,714::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443684 s, 23.1 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:51:08,869::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,871::__init__::225::IOProcess::(_processLogs) (543434) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:51:08,872::__init__::225::IOProcess::(_processLogs) (543434) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:51:08,872::__init__::225::IOProcess::(_processLogs) DEBUG|(543434) Building response >Thread-19::DEBUG::2014-08-11 17:51:08,872::__init__::225::IOProcess::(_processLogs) (543434) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,872::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:08,872::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:51:08,872::__init__::225::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) (543435) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) (543435) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:51:08,873::__init__::225::IOProcess::(_processLogs) DEBUG|(543435) Building response >Thread-19::DEBUG::2014-08-11 17:51:08,874::__init__::225::IOProcess::(_processLogs) (543435) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,875::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:08,876::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:51:08,879::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) (543436) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:51:08,880::__init__::225::IOProcess::(_processLogs) (543436) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:51:08,895::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543436) Building response >Thread-19::DEBUG::2014-08-11 17:51:08,895::__init__::225::IOProcess::(_processLogs) (543436) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,895::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:51:08,895::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,896::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,897::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,897::__init__::225::IOProcess::(_processLogs) (543437) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:51:08,897::__init__::225::IOProcess::(_processLogs) (543437) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:51:08,898::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543437) Building response >Thread-19::DEBUG::2014-08-11 17:51:08,898::__init__::225::IOProcess::(_processLogs) (543437) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,898::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:08,899::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-27::DEBUG::2014-08-11 17:51:08,899::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:51:08,899::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,899::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:51:08,899::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,899::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,899::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) (543438) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) (543438) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) (543438) Building response >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) (543438) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:08,900::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) (543439) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:51:08,901::__init__::225::IOProcess::(_processLogs) (543439) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:51:08,905::__init__::225::IOProcess::(_processLogs) Waiting for next request...DEBUG|(543439) Building response >Thread-19::DEBUG::2014-08-11 17:51:08,905::__init__::225::IOProcess::(_processLogs) (543439) Queuing response >Thread-27::DEBUG::2014-08-11 17:51:08,905::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:51:08,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::INFO::2014-08-11 17:51:08,906::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:51:08,906::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-27::INFO::2014-08-11 17:51:08,906::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,907::__init__::225::IOProcess::(_processLogs) (543440) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:08,908::__init__::225::IOProcess::(_processLogs) (543440) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:08,908::__init__::225::IOProcess::(_processLogs) DEBUG|(543440) Building response >Thread-27::DEBUG::2014-08-11 17:51:08,908::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:08,908::__init__::225::IOProcess::(_processLogs) (543440) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,968::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:08,968::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:51:08,969::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0007 s, 523 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:08,969::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) (543441) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) (543441) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:08,970::__init__::225::IOProcess::(_processLogs) (543441) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:08,971::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:08,971::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:10,587::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:10,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:10,588::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:10,722::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:10,828::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0465748 s, 22.0 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:51:10,884::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:51:12,036::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:12,797::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:12,797::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:12,797::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:12,836::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:12,947::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0521861 s, 19.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:14,779::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:14,779::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:14,779::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:14,779::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:14,779::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:14,779::__init__::225::IOProcess::(_processLogs) (543442) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:14,780::__init__::225::IOProcess::(_processLogs) (543442) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:14,780::__init__::225::IOProcess::(_processLogs) (543442) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:14,780::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:51:14,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:51:14,840::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00122715 s, 403 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:14,841::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:14,841::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:14,841::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:14,841::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) (543443) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) (543443) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) DEBUG|(543443) Building response >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) (543443) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:14,842::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:14,843::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) (543444) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) (543444) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) DEBUG|(543444) Building response >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) (543444) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:14,844::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) (543445) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) (543445) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:14,845::__init__::225::IOProcess::(_processLogs) DEBUG|(543445) Building response >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) (543445) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:14,846::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) (543446) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) (543446) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) (543446) Building response >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) (543446) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:14,847::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:14,848::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:51:14,955::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:15,042::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0281453 s, 36.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:15,592::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:15,592::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:15,592::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:16,820::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [1aa273ac] >Thread-10237::DEBUG::2014-08-11 17:51:16,821::task::595::Storage.TaskManager.Task::(_updateState) Task=`22207ea8-fe5a-4117-a54e-9ef30db886ae`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:16,821::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:51:16,856::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:16,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`22207ea8-fe5a-4117-a54e-9ef30db886ae`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:16,857::task::595::Storage.TaskManager.Task::(_updateState) Task=`22207ea8-fe5a-4117-a54e-9ef30db886ae`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:16,857::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:16,857::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:16,857::task::993::Storage.TaskManager.Task::(_decref) Task=`22207ea8-fe5a-4117-a54e-9ef30db886ae`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:51:16,924::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [1aa273ac] >Thread-10197::DEBUG::2014-08-11 17:51:16,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`34d5e6db-2fbc-412e-9a2f-850bd102d75e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:51:16,925::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:51:16,925::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fbcf0352-498a-43c7-a4bd-a55287f3132b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:51:16,925::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:51:16,925::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:51:16,925::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fbcf0352-498a-43c7-a4bd-a55287f3132b`::Granted request >Thread-10197::DEBUG::2014-08-11 17:51:16,927::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`34d5e6db-2fbc-412e-9a2f-850bd102d75e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:51:16,927::task::993::Storage.TaskManager.Task::(_decref) Task=`34d5e6db-2fbc-412e-9a2f-850bd102d75e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:51:16,985::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:16,986::task::1191::Storage.TaskManager.Task::(prepare) Task=`34d5e6db-2fbc-412e-9a2f-850bd102d75e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:16,986::task::595::Storage.TaskManager.Task::(_updateState) Task=`34d5e6db-2fbc-412e-9a2f-850bd102d75e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:51:16,986::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:51:16,986::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:51:16,986::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:51:16,986::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:51:16,986::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:51:16,986::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:51:16,986::task::993::Storage.TaskManager.Task::(_decref) Task=`34d5e6db-2fbc-412e-9a2f-850bd102d75e`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:51:17,050::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:17,163::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549596 s, 18.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:17,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:17,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:17,803::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) (543447) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:18,972::__init__::225::IOProcess::(_processLogs) (543447) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:18,973::__init__::225::IOProcess::(_processLogs) DEBUG|(543447) Building response >Thread-19::DEBUG::2014-08-11 17:51:18,973::__init__::225::IOProcess::(_processLogs) (543447) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:18,973::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:18,973::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:51:18,974::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:51:19,033::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000392568 s, 932 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:19,034::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:19,034::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:19,034::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:19,034::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:19,034::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:19,034::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:19,035::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:19,035::__init__::225::IOProcess::(_processLogs) (543448) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:19,035::__init__::225::IOProcess::(_processLogs) (543448) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:19,035::__init__::225::IOProcess::(_processLogs) (543448) Building response >Thread-19::DEBUG::2014-08-11 17:51:19,036::__init__::225::IOProcess::(_processLogs) (543448) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:19,036::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:19,036::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:51:19,171::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:19,260::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0305795 s, 33.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:20,595::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:20,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:20,596::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:21,269::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:21,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055706 s, 18.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:22,805::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:22,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:22,806::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:23,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`4adfee38-95a2-409b-86b5-ba98c7d93cf5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:23,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:51:23,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392568', 'lastCheck': '4.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122715', 'lastCheck': '8.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:23,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`4adfee38-95a2-409b-86b5-ba98c7d93cf5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000392568', 'lastCheck': '4.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00122715', 'lastCheck': '8.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:23,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`4adfee38-95a2-409b-86b5-ba98c7d93cf5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:23,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:23,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:23,136::task::993::Storage.TaskManager.Task::(_decref) Task=`4adfee38-95a2-409b-86b5-ba98c7d93cf5`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:51:23,155::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:23,156::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:23,392::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:23,478::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0248205 s, 41.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:24,847::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:24,847::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) (543449) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) (543449) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:24,848::__init__::225::IOProcess::(_processLogs) DEBUG|(543449) Building response >Thread-19::DEBUG::2014-08-11 17:51:24,849::__init__::225::IOProcess::(_processLogs) (543449) Queuing response >Thread-28::DEBUG::2014-08-11 17:51:24,849::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:24,850::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:24,909::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:51:24,911::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00085769 s, 577 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:24,911::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:24,911::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) (543450) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) (543450) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:24,912::__init__::225::IOProcess::(_processLogs) DEBUG|(543450) Building response >Thread-19::DEBUG::2014-08-11 17:51:24,913::__init__::225::IOProcess::(_processLogs) (543450) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:24,913::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:24,913::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:24,913::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:24,913::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:51:24,913::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) (543451) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) (543451) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) (543451) Building response >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) (543451) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:24,914::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:24,915::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) (543452) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) (543452) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) (543452) Building response >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) (543452) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:24,916::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:24,917::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:24,917::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:24,917::__init__::225::IOProcess::(_processLogs) (543453) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:24,917::__init__::225::IOProcess::(_processLogs) (543453) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:24,917::__init__::225::IOProcess::(_processLogs) (543453) Building response >Thread-19::DEBUG::2014-08-11 17:51:24,918::__init__::225::IOProcess::(_processLogs) (543453) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:24,918::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:24,918::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:51:25,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:51:25,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:25,601::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:25,602::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:25,624::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0357229 s, 28.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:51:25,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c30b706-33e4-4047-9767-f659da832d65`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:51:25,906::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:51:25,907::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:25,907::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:51:25,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:25,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:25,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:25,908::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:25,908::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:25,908::__init__::225::IOProcess::(_processLogs) (543454) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:51:25,908::__init__::225::IOProcess::(_processLogs) (543454) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:51:25,911::__init__::225::IOProcess::(_processLogs) DEBUG|(543454) Building response >Thread-19::DEBUG::2014-08-11 17:51:25,911::__init__::225::IOProcess::(_processLogs) (543454) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:25,911::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:51:25,911::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:51:25,912::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:25,912::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:51:25,912::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:25,912::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:25,912::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:25,912::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10017::INFO::2014-08-11 17:51:25,912::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:51:25,913::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:51:25,913::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c30b706-33e4-4047-9767-f659da832d65`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:51:25,914::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c30b706-33e4-4047-9767-f659da832d65`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:51:25,913::__init__::225::IOProcess::(_processLogs) (543455) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:51:25,914::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:51:25,914::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:51:25,914::__init__::225::IOProcess::(_processLogs) (543455) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:51:25,915::task::993::Storage.TaskManager.Task::(_decref) Task=`9c30b706-33e4-4047-9767-f659da832d65`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:51:25,915::__init__::225::IOProcess::(_processLogs) (543455) Building response >Thread-19::DEBUG::2014-08-11 17:51:25,915::__init__::225::IOProcess::(_processLogs) (543455) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:25,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:25,916::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:51:25,941::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:51:27,009::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:51:27,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ab16884-5c8a-4521-b2d7-c721bb66510a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:27,010::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10256::DEBUG::2014-08-11 17:51:27,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`c55b66fa-f74c-4d2f-8bf2-d021363f242d`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:51:27,038::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:27,039::__init__::225::IOProcess::(_processLogs) (543456) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:51:27,040::__init__::225::IOProcess::(_processLogs) (543456) Got request for method 'stat' >Thread-10237::INFO::2014-08-11 17:51:27,068::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:27,068::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ab16884-5c8a-4521-b2d7-c721bb66510a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:27,068::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ab16884-5c8a-4521-b2d7-c721bb66510a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:27,068::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:27,068::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:27,069::task::993::Storage.TaskManager.Task::(_decref) Task=`4ab16884-5c8a-4521-b2d7-c721bb66510a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:51:27,072::__init__::225::IOProcess::(_processLogs) DEBUG|(543456) Building response >Thread-19::DEBUG::2014-08-11 17:51:27,073::__init__::225::IOProcess::(_processLogs) (543456) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:27,073::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:51:27,073::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:51:27,073::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:27,074::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:51:27,074::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:27,074::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:27,074::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:27,074::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10256::INFO::2014-08-11 17:51:27,074::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:51:27,075::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:51:27,075::task::1191::Storage.TaskManager.Task::(prepare) Task=`c55b66fa-f74c-4d2f-8bf2-d021363f242d`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:51:27,075::__init__::225::IOProcess::(_processLogs) (543457) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:51:27,075::task::595::Storage.TaskManager.Task::(_updateState) Task=`c55b66fa-f74c-4d2f-8bf2-d021363f242d`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:51:27,076::__init__::225::IOProcess::(_processLogs) (543457) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:51:27,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:51:27,076::__init__::225::IOProcess::(_processLogs) (543457) Building response >Thread-10256::DEBUG::2014-08-11 17:51:27,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:51:27,077::__init__::225::IOProcess::(_processLogs) (543457) Queuing response >Thread-10256::DEBUG::2014-08-11 17:51:27,077::task::993::Storage.TaskManager.Task::(_decref) Task=`c55b66fa-f74c-4d2f-8bf2-d021363f242d`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:51:27,077::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:27,078::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10197::DEBUG::2014-08-11 17:51:27,079::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:51:27,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9b2d185-9788-4d63-ab74-75de2a76b956`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:51:27,079::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:51:27,080::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d736d833-2487-4b3c-b989-2460e9c9f696`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:51:27,080::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:51:27,080::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:51:27,080::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d736d833-2487-4b3c-b989-2460e9c9f696`::Granted request >Thread-10197::DEBUG::2014-08-11 17:51:27,080::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e9b2d185-9788-4d63-ab74-75de2a76b956`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:51:27,080::task::993::Storage.TaskManager.Task::(_decref) Task=`e9b2d185-9788-4d63-ab74-75de2a76b956`::ref 1 aborting False >Thread-10256::DEBUG::2014-08-11 17:51:27,098::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10197::INFO::2014-08-11 17:51:27,137::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:27,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9b2d185-9788-4d63-ab74-75de2a76b956`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:27,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9b2d185-9788-4d63-ab74-75de2a76b956`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:51:27,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:51:27,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:51:27,138::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:51:27,138::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:51:27,138::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:51:27,138::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:51:27,138::task::993::Storage.TaskManager.Task::(_decref) Task=`e9b2d185-9788-4d63-ab74-75de2a76b956`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:51:27,632::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:27,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0206475 s, 49.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:27,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:27,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:27,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:51:27,911::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) (543458) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:29,036::__init__::225::IOProcess::(_processLogs) (543458) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:29,037::__init__::225::IOProcess::(_processLogs) DEBUG|(543458) Building response >Thread-19::DEBUG::2014-08-11 17:51:29,037::__init__::225::IOProcess::(_processLogs) (543458) Queuing response >Thread-27::DEBUG::2014-08-11 17:51:29,037::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:29,038::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:29,096::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:51:29,097::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000364107 s, 1.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:29,097::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:29,097::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:29,097::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:29,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:29,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:29,098::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:29,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:29,098::__init__::225::IOProcess::(_processLogs) (543459) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:29,098::__init__::225::IOProcess::(_processLogs) (543459) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:29,098::__init__::225::IOProcess::(_processLogs) DEBUG|(543459) Building response >Thread-19::DEBUG::2014-08-11 17:51:29,098::__init__::225::IOProcess::(_processLogs) (543459) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:29,099::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:29,099::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:51:29,720::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:29,790::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124367 s, 82.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:30,607::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:30,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:30,608::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:31,799::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:31,896::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351877 s, 29.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:32,816::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:32,817::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:32,817::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:33,948::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:34,038::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0300998 s, 34.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:34,918::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:34,918::__init__::225::IOProcess::(_processLogs) Message size is 182 >VM Channels Listener::DEBUG::2014-08-11 17:51:34,918::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:51:34,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:34,919::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-28::DEBUG::2014-08-11 17:51:34,920::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:34,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:34,978::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:34,978::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:34,979::__init__::225::IOProcess::(_processLogs) (543460) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:34,979::__init__::225::IOProcess::(_processLogs) (543460) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:34,979::__init__::225::IOProcess::(_processLogs) (543460) Building response >Thread-19::DEBUG::2014-08-11 17:51:34,979::__init__::225::IOProcess::(_processLogs) (543460) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:34,979::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:34,979::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:51:34,980::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000901989 s, 549 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:34,980::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:34,980::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:34,980::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) (543461) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) (543461) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:34,981::__init__::225::IOProcess::(_processLogs) DEBUG|(543461) Building response >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) (543461) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:34,982::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) (543462) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) (543462) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) (543462) Building response >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) (543462) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:34,983::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:34,984::__init__::225::IOProcess::(_processLogs) (543463) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) (543463) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) (543463) Building response >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) (543463) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:34,985::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:34,986::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:34,986::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:34,986::__init__::225::IOProcess::(_processLogs) (543464) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:34,986::__init__::225::IOProcess::(_processLogs) (543464) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:34,986::__init__::225::IOProcess::(_processLogs) (543464) Building response >Thread-19::DEBUG::2014-08-11 17:51:34,986::__init__::225::IOProcess::(_processLogs) (543464) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:34,987::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:34,987::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:35,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:35,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:35,614::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:36,046::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:36,143::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0388048 s, 26.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:51:37,198::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:51:37,198::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cfc57a5-b8ca-40fe-b058-9344c093d16f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:37,198::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:51:37,212::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:37,212::task::1191::Storage.TaskManager.Task::(prepare) Task=`6cfc57a5-b8ca-40fe-b058-9344c093d16f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:37,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`6cfc57a5-b8ca-40fe-b058-9344c093d16f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:37,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:37,213::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:37,213::task::993::Storage.TaskManager.Task::(_decref) Task=`6cfc57a5-b8ca-40fe-b058-9344c093d16f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:51:37,219::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:51:37,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`003672f1-440e-4cf2-81b6-e11ed666d1fa`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:51:37,219::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:51:37,220::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1da5abb2-2240-4b2e-a105-173f2a8e45db`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:51:37,220::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:51:37,220::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:51:37,220::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`1da5abb2-2240-4b2e-a105-173f2a8e45db`::Granted request >Thread-10197::DEBUG::2014-08-11 17:51:37,220::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`003672f1-440e-4cf2-81b6-e11ed666d1fa`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:51:37,220::task::993::Storage.TaskManager.Task::(_decref) Task=`003672f1-440e-4cf2-81b6-e11ed666d1fa`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:51:37,237::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:37,237::task::1191::Storage.TaskManager.Task::(prepare) Task=`003672f1-440e-4cf2-81b6-e11ed666d1fa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:37,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`003672f1-440e-4cf2-81b6-e11ed666d1fa`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:51:37,237::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:51:37,237::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:51:37,238::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:51:37,238::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:51:37,238::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:51:37,238::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:51:37,238::task::993::Storage.TaskManager.Task::(_decref) Task=`003672f1-440e-4cf2-81b6-e11ed666d1fa`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:37,822::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:37,822::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:37,823::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:38,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:38,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134056 s, 76.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:51:38,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`e55a24a8-9f1d-4dd9-8c0a-6ad819572ad0`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:38,336::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:51:38,336::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364107', 'lastCheck': '9.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901989', 'lastCheck': '3.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:38,336::task::1191::Storage.TaskManager.Task::(prepare) Task=`e55a24a8-9f1d-4dd9-8c0a-6ad819572ad0`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364107', 'lastCheck': '9.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000901989', 'lastCheck': '3.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:38,336::task::595::Storage.TaskManager.Task::(_updateState) Task=`e55a24a8-9f1d-4dd9-8c0a-6ad819572ad0`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:38,336::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:38,337::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:38,337::task::993::Storage.TaskManager.Task::(_decref) Task=`e55a24a8-9f1d-4dd9-8c0a-6ad819572ad0`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:51:38,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:38,356::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) (543465) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:39,100::__init__::225::IOProcess::(_processLogs) (543465) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:39,101::__init__::225::IOProcess::(_processLogs) DEBUG|(543465) Building response >Thread-19::DEBUG::2014-08-11 17:51:39,101::__init__::225::IOProcess::(_processLogs) (543465) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:39,101::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:39,101::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:51:39,102::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:51:39,240::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000846508 s, 432 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:39,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:39,242::__init__::225::IOProcess::(_processLogs) (543466) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:39,242::__init__::225::IOProcess::(_processLogs) (543466) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:39,242::__init__::225::IOProcess::(_processLogs) DEBUG|(543466) Building response >Thread-19::DEBUG::2014-08-11 17:51:39,242::__init__::225::IOProcess::(_processLogs) (543466) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:39,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:39,243::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:51:40,232::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:40,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0188811 s, 54.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:40,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:40,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:40,620::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:51:40,949::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:51:42,167::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:51:42,363::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:42,461::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0355167 s, 28.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:42,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:42,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:42,826::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:44,469::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:44,540::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126453 s, 81.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) (543467) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) (543467) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:44,987::__init__::225::IOProcess::(_processLogs) DEBUG|(543467) Building response >Thread-19::DEBUG::2014-08-11 17:51:44,988::__init__::225::IOProcess::(_processLogs) (543467) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:44,988::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:44,988::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:51:44,988::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:51:45,086::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0207328 s, 23.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) (543468) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:45,087::__init__::225::IOProcess::(_processLogs) (543468) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:45,092::__init__::225::IOProcess::(_processLogs) DEBUG|(543468) Building response >Thread-19::DEBUG::2014-08-11 17:51:45,092::__init__::225::IOProcess::(_processLogs) (543468) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:45,092::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:45,092::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:45,093::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:45,093::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) (543469) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) (543469) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) (543469) Building response >Thread-19::DEBUG::2014-08-11 17:51:45,094::__init__::225::IOProcess::(_processLogs) (543469) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:45,095::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:45,095::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:45,095::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:45,095::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:51:45,095::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) (543470) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) (543470) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) (543470) Building response >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) (543470) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:45,096::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) (543471) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) (543471) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) (543471) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:45,097::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:45,098::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:45,626::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:45,626::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:45,627::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:46,548::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:46,702::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0337904 s, 30.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:51:47,271::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:51:47,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5c289d5-e88a-4131-8cd4-a1fc81be17d3`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:47,272::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:51:47,323::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:47,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`e5c289d5-e88a-4131-8cd4-a1fc81be17d3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:47,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`e5c289d5-e88a-4131-8cd4-a1fc81be17d3`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:47,324::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:47,324::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:47,324::task::993::Storage.TaskManager.Task::(_decref) Task=`e5c289d5-e88a-4131-8cd4-a1fc81be17d3`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:51:47,335::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:51:47,335::task::595::Storage.TaskManager.Task::(_updateState) Task=`28dca75c-14d1-4330-b762-47e60b2daeb7`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:51:47,335::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:51:47,335::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`55c13932-6227-4808-91ce-6867973c8d5e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:51:47,335::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:51:47,336::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:51:47,336::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`55c13932-6227-4808-91ce-6867973c8d5e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:51:47,336::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`28dca75c-14d1-4330-b762-47e60b2daeb7`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:51:47,336::task::993::Storage.TaskManager.Task::(_decref) Task=`28dca75c-14d1-4330-b762-47e60b2daeb7`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:51:47,353::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:47,354::task::1191::Storage.TaskManager.Task::(prepare) Task=`28dca75c-14d1-4330-b762-47e60b2daeb7`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:47,354::task::595::Storage.TaskManager.Task::(_updateState) Task=`28dca75c-14d1-4330-b762-47e60b2daeb7`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:51:47,354::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:51:47,354::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:51:47,354::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:51:47,354::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:51:47,354::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:51:47,354::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:51:47,354::task::993::Storage.TaskManager.Task::(_decref) Task=`28dca75c-14d1-4330-b762-47e60b2daeb7`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:47,832::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:47,833::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:47,833::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:48,710::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:48,784::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0160027 s, 64.0 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:49,243::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:49,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:49,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:49,244::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:49,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:49,244::__init__::225::IOProcess::(_processLogs) (543472) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:49,244::__init__::225::IOProcess::(_processLogs) (543472) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:49,244::__init__::225::IOProcess::(_processLogs) (543472) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:49,245::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:51:49,245::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:49,245::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:51:49,305::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000626168 s, 585 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:49,305::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:49,305::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:49,306::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:49,306::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:49,306::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:49,306::__init__::225::IOProcess::(_processLogs) (543473) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:49,306::__init__::225::IOProcess::(_processLogs) (543473) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:49,306::__init__::225::IOProcess::(_processLogs) (543473) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:49,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:49,307::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:50,632::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:50,633::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:50,633::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:50,792::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:50,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0152473 s, 67.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:52,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:52,839::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:52,840::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:52,874::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:52,974::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0411713 s, 24.9 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:51:53,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c4afdef-5753-46ee-888a-72b98221ebe1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:53,569::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:51:53,570::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626168', 'lastCheck': '4.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0207328', 'lastCheck': '8.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:53,570::task::1191::Storage.TaskManager.Task::(prepare) Task=`8c4afdef-5753-46ee-888a-72b98221ebe1`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000626168', 'lastCheck': '4.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0207328', 'lastCheck': '8.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:51:53,570::task::595::Storage.TaskManager.Task::(_updateState) Task=`8c4afdef-5753-46ee-888a-72b98221ebe1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:53,570::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:53,570::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:53,570::task::993::Storage.TaskManager.Task::(_decref) Task=`8c4afdef-5753-46ee-888a-72b98221ebe1`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:51:53,590::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:51:53,591::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:51:54,981::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:51:55,087::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0473307 s, 21.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:55,098::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) (543474) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) (543474) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:55,099::__init__::225::IOProcess::(_processLogs) (543474) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:55,100::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:51:55,100::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:55,100::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:51:55,162::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0013994 s, 354 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:55,162::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:55,162::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:55,162::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:55,162::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:55,163::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:55,163::__init__::225::IOProcess::(_processLogs) (543475) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:55,163::__init__::225::IOProcess::(_processLogs) (543475) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:55,163::__init__::225::IOProcess::(_processLogs) (543475) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:55,163::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:55,164::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:51:55,164::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:55,164::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:55,164::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:55,164::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) (543476) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) (543476) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) (543476) Building response >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) (543476) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:55,165::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) (543477) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) (543477) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) (543477) Building response >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) (543477) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:55,166::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:55,167::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:55,168::__init__::225::IOProcess::(_processLogs) (543478) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:51:55,168::__init__::225::IOProcess::(_processLogs) (543478) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:51:55,168::__init__::225::IOProcess::(_processLogs) (543478) Building response >Thread-19::DEBUG::2014-08-11 17:51:55,168::__init__::225::IOProcess::(_processLogs) (543478) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:55,168::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:55,168::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:51:55,636::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:55,637::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:51:55,637::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:51:55,957::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:51:57,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10256::DEBUG::2014-08-11 17:51:57,175::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:51:57,208::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0558079 s, 18.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:51:57,411::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:51:57,412::task::595::Storage.TaskManager.Task::(_updateState) Task=`68a1eaae-57d3-420e-a06c-f06dba344ffa`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:51:57,412::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:51:57,485::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:57,485::task::1191::Storage.TaskManager.Task::(prepare) Task=`68a1eaae-57d3-420e-a06c-f06dba344ffa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:51:57,485::task::595::Storage.TaskManager.Task::(_updateState) Task=`68a1eaae-57d3-420e-a06c-f06dba344ffa`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:51:57,485::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:51:57,486::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:51:57,486::task::993::Storage.TaskManager.Task::(_decref) Task=`68a1eaae-57d3-420e-a06c-f06dba344ffa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:51:57,498::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:51:57,498::task::595::Storage.TaskManager.Task::(_updateState) Task=`9608fd13-4d39-48c7-a708-9c2eab9ee1a0`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:51:57,498::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:51:57,498::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`993402d4-4770-4e27-a344-44e568ecfee7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:51:57,498::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:51:57,499::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:51:57,499::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`993402d4-4770-4e27-a344-44e568ecfee7`::Granted request >Thread-10197::DEBUG::2014-08-11 17:51:57,499::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9608fd13-4d39-48c7-a708-9c2eab9ee1a0`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:51:57,499::task::993::Storage.TaskManager.Task::(_decref) Task=`9608fd13-4d39-48c7-a708-9c2eab9ee1a0`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:51:57,515::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:57,516::task::1191::Storage.TaskManager.Task::(prepare) Task=`9608fd13-4d39-48c7-a708-9c2eab9ee1a0`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:51:57,516::task::595::Storage.TaskManager.Task::(_updateState) Task=`9608fd13-4d39-48c7-a708-9c2eab9ee1a0`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:51:57,516::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:51:57,516::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:51:57,516::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:51:57,516::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:51:57,516::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:51:57,516::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:51:57,516::task::993::Storage.TaskManager.Task::(_decref) Task=`9608fd13-4d39-48c7-a708-9c2eab9ee1a0`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:57,844::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:57,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:51:57,845::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:51:57,941::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:51:59,216::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:59,309::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Dummy-51::DEBUG::2014-08-11 17:51:59,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0317574 s, 32.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:59,310::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:59,311::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:59,311::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:59,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:59,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:59,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:59,314::__init__::225::IOProcess::(_processLogs) (543479) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:59,315::__init__::225::IOProcess::(_processLogs) (543479) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:59,316::__init__::225::IOProcess::(_processLogs) DEBUG|(543479) Building response >Thread-27::DEBUG::2014-08-11 17:51:59,316::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:51:59,317::__init__::225::IOProcess::(_processLogs) (543479) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:59,377::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:51:59,378::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000794893 s, 460 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:51:59,378::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:51:59,379::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:51:59,380::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:51:59,381::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:51:59,381::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:51:59,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:51:59,383::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:51:59,384::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:51:59,385::__init__::225::IOProcess::(_processLogs) (543480) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:51:59,386::__init__::225::IOProcess::(_processLogs) (543480) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:51:59,386::__init__::225::IOProcess::(_processLogs) (543480) Building response >Thread-19::DEBUG::2014-08-11 17:51:59,387::__init__::225::IOProcess::(_processLogs) (543480) Queuing response >Thread-19::DEBUG::2014-08-11 17:51:59,387::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:51:59,388::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:00,641::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:00,642::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:00,642::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:01,396::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:01,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.07036 s, 14.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:02,846::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:02,847::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:02,847::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:03,534::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:03,645::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515331 s, 19.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:52:04,975::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:52:05,168::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:05,168::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:05,168::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:05,168::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:05,168::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:05,169::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:05,169::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:05,169::__init__::225::IOProcess::(_processLogs) (543481) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:05,169::__init__::225::IOProcess::(_processLogs) (543481) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:05,172::__init__::225::IOProcess::(_processLogs) DEBUG|(543481) Building response >Thread-19::DEBUG::2014-08-11 17:52:05,173::__init__::225::IOProcess::(_processLogs) (543481) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:05,173::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:05,173::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:52:05,173::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:52:05,238::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00237629 s, 208 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:05,238::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:05,238::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) (543482) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) (543482) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:05,239::__init__::225::IOProcess::(_processLogs) DEBUG|(543482) Building response >Thread-19::DEBUG::2014-08-11 17:52:05,240::__init__::225::IOProcess::(_processLogs) (543482) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:05,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:05,240::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:52:05,240::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:05,240::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:52:05,240::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) (543483) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) (543483) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) (543483) Building response >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) (543483) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:05,241::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:05,242::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) (543484) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) (543484) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) (543484) Building response >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) (543484) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:05,243::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) (543485) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) (543485) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) DEBUG|(543485) Building response >Thread-19::DEBUG::2014-08-11 17:52:05,244::__init__::225::IOProcess::(_processLogs) (543485) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:05,245::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:52:05,245::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:05,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:05,647::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:05,648::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:05,653::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:05,743::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0299575 s, 34.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:52:07,582::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:52:07,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c3b88d6-e34b-42fc-853b-95f40369ce0f`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:07,583::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:52:07,643::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:07,643::task::1191::Storage.TaskManager.Task::(prepare) Task=`2c3b88d6-e34b-42fc-853b-95f40369ce0f`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:07,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`2c3b88d6-e34b-42fc-853b-95f40369ce0f`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:07,643::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:07,643::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:07,643::task::993::Storage.TaskManager.Task::(_decref) Task=`2c3b88d6-e34b-42fc-853b-95f40369ce0f`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:52:07,654::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:52:07,655::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f7869f8-e894-456e-8175-caf3dc723c74`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:52:07,655::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:52:07,655::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e6d1eeca-9084-4b8d-93d6-d61d79ef4268`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:52:07,655::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:52:07,655::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:52:07,655::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`e6d1eeca-9084-4b8d-93d6-d61d79ef4268`::Granted request >Thread-10197::DEBUG::2014-08-11 17:52:07,655::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8f7869f8-e894-456e-8175-caf3dc723c74`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:52:07,656::task::993::Storage.TaskManager.Task::(_decref) Task=`8f7869f8-e894-456e-8175-caf3dc723c74`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:52:07,672::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:07,672::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f7869f8-e894-456e-8175-caf3dc723c74`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:07,672::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f7869f8-e894-456e-8175-caf3dc723c74`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:52:07,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:52:07,673::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:52:07,673::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:52:07,673::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:52:07,673::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:52:07,673::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:52:07,673::task::993::Storage.TaskManager.Task::(_decref) Task=`8f7869f8-e894-456e-8175-caf3dc723c74`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:52:07,751::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:07,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:07,854::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:07,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:07,872::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0617507 s, 16.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:52:08,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`8295126e-5041-4108-8a00-29e954ee1133`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:08,784::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:52:08,784::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794893', 'lastCheck': '9.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237629', 'lastCheck': '3.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:08,784::task::1191::Storage.TaskManager.Task::(prepare) Task=`8295126e-5041-4108-8a00-29e954ee1133`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000794893', 'lastCheck': '9.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00237629', 'lastCheck': '3.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:08,784::task::595::Storage.TaskManager.Task::(_updateState) Task=`8295126e-5041-4108-8a00-29e954ee1133`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:08,784::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:08,784::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:08,784::task::993::Storage.TaskManager.Task::(_decref) Task=`8295126e-5041-4108-8a00-29e954ee1133`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:52:08,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:08,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:52:09,385::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:09,385::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:09,385::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:09,385::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:09,385::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:09,385::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:09,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:09,386::__init__::225::IOProcess::(_processLogs) (543486) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:09,386::__init__::225::IOProcess::(_processLogs) (543486) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:09,386::__init__::225::IOProcess::(_processLogs) DEBUG|(543486) Building response >Thread-27::DEBUG::2014-08-11 17:52:09,387::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:09,387::__init__::225::IOProcess::(_processLogs) (543486) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:09,445::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:09,446::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:52:09,457::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00206951 s, 177 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:09,457::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:09,457::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:09,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:09,457::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:09,458::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:09,458::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:09,458::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:09,458::__init__::225::IOProcess::(_processLogs) (543487) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:09,458::__init__::225::IOProcess::(_processLogs) (543487) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:09,458::__init__::225::IOProcess::(_processLogs) DEBUG|(543487) Building response >Thread-19::DEBUG::2014-08-11 17:52:09,459::__init__::225::IOProcess::(_processLogs) (543487) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:09,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:09,459::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:52:09,880::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:09,957::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.017464 s, 58.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:10,653::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:10,654::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:10,654::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:52:10,978::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:52:11,964::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:12,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0501626 s, 20.4 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:52:12,251::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:12,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:12,858::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:12,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:14,082::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:14,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0271918 s, 37.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) (543488) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:15,246::__init__::225::IOProcess::(_processLogs) (543488) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:15,247::__init__::225::IOProcess::(_processLogs) DEBUG|(543488) Building response >Thread-28::DEBUG::2014-08-11 17:52:15,247::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:15,247::__init__::225::IOProcess::(_processLogs) (543488) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:15,307::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:15,307::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:52:15,310::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00145522 s, 340 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:15,310::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:15,310::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:15,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:15,310::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:15,310::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:15,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:15,311::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:15,311::__init__::225::IOProcess::(_processLogs) (543489) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:15,311::__init__::225::IOProcess::(_processLogs) (543489) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:15,312::__init__::225::IOProcess::(_processLogs) DEBUG|(543489) Building response >Thread-19::DEBUG::2014-08-11 17:52:15,312::__init__::225::IOProcess::(_processLogs) (543489) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:15,312::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:15,312::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:52:15,313::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:15,313::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:52:15,313::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:15,313::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:15,313::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:15,313::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) (543490) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) (543490) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) (543490) Building response >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) (543490) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:15,314::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) (543491) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) (543491) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) (543491) Building response >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) (543491) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:15,315::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) (543492) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:15,316::__init__::225::IOProcess::(_processLogs) (543492) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:15,317::__init__::225::IOProcess::(_processLogs) (543492) Building response >Thread-19::DEBUG::2014-08-11 17:52:15,317::__init__::225::IOProcess::(_processLogs) (543492) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:15,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:15,317::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:15,659::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:15,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:15,660::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:16,176::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:16,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0483086 s, 21.2 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:52:17,728::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [13b5bee0] >Thread-10237::DEBUG::2014-08-11 17:52:17,729::task::595::Storage.TaskManager.Task::(_updateState) Task=`db006132-aeb8-4ed9-9646-2948e6c8d530`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:17,729::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:52:17,742::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:17,742::task::1191::Storage.TaskManager.Task::(prepare) Task=`db006132-aeb8-4ed9-9646-2948e6c8d530`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:17,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`db006132-aeb8-4ed9-9646-2948e6c8d530`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:17,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:17,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:17,742::task::993::Storage.TaskManager.Task::(_decref) Task=`db006132-aeb8-4ed9-9646-2948e6c8d530`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:52:17,754::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [13b5bee0] >Thread-10197::DEBUG::2014-08-11 17:52:17,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d01eee1-093d-4825-b71b-4118622d0f26`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:52:17,755::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:52:17,756::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`163815df-dc11-45a2-b2a9-dbcd7400d571`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:52:17,756::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:52:17,756::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:52:17,756::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`163815df-dc11-45a2-b2a9-dbcd7400d571`::Granted request >Thread-10197::DEBUG::2014-08-11 17:52:17,757::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8d01eee1-093d-4825-b71b-4118622d0f26`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:52:17,757::task::993::Storage.TaskManager.Task::(_decref) Task=`8d01eee1-093d-4825-b71b-4118622d0f26`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:52:17,793::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:17,793::task::1191::Storage.TaskManager.Task::(prepare) Task=`8d01eee1-093d-4825-b71b-4118622d0f26`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:17,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`8d01eee1-093d-4825-b71b-4118622d0f26`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:52:17,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:52:17,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:52:17,793::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:52:17,793::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:52:17,793::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:52:17,793::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:52:17,794::task::993::Storage.TaskManager.Task::(_decref) Task=`8d01eee1-093d-4825-b71b-4118622d0f26`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:17,864::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:17,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:17,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:18,292::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:18,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0135795 s, 75.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) (543493) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) (543493) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) (543493) Building response >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) (543493) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:19,460::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:19,461::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:52:19,461::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:52:19,520::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000462685 s, 791 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:19,520::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:19,521::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:19,521::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:19,521::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:19,521::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:19,522::__init__::225::IOProcess::(_processLogs) (543494) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:19,522::__init__::225::IOProcess::(_processLogs) (543494) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:19,522::__init__::225::IOProcess::(_processLogs) (543494) Building response >Thread-19::DEBUG::2014-08-11 17:52:19,522::__init__::225::IOProcess::(_processLogs) (543494) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:19,522::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:19,522::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:52:20,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:20,463::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.025858 s, 39.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:20,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:20,666::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:20,667::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:22,522::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:22,610::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0277508 s, 36.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:22,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:22,871::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:22,872::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:23,992::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef4f6c5b-990a-4e43-909d-ac9f383f3cb5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:23,993::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:52:23,993::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462685', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145522', 'lastCheck': '8.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:23,993::task::1191::Storage.TaskManager.Task::(prepare) Task=`ef4f6c5b-990a-4e43-909d-ac9f383f3cb5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000462685', 'lastCheck': '4.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00145522', 'lastCheck': '8.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:23,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`ef4f6c5b-990a-4e43-909d-ac9f383f3cb5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:23,993::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:23,993::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:23,993::task::993::Storage.TaskManager.Task::(_decref) Task=`ef4f6c5b-990a-4e43-909d-ac9f383f3cb5`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:52:24,013::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:24,013::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:24,619::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:24,732::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0534155 s, 19.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:25,317::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:25,317::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:25,317::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:25,318::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:25,318::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:25,318::__init__::225::IOProcess::(_processLogs) (543495) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:25,318::__init__::225::IOProcess::(_processLogs) (543495) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:25,318::__init__::225::IOProcess::(_processLogs) (543495) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:25,318::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:52:25,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:25,319::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:52:25,381::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00102655 s, 482 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:25,381::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) (543496) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:25,382::__init__::225::IOProcess::(_processLogs) (543496) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:25,383::__init__::225::IOProcess::(_processLogs) DEBUG|(543496) Building response >Thread-19::DEBUG::2014-08-11 17:52:25,383::__init__::225::IOProcess::(_processLogs) (543496) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:25,383::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:25,383::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:52:25,383::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) (543497) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) (543497) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:25,384::__init__::225::IOProcess::(_processLogs) (543497) Building response >Thread-19::DEBUG::2014-08-11 17:52:25,385::__init__::225::IOProcess::(_processLogs) (543497) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:25,385::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:25,385::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:25,385::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:25,385::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:52:25,385::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) (543498) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) (543498) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) (543498) Building response >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) (543498) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:25,386::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:25,387::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:52:25,387::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:25,387::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:25,387::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:25,387::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:25,387::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:25,388::__init__::225::IOProcess::(_processLogs) (543499) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:25,388::__init__::225::IOProcess::(_processLogs) (543499) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:25,388::__init__::225::IOProcess::(_processLogs) (543499) Building response >Thread-19::DEBUG::2014-08-11 17:52:25,388::__init__::225::IOProcess::(_processLogs) (543499) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:25,388::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:25,388::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:25,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:25,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:25,672::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:52:26,024::task::595::Storage.TaskManager.Task::(_updateState) Task=`1007f0d0-c3ce-4760-bb2d-c6d2150adc91`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:52:26,024::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:52:26,024::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) (543500) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:52:26,025::__init__::225::IOProcess::(_processLogs) (543500) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:52:26,028::__init__::225::IOProcess::(_processLogs) DEBUG|(543500) Building response >Thread-19::DEBUG::2014-08-11 17:52:26,029::__init__::225::IOProcess::(_processLogs) (543500) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:26,029::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:26,029::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:52:26,029::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:26,029::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:52:26,030::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:26,030::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:52:26,030::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:52:26,030::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:52:26,031::task::1191::Storage.TaskManager.Task::(prepare) Task=`1007f0d0-c3ce-4760-bb2d-c6d2150adc91`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:52:26,031::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:52:26,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`1007f0d0-c3ce-4760-bb2d-c6d2150adc91`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:52:26,031::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:52:26,032::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:52:26,032::__init__::225::IOProcess::(_processLogs) (543501) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:52:26,032::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:52:26,032::__init__::225::IOProcess::(_processLogs) (543501) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:52:26,033::task::993::Storage.TaskManager.Task::(_decref) Task=`1007f0d0-c3ce-4760-bb2d-c6d2150adc91`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:52:26,033::__init__::225::IOProcess::(_processLogs) (543501) Building response >Thread-19::DEBUG::2014-08-11 17:52:26,033::__init__::225::IOProcess::(_processLogs) (543501) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:26,033::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:26,033::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:52:26,054::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:52:26,740::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:26,817::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0180276 s, 56.8 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:52:27,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`6efe090b-586a-49b1-8dcc-ed0fd545877e`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:52:27,309::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:52:27,309::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:27,309::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) (543502) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:52:27,310::__init__::225::IOProcess::(_processLogs) (543502) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:52:27,311::__init__::225::IOProcess::(_processLogs) DEBUG|(543502) Building response >Thread-19::DEBUG::2014-08-11 17:52:27,311::__init__::225::IOProcess::(_processLogs) (543502) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:27,311::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:52:27,312::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:52:27,312::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:27,312::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:52:27,312::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:27,312::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:27,312::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:27,313::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-10256::INFO::2014-08-11 17:52:27,313::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:52:27,313::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:52:27,313::task::1191::Storage.TaskManager.Task::(prepare) Task=`6efe090b-586a-49b1-8dcc-ed0fd545877e`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10256::DEBUG::2014-08-11 17:52:27,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`6efe090b-586a-49b1-8dcc-ed0fd545877e`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:52:27,314::__init__::225::IOProcess::(_processLogs) (543503) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:52:27,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:52:27,314::__init__::225::IOProcess::(_processLogs) (543503) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:52:27,315::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:52:27,315::__init__::225::IOProcess::(_processLogs) (543503) Building response >Thread-10256::DEBUG::2014-08-11 17:52:27,315::task::993::Storage.TaskManager.Task::(_decref) Task=`6efe090b-586a-49b1-8dcc-ed0fd545877e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:52:27,316::__init__::225::IOProcess::(_processLogs) (543503) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:27,316::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:27,316::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:52:27,337::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:52:27,843::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10237::DEBUG::2014-08-11 17:52:27,843::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e40032e-7f00-4836-b046-b2bcff7fbcff`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:27,843::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:52:27,874::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:27,874::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e40032e-7f00-4836-b046-b2bcff7fbcff`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:27,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e40032e-7f00-4836-b046-b2bcff7fbcff`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:27,874::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:27,874::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:27,874::task::993::Storage.TaskManager.Task::(_decref) Task=`4e40032e-7f00-4836-b046-b2bcff7fbcff`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:27,877::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:27,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:27,878::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:52:27,885::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] flowID [4337c859] >Thread-10197::DEBUG::2014-08-11 17:52:27,885::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb0f10df-19aa-4896-9212-c2975975bdad`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:52:27,885::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:52:27,885::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a3b88936-9f3a-4b10-9805-56e1dce9c2f0`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:52:27,886::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:52:27,886::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:52:27,886::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a3b88936-9f3a-4b10-9805-56e1dce9c2f0`::Granted request >Thread-10197::DEBUG::2014-08-11 17:52:27,886::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fb0f10df-19aa-4896-9212-c2975975bdad`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:52:27,886::task::993::Storage.TaskManager.Task::(_decref) Task=`fb0f10df-19aa-4896-9212-c2975975bdad`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:52:27,906::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:27,906::task::1191::Storage.TaskManager.Task::(prepare) Task=`fb0f10df-19aa-4896-9212-c2975975bdad`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:27,906::task::595::Storage.TaskManager.Task::(_updateState) Task=`fb0f10df-19aa-4896-9212-c2975975bdad`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:52:27,906::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:52:27,906::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:52:27,907::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:52:27,907::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:52:27,907::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:52:27,907::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:52:27,907::task::993::Storage.TaskManager.Task::(_decref) Task=`fb0f10df-19aa-4896-9212-c2975975bdad`::ref 0 aborting False >VM Channels Listener::DEBUG::2014-08-11 17:52:28,038::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:52:28,825::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:28,897::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128712 s, 79.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:29,522::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) (543504) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:29,523::__init__::225::IOProcess::(_processLogs) (543504) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:29,525::__init__::225::IOProcess::(_processLogs) DEBUG|(543504) Building response >Thread-19::DEBUG::2014-08-11 17:52:29,525::__init__::225::IOProcess::(_processLogs) (543504) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:29,526::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:29,526::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:52:29,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:52:29,586::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000845942 s, 433 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:29,587::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:29,587::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:29,587::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:29,587::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:29,587::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:29,587::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:29,588::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:29,588::__init__::225::IOProcess::(_processLogs) (543505) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:29,588::__init__::225::IOProcess::(_processLogs) (543505) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:29,588::__init__::225::IOProcess::(_processLogs) DEBUG|(543505) Building response >Thread-19::DEBUG::2014-08-11 17:52:29,588::__init__::225::IOProcess::(_processLogs) (543505) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:29,589::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:29,589::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:30,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:30,678::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:30,679::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:30,905::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:30,979::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153655 s, 66.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:32,884::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:32,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:32,885::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:32,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:33,077::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0270254 s, 37.9 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:52:35,048::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:52:35,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:35,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153106 s, 66.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) (543506) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:35,388::__init__::225::IOProcess::(_processLogs) (543506) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:35,389::__init__::225::IOProcess::(_processLogs) DEBUG|(543506) Building response >Thread-19::DEBUG::2014-08-11 17:52:35,389::__init__::225::IOProcess::(_processLogs) (543506) Queuing response >Thread-28::DEBUG::2014-08-11 17:52:35,389::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:35,390::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:35,449::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:52:35,454::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00281669 s, 176 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:35,454::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:35,454::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) (543507) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) (543507) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:35,455::__init__::225::IOProcess::(_processLogs) DEBUG|(543507) Building response >Thread-19::DEBUG::2014-08-11 17:52:35,456::__init__::225::IOProcess::(_processLogs) (543507) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:35,456::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:52:35,456::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:35,457::__init__::225::IOProcess::(_processLogs) (543508) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) (543508) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) (543508) Building response >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) (543508) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:35,458::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) (543509) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) (543509) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) (543509) Building response >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) (543509) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:35,459::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:35,460::__init__::225::IOProcess::(_processLogs) (543510) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:35,461::__init__::225::IOProcess::(_processLogs) (543510) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:35,461::__init__::225::IOProcess::(_processLogs) (543510) Building response >Thread-19::DEBUG::2014-08-11 17:52:35,461::__init__::225::IOProcess::(_processLogs) (543510) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:35,461::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:35,461::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:35,684::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:35,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:35,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:37,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:37,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013418 s, 76.3 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:37,888::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:37,889::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:37,889::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:37,981::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:52:37,981::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7b8db6c-4422-4864-bed1-45efe2bb689c`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:37,981::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:52:38,030::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:38,030::task::1191::Storage.TaskManager.Task::(prepare) Task=`d7b8db6c-4422-4864-bed1-45efe2bb689c`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:38,030::task::595::Storage.TaskManager.Task::(_updateState) Task=`d7b8db6c-4422-4864-bed1-45efe2bb689c`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:38,030::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:38,030::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:38,030::task::993::Storage.TaskManager.Task::(_decref) Task=`d7b8db6c-4422-4864-bed1-45efe2bb689c`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:52:38,042::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:52:38,043::task::595::Storage.TaskManager.Task::(_updateState) Task=`05ce230b-2846-4b53-a37a-cfdd191e38ed`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:52:38,043::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:52:38,043::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`54895af8-c66d-44ee-b513-6ca7755be368`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:52:38,043::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:52:38,043::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:52:38,044::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`54895af8-c66d-44ee-b513-6ca7755be368`::Granted request >Thread-10197::DEBUG::2014-08-11 17:52:38,044::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`05ce230b-2846-4b53-a37a-cfdd191e38ed`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:52:38,044::task::993::Storage.TaskManager.Task::(_decref) Task=`05ce230b-2846-4b53-a37a-cfdd191e38ed`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:52:38,061::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:38,061::task::1191::Storage.TaskManager.Task::(prepare) Task=`05ce230b-2846-4b53-a37a-cfdd191e38ed`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620958318592', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:38,061::task::595::Storage.TaskManager.Task::(_updateState) Task=`05ce230b-2846-4b53-a37a-cfdd191e38ed`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:52:38,061::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:52:38,061::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:52:38,061::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:52:38,062::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:52:38,062::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:52:38,062::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:52:38,062::task::993::Storage.TaskManager.Task::(_decref) Task=`05ce230b-2846-4b53-a37a-cfdd191e38ed`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:52:39,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c2ec72d-df81-4424-b131-476aeb9a3d05`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:39,219::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:52:39,219::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845942', 'lastCheck': '9.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00281669', 'lastCheck': '3.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:39,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`7c2ec72d-df81-4424-b131-476aeb9a3d05`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000845942', 'lastCheck': '9.6', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00281669', 'lastCheck': '3.8', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:39,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`7c2ec72d-df81-4424-b131-476aeb9a3d05`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:39,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:39,220::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:39,220::task::993::Storage.TaskManager.Task::(_decref) Task=`7c2ec72d-df81-4424-b131-476aeb9a3d05`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:52:39,242::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:39,243::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:39,248::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:39,320::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0134868 s, 75.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:39,589::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:39,589::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) (543511) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) (543511) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:39,590::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543511) Building response >Thread-19::DEBUG::2014-08-11 17:52:39,591::__init__::225::IOProcess::(_processLogs) (543511) Queuing response >Thread-27::DEBUG::2014-08-11 17:52:39,591::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:39,591::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:39,651::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:52:39,651::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000550595 s, 665 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:39,652::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:39,653::__init__::225::IOProcess::(_processLogs) (543512) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:39,653::__init__::225::IOProcess::(_processLogs) (543512) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:39,653::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543512) Building response >Thread-19::DEBUG::2014-08-11 17:52:39,653::__init__::225::IOProcess::(_processLogs) (543512) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:39,654::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:39,654::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:40,691::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:40,691::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:40,692::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:52:41,062::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:52:41,328::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:41,423::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0361362 s, 28.3 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:52:42,392::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:42,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:42,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:42,892::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:43,431::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:43,542::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.052834 s, 19.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:45,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:45,461::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:45,461::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:45,461::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:45,461::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:45,462::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:45,462::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:45,462::__init__::225::IOProcess::(_processLogs) (543513) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:45,462::__init__::225::IOProcess::(_processLogs) (543513) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:45,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543513) Building response >Thread-19::DEBUG::2014-08-11 17:52:45,466::__init__::225::IOProcess::(_processLogs) (543513) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:45,466::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:52:45,467::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:52:45,467::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:52:45,526::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000372817 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:45,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:45,527::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:45,527::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:45,527::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:45,527::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:45,527::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:45,528::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:45,528::__init__::225::IOProcess::(_processLogs) (543514) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:45,528::__init__::225::IOProcess::(_processLogs) (543514) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:45,528::__init__::225::IOProcess::(_processLogs) (543514) Building response >Thread-19::DEBUG::2014-08-11 17:52:45,528::__init__::225::IOProcess::(_processLogs) (543514) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:45,528::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:45,529::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) (543515) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) (543515) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) (543515) Building response >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) (543515) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:45,530::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) (543516) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) (543516) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) (543516) Building response >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) (543516) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:45,531::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:45,532::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:45,533::__init__::225::IOProcess::(_processLogs) (543517) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:45,533::__init__::225::IOProcess::(_processLogs) (543517) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:45,533::__init__::225::IOProcess::(_processLogs) (543517) Building response >Thread-19::DEBUG::2014-08-11 17:52:45,533::__init__::225::IOProcess::(_processLogs) (543517) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:45,533::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:45,533::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:52:45,550::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:45,654::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0456682 s, 22.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:45,695::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:45,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:45,696::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:47,661::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:47,769::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0488433 s, 21.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:47,897::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:47,897::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:47,897::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:48,119::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:52:48,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`81963b22-80fa-42c8-9ce4-dd95127f05d1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:48,120::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:52:48,190::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:48,190::task::1191::Storage.TaskManager.Task::(prepare) Task=`81963b22-80fa-42c8-9ce4-dd95127f05d1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:48,190::task::595::Storage.TaskManager.Task::(_updateState) Task=`81963b22-80fa-42c8-9ce4-dd95127f05d1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:48,190::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:48,190::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:48,190::task::993::Storage.TaskManager.Task::(_decref) Task=`81963b22-80fa-42c8-9ce4-dd95127f05d1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:52:48,227::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:52:48,228::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7e48090-e4fc-41ac-86bd-594135592e75`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:52:48,228::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:52:48,229::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7a149dde-7c34-445e-8521-9d7779b3cb3f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:52:48,229::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:52:48,229::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:52:48,229::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7a149dde-7c34-445e-8521-9d7779b3cb3f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:52:48,229::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`f7e48090-e4fc-41ac-86bd-594135592e75`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:52:48,229::task::993::Storage.TaskManager.Task::(_decref) Task=`f7e48090-e4fc-41ac-86bd-594135592e75`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:52:48,246::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:48,247::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7e48090-e4fc-41ac-86bd-594135592e75`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:48,247::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7e48090-e4fc-41ac-86bd-594135592e75`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:52:48,247::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:52:48,247::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:52:48,247::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:52:48,247::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:52:48,247::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:52:48,247::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:52:48,247::task::993::Storage.TaskManager.Task::(_decref) Task=`f7e48090-e4fc-41ac-86bd-594135592e75`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:52:49,654::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:49,654::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:49,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) (543518) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) (543518) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) (543518) Building response >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) (543518) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:49,655::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:52:49,656::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:49,656::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:52:49,716::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000703696 s, 520 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) (543519) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:49,717::__init__::225::IOProcess::(_processLogs) (543519) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:49,718::__init__::225::IOProcess::(_processLogs) DEBUG|(543519) Building response >Thread-19::DEBUG::2014-08-11 17:52:49,718::__init__::225::IOProcess::(_processLogs) DEBUG|(543519) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:49,718::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:49,719::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:52:49,778::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:49,909::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0729428 s, 14.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:50,701::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:50,702::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:50,702::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:51,917::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:51,996::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0193347 s, 53.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:52,903::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:52,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:52,904::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:52:54,004::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:54,125::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0621638 s, 16.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:52:54,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`99731156-5955-44ac-b1d3-e77dc7775873`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:54,434::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:52:54,434::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703696', 'lastCheck': '4.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372817', 'lastCheck': '8.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:54,434::task::1191::Storage.TaskManager.Task::(prepare) Task=`99731156-5955-44ac-b1d3-e77dc7775873`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000703696', 'lastCheck': '4.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000372817', 'lastCheck': '8.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:52:54,434::task::595::Storage.TaskManager.Task::(_updateState) Task=`99731156-5955-44ac-b1d3-e77dc7775873`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:54,434::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:54,434::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:54,434::task::993::Storage.TaskManager.Task::(_decref) Task=`99731156-5955-44ac-b1d3-e77dc7775873`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:52:54,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:52:54,453::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:52:55,533::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:55,533::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:55,533::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:55,533::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:55,534::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-28::DEBUG::2014-08-11 17:52:55,534::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:52:55,534::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:55,593::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:55,593::__init__::225::IOProcess::(_processLogs) (543520) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:55,593::__init__::225::IOProcess::(_processLogs) (543520) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:55,593::__init__::225::IOProcess::(_processLogs) (543520) Building response >Thread-19::DEBUG::2014-08-11 17:52:55,593::__init__::225::IOProcess::(_processLogs) (543520) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:55,594::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:55,594::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:52:55,595::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00087737 s, 564 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:55,595::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:55,595::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:55,595::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:55,595::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:55,595::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:55,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:55,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:55,596::__init__::225::IOProcess::(_processLogs) (543521) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:55,596::__init__::225::IOProcess::(_processLogs) (543521) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:55,596::__init__::225::IOProcess::(_processLogs) DEBUG|(543521) Building response >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) (543521) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:55,597::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) (543522) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) (543522) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) (543522) Building response >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) (543522) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:55,598::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) (543523) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) (543523) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:55,599::__init__::225::IOProcess::(_processLogs) (543523) Building response >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) (543523) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:55,600::__init__::225::IOProcess::(_processLogs) (543524) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:52:55,601::__init__::225::IOProcess::(_processLogs) (543524) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:52:55,601::__init__::225::IOProcess::(_processLogs) (543524) Building response >Thread-19::DEBUG::2014-08-11 17:52:55,601::__init__::225::IOProcess::(_processLogs) (543524) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:55,601::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:52:55,601::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:52:55,706::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:55,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:52:55,707::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:52:56,069::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:52:56,134::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:52:56,251::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.058104 s, 17.6 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:52:57,400::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:57,910::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:57,910::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:52:57,911::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:52:58,070::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:52:58,259::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:52:58,317::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:52:58,318::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf759d0e-d473-49db-b752-65377e97a8b6`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:52:58,318::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:52:58,354::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0348108 s, 29.4 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:52:58,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:58,361::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf759d0e-d473-49db-b752-65377e97a8b6`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:52:58,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf759d0e-d473-49db-b752-65377e97a8b6`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:52:58,361::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:52:58,361::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:52:58,361::task::993::Storage.TaskManager.Task::(_decref) Task=`cf759d0e-d473-49db-b752-65377e97a8b6`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:52:58,372::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:52:58,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`711592c2-61b2-4964-8521-3fba4935e16a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:52:58,372::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:52:58,372::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`71197ff3-0a57-4fb8-a427-689d7efb7037`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:52:58,372::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:52:58,373::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:52:58,373::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`71197ff3-0a57-4fb8-a427-689d7efb7037`::Granted request >Thread-10197::DEBUG::2014-08-11 17:52:58,373::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`711592c2-61b2-4964-8521-3fba4935e16a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:52:58,373::task::993::Storage.TaskManager.Task::(_decref) Task=`711592c2-61b2-4964-8521-3fba4935e16a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:52:58,390::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:58,390::task::1191::Storage.TaskManager.Task::(prepare) Task=`711592c2-61b2-4964-8521-3fba4935e16a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:52:58,390::task::595::Storage.TaskManager.Task::(_updateState) Task=`711592c2-61b2-4964-8521-3fba4935e16a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:52:58,390::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:52:58,390::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:52:58,391::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:52:58,391::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:52:58,391::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:52:58,391::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:52:58,391::task::993::Storage.TaskManager.Task::(_decref) Task=`711592c2-61b2-4964-8521-3fba4935e16a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:52:59,719::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:59,719::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:59,719::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:59,720::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:52:59,720::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:59,720::__init__::225::IOProcess::(_processLogs) (543525) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:59,720::__init__::225::IOProcess::(_processLogs) (543525) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:59,720::__init__::225::IOProcess::(_processLogs) (543525) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:59,720::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:52:59,721::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:52:59,781::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000813294 s, 450 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:52:59,782::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:52:59,782::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:52:59,782::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:52:59,782::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:52:59,783::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:52:59,783::__init__::225::IOProcess::(_processLogs) (543526) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:52:59,783::__init__::225::IOProcess::(_processLogs) (543526) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:52:59,783::__init__::225::IOProcess::(_processLogs) (543526) Queuing response >Thread-19::DEBUG::2014-08-11 17:52:59,783::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:53:00,361::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:00,490::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.068596 s, 14.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:00,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:00,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:00,712::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:02,499::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:02,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.055569 s, 18.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:02,916::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:02,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:02,917::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:04,679::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:04,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0173528 s, 59.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:53:05,077::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Thread-19::DEBUG::2014-08-11 17:53:05,601::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) (543527) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) (543527) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) (543527) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:05,602::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:53:05,603::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:53:05,665::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0014106 s, 351 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:05,665::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:05,665::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:05,665::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:05,666::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:05,666::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:05,666::__init__::225::IOProcess::(_processLogs) (543528) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:05,666::__init__::225::IOProcess::(_processLogs) (543528) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:05,666::__init__::225::IOProcess::(_processLogs) (543528) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:05,667::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) (543529) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) (543529) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) (543529) Building response >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) (543529) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:05,668::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) (543530) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) (543530) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) (543530) Building response >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) (543530) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:05,669::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) (543531) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) (543531) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:05,670::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543531) Building response >Thread-19::DEBUG::2014-08-11 17:53:05,671::__init__::225::IOProcess::(_processLogs) (543531) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:05,671::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:05,671::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:05,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:05,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:05,717::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:06,763::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:06,848::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0265352 s, 38.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:07,923::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:07,924::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:07,924::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:53:08,494::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:53:08,494::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a6263d2-0225-4e60-85e2-45fcb78b0dcb`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:08,494::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:53:08,508::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:08,508::task::1191::Storage.TaskManager.Task::(prepare) Task=`8a6263d2-0225-4e60-85e2-45fcb78b0dcb`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:08,508::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a6263d2-0225-4e60-85e2-45fcb78b0dcb`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:08,509::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:08,509::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:08,509::task::993::Storage.TaskManager.Task::(_decref) Task=`8a6263d2-0225-4e60-85e2-45fcb78b0dcb`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:53:08,520::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:53:08,520::task::595::Storage.TaskManager.Task::(_updateState) Task=`07be739d-bc8a-4a71-b6a7-754558e6d1f1`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:53:08,520::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:53:08,520::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b714bae6-e4c9-49e8-ab2e-df7e46527eb2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:53:08,520::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:53:08,520::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:53:08,520::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b714bae6-e4c9-49e8-ab2e-df7e46527eb2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:53:08,521::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`07be739d-bc8a-4a71-b6a7-754558e6d1f1`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:53:08,521::task::993::Storage.TaskManager.Task::(_decref) Task=`07be739d-bc8a-4a71-b6a7-754558e6d1f1`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:53:08,537::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:08,537::task::1191::Storage.TaskManager.Task::(prepare) Task=`07be739d-bc8a-4a71-b6a7-754558e6d1f1`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:08,537::task::595::Storage.TaskManager.Task::(_updateState) Task=`07be739d-bc8a-4a71-b6a7-754558e6d1f1`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:53:08,538::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:53:08,538::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:53:08,538::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:53:08,538::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:53:08,538::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:53:08,538::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:53:08,538::task::993::Storage.TaskManager.Task::(_decref) Task=`07be739d-bc8a-4a71-b6a7-754558e6d1f1`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:53:08,856::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:09,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0310434 s, 33.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:53:09,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1620a57-cfad-49fb-8d7a-01f3d1048a94`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:09,664::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:53:09,664::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813294', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014106', 'lastCheck': '4.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:09,664::task::1191::Storage.TaskManager.Task::(prepare) Task=`c1620a57-cfad-49fb-8d7a-01f3d1048a94`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000813294', 'lastCheck': '9.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0014106', 'lastCheck': '4.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:09,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`c1620a57-cfad-49fb-8d7a-01f3d1048a94`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:09,665::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:09,665::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:09,665::task::993::Storage.TaskManager.Task::(_decref) Task=`c1620a57-cfad-49fb-8d7a-01f3d1048a94`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:53:09,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:53:09,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:53:09,784::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:09,784::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:09,784::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) (543532) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) (543532) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543532) Building response >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) (543532) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:09,785::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:53:09,786::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:53:09,786::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:53:09,846::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000623776 s, 587 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:09,846::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:09,846::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:09,846::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) (543533) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) (543533) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:09,847::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543533) Building response >Thread-19::DEBUG::2014-08-11 17:53:09,848::__init__::225::IOProcess::(_processLogs) (543533) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:09,848::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:09,848::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:10,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:10,723::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:10,724::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:11,016::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10017::DEBUG::2014-08-11 17:53:11,081::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:53:11,086::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121672 s, 84.2 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:53:12,408::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:12,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:12,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:12,930::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:13,094::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:13,165::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0120328 s, 85.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:53:15,173::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:15,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0351133 s, 29.2 MB/s\n'; <rc> = 0 >Thread-28::DEBUG::2014-08-11 17:53:15,671::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:53:15,674::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,675::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:53:15,676::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,677::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,677::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,679::__init__::225::IOProcess::(_processLogs) (543534) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:53:15,679::__init__::225::IOProcess::(_processLogs) (543534) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:53:15,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543534) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,680::__init__::225::IOProcess::(_processLogs) (543534) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,681::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,682::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:53:15,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,683::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:53:15,684::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,684::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,685::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,686::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,686::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,687::__init__::225::IOProcess::(_processLogs) (543535) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:53:15,688::__init__::225::IOProcess::(_processLogs) (543535) Got request for method 'glob' >Thread-28::DEBUG::2014-08-11 17:53:15,690::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a >Thread-19::DEBUG::2014-08-11 17:53:15,690::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) (543536) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:53:15,691::__init__::225::IOProcess::(_processLogs) (543536) Got request for method 'touch' >Thread-19::DEBUG::2014-08-11 17:53:15,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543535) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,702::__init__::225::IOProcess::(_processLogs) (543535) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,702::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,702::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 186 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:15,729::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:15,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:15,730::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:53:15,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543536) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,734::__init__::225::IOProcess::(_processLogs) (543536) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,734::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,734::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 58 >Thread-28::DEBUG::2014-08-11 17:53:15,735::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-08-11 17:53:15,735::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,735::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:53:15,735::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,736::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,736::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,736::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,736::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,736::__init__::225::IOProcess::(_processLogs) (543537) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:53:15,736::__init__::225::IOProcess::(_processLogs) (543537) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:53:15,747::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|(543537) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,748::__init__::225::IOProcess::(_processLogs) (543537) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,748::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,748::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Sending response sized 716 >Thread-28::DEBUG::2014-08-11 17:53:15,748::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd_35', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=Default', 'POOL_DOMAINS=d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=-1', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc4', 'ROLE=Master', 'SDUUID=d54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=f8663b447c3e74ce973bb802067734eee7ca7cb1'] >Thread-19::DEBUG::2014-08-11 17:53:15,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,749::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:53:15,749::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,749::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) (543538) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) (543538) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) (543538) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) (543538) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,750::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,751::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,751::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,751::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,751::__init__::225::IOProcess::(_processLogs) (543539) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:53:15,751::__init__::225::IOProcess::(_processLogs) (543539) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:53:15,761::__init__::225::IOProcess::(_processLogs) DEBUG|(543539) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,761::__init__::225::IOProcess::(_processLogs) (543539) Queuing response >Thread-28::DEBUG::2014-08-11 17:53:15,761::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:53:15,761::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::INFO::2014-08-11 17:53:15,762::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_imageNS already registered >Thread-28::INFO::2014-08-11 17:53:15,762::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace d54e6e6c-81f2-41f2-90ab-7e3c2457938a_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:53:15,762::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) (543539) Queuing responseDEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) (543540) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) (543540) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:15,763::__init__::225::IOProcess::(_processLogs) (543540) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,764::__init__::225::IOProcess::(_processLogs) (543540) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,764::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,764::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:53:15,764::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:53:15,824::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00103282 s, 479 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,825::__init__::225::IOProcess::(_processLogs) (543541) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:15,826::__init__::225::IOProcess::(_processLogs) (543541) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:15,826::__init__::225::IOProcess::(_processLogs) DEBUG|(543541) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,826::__init__::225::IOProcess::(_processLogs) (543541) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,826::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) (543542) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:15,827::__init__::225::IOProcess::(_processLogs) (543542) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) DEBUG|(543542) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) (543542) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,828::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) (543543) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) (543543) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) DEBUG|(543543) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) (543543) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,829::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:15,830::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:15,830::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:53:15,830::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:15,830::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:15,830::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:15,830::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) (543544) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) (543544) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) (543544) Building response >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) (543544) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:15,831::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:53:17,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:17,377::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0413932 s, 24.7 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:17,936::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:17,937::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:17,937::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:53:18,583::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:53:18,583::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b341444-bd66-4d04-938f-615cd867e09a`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:18,584::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:53:18,637::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:18,637::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b341444-bd66-4d04-938f-615cd867e09a`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:18,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b341444-bd66-4d04-938f-615cd867e09a`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:18,637::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:18,637::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:18,638::task::993::Storage.TaskManager.Task::(_decref) Task=`5b341444-bd66-4d04-938f-615cd867e09a`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:53:18,649::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:53:18,649::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b07fca9-d547-4dea-8f32-fa1d1137cb17`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:53:18,649::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:53:18,649::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9585cb7d-a94c-4c58-9b87-e36b4855c665`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:53:18,649::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:53:18,650::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:53:18,650::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`9585cb7d-a94c-4c58-9b87-e36b4855c665`::Granted request >Thread-10197::DEBUG::2014-08-11 17:53:18,650::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8b07fca9-d547-4dea-8f32-fa1d1137cb17`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:53:18,650::task::993::Storage.TaskManager.Task::(_decref) Task=`8b07fca9-d547-4dea-8f32-fa1d1137cb17`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:53:18,702::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:18,702::task::1191::Storage.TaskManager.Task::(prepare) Task=`8b07fca9-d547-4dea-8f32-fa1d1137cb17`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:18,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`8b07fca9-d547-4dea-8f32-fa1d1137cb17`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:53:18,702::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:53:18,702::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:53:18,702::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:53:18,702::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:53:18,702::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:53:18,702::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:53:18,702::task::993::Storage.TaskManager.Task::(_decref) Task=`8b07fca9-d547-4dea-8f32-fa1d1137cb17`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:53:19,385::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:19,479::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0342719 s, 29.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:19,848::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) (543545) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:19,849::__init__::225::IOProcess::(_processLogs) (543545) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:19,859::__init__::225::IOProcess::(_processLogs) (543545) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:19,859::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:53:19,859::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:53:19,918::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000475847 s, 769 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:19,918::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:19,918::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:19,918::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:19,918::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:19,919::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:19,919::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:19,919::__init__::225::IOProcess::(_processLogs) (543546) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:19,919::__init__::225::IOProcess::(_processLogs) (543546) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:19,919::__init__::225::IOProcess::(_processLogs) DEBUG|(543546) Building response >Thread-19::DEBUG::2014-08-11 17:53:19,920::__init__::225::IOProcess::(_processLogs) (543546) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:19,920::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:19,920::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:20,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:20,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:20,736::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:21,486::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:21,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0514598 s, 19.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:22,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:22,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:22,941::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:23,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:23,678::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153168 s, 66.9 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:53:24,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9a1219f-3b66-48d1-9d1b-686dca16908e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:24,874::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:53:24,874::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475847', 'lastCheck': '5.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103282', 'lastCheck': '9.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:24,874::task::1191::Storage.TaskManager.Task::(prepare) Task=`f9a1219f-3b66-48d1-9d1b-686dca16908e`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000475847', 'lastCheck': '5.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103282', 'lastCheck': '9.0', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:24,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`f9a1219f-3b66-48d1-9d1b-686dca16908e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:24,874::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:24,874::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:24,874::task::993::Storage.TaskManager.Task::(_decref) Task=`f9a1219f-3b66-48d1-9d1b-686dca16908e`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:53:24,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:53:24,893::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:25,687::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:53:25,747::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:25,751::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:25,753::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:25,785::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0381193 s, 26.9 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:25,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:25,831::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:25,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:25,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:25,831::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:25,832::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:25,832::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:25,832::__init__::225::IOProcess::(_processLogs) (543547) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:25,832::__init__::225::IOProcess::(_processLogs) (543547) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:25,832::__init__::225::IOProcess::(_processLogs) DEBUG|(543547) Building response >Thread-28::DEBUG::2014-08-11 17:53:25,833::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:53:25,833::__init__::225::IOProcess::(_processLogs) (543547) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:25,892::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:25,892::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:53:25,901::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00236637 s, 209 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:25,901::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:25,901::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:25,901::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:25,902::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:25,902::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:25,902::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:25,902::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:25,902::__init__::225::IOProcess::(_processLogs) (543548) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:25,902::__init__::225::IOProcess::(_processLogs) (543548) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:25,904::__init__::225::IOProcess::(_processLogs) (543548) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:25,905::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:53:25,905::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:53:25,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) (543549) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) (543549) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) (543549) Building response >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) (543549) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:25,906::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) (543550) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:25,907::__init__::225::IOProcess::(_processLogs) (543550) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:25,908::__init__::225::IOProcess::(_processLogs) (543550) Building response >Thread-19::DEBUG::2014-08-11 17:53:25,908::__init__::225::IOProcess::(_processLogs) (543550) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:25,908::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:25,908::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:25,908::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:53:25,908::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) (543551) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) (543551) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) (543551) Building response >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) (543551) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:25,909::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:53:26,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`b92f6563-ca4c-4106-bc8a-8a45ac5b4e67`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:53:26,083::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:53:26,083::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:53:26,083::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:26,083::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:26,083::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:26,083::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:26,083::__init__::225::IOProcess::(_processLogs) (543552) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:53:26,084::__init__::225::IOProcess::(_processLogs) (543552) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:53:26,088::__init__::225::IOProcess::(_processLogs) (543552) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:26,088::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:26,088::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:53:26,088::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:26,088::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:26,088::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) (543553) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) (543553) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) (543553) Building response >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) (543553) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:26,089::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::INFO::2014-08-11 17:53:26,089::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:53:26,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`b92f6563-ca4c-4106-bc8a-8a45ac5b4e67`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-10017::DEBUG::2014-08-11 17:53:26,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`b92f6563-ca4c-4106-bc8a-8a45ac5b4e67`::moving from state preparing -> state finished >Thread-10017::DEBUG::2014-08-11 17:53:26,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:53:26,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10017::DEBUG::2014-08-11 17:53:26,090::task::993::Storage.TaskManager.Task::(_decref) Task=`b92f6563-ca4c-4106-bc8a-8a45ac5b4e67`::ref 0 aborting False >Thread-10017::DEBUG::2014-08-11 17:53:26,113::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:53:27,445::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8943664-d3f1-4a9b-b8a9-304cd8bf9766`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:53:27,445::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:53:27,445::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:53:27,445::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:27,445::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:27,446::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:27,446::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:27,446::__init__::225::IOProcess::(_processLogs) (543554) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:53:27,446::__init__::225::IOProcess::(_processLogs) (543554) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:53:27,450::__init__::225::IOProcess::(_processLogs) (543554) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:27,450::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:27,450::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:53:27,450::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:27,450::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10256::INFO::2014-08-11 17:53:27,451::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:53:27,451::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10256::DEBUG::2014-08-11 17:53:27,451::task::1191::Storage.TaskManager.Task::(prepare) Task=`e8943664-d3f1-4a9b-b8a9-304cd8bf9766`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:53:27,452::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:53:27,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`e8943664-d3f1-4a9b-b8a9-304cd8bf9766`::moving from state preparing -> state finished >Thread-10256::DEBUG::2014-08-11 17:53:27,452::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:53:27,452::__init__::225::IOProcess::(_processLogs) (543555) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:53:27,453::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:53:27,453::__init__::225::IOProcess::(_processLogs) (543555) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:53:27,453::task::993::Storage.TaskManager.Task::(_decref) Task=`e8943664-d3f1-4a9b-b8a9-304cd8bf9766`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:53:27,453::__init__::225::IOProcess::(_processLogs) (543555) Building response >Thread-19::DEBUG::2014-08-11 17:53:27,454::__init__::225::IOProcess::(_processLogs) (543555) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:27,454::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:27,454::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:53:27,476::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:53:27,793::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:27,865::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0131091 s, 78.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:27,946::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:27,947::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:27,947::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:53:28,100::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-10237::DEBUG::2014-08-11 17:53:28,812::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:53:28,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`d104279b-b970-44fe-821f-438d4668394e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:28,813::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:53:28,866::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:28,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`d104279b-b970-44fe-821f-438d4668394e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:28,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`d104279b-b970-44fe-821f-438d4668394e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:28,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:28,866::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:28,866::task::993::Storage.TaskManager.Task::(_decref) Task=`d104279b-b970-44fe-821f-438d4668394e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:53:28,877::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:53:28,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b05140a-da3d-4248-9b38-86008e056b74`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:53:28,877::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:53:28,878::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`005b589e-6a52-48e4-8065-8bddb462a2c8`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:53:28,878::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:53:28,878::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:53:28,878::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`005b589e-6a52-48e4-8065-8bddb462a2c8`::Granted request >Thread-10197::DEBUG::2014-08-11 17:53:28,879::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b05140a-da3d-4248-9b38-86008e056b74`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:53:28,879::task::993::Storage.TaskManager.Task::(_decref) Task=`2b05140a-da3d-4248-9b38-86008e056b74`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:53:28,923::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:28,923::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b05140a-da3d-4248-9b38-86008e056b74`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:28,923::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b05140a-da3d-4248-9b38-86008e056b74`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:53:28,923::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:53:28,924::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:53:28,924::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:53:28,924::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:53:28,924::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:53:28,924::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:53:28,924::task::993::Storage.TaskManager.Task::(_decref) Task=`2b05140a-da3d-4248-9b38-86008e056b74`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:53:29,873::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:53:29,932::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:29,932::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:29,932::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:29,932::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:29,932::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:29,933::__init__::225::IOProcess::(_processLogs) (543556) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:29,933::__init__::225::IOProcess::(_processLogs) (543556) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:29,933::__init__::225::IOProcess::(_processLogs) (543556) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:29,934::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:53:29,934::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:29,995::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0609145 s, 16.8 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:53:29,995::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00146772 s, 249 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:29,997::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:29,997::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:29,998::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:29,998::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:29,999::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:29,999::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:30,000::__init__::225::IOProcess::(_processLogs) (543557) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:30,001::__init__::225::IOProcess::(_processLogs) (543557) Building response >Thread-19::DEBUG::2014-08-11 17:53:30,002::__init__::225::IOProcess::(_processLogs) (543557) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:30,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:30,002::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:30,756::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:30,757::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:30,757::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:32,011::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:32,122::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0512077 s, 20.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:32,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:32,952::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:32,953::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:34,183::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:34,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0251154 s, 40.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:53:35,107::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >GuestMonitor-vm::DEBUG::2014-08-11 17:53:35,763::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:35,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:35,767::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:53:35,909::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:35,909::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:35,909::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:35,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:35,909::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:35,909::__init__::225::IOProcess::(_processLogs) (543558) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:35,910::__init__::225::IOProcess::(_processLogs) (543558) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:35,911::__init__::225::IOProcess::(_processLogs) (543558) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:35,911::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:53:35,911::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:53:35,990::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00981388 s, 50.4 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:35,990::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:35,991::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:35,991::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:35,991::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:35,991::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:35,991::__init__::225::IOProcess::(_processLogs) (543559) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:35,991::__init__::225::IOProcess::(_processLogs) (543559) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:35,992::__init__::225::IOProcess::(_processLogs) (543559) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:35,992::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:35,992::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:53:35,992::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:35,992::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) (543560) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) (543560) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) (543560) Building response >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) (543560) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:35,993::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) (543561) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) (543561) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) (543561) Building response >Thread-19::DEBUG::2014-08-11 17:53:35,994::__init__::225::IOProcess::(_processLogs) (543561) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:35,995::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:35,995::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:35,995::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:53:35,995::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:35,995::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) (543562) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) (543562) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) (543562) Building response >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) (543562) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:35,996::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:53:36,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:36,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.012569 s, 81.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:37,958::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:37,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:37,959::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:38,359::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:38,480::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0612905 s, 16.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:53:38,976::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:53:38,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f7d6acc-ce5c-4e1f-ad90-9243cac5da89`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:38,977::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:53:38,995::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:38,996::task::1191::Storage.TaskManager.Task::(prepare) Task=`6f7d6acc-ce5c-4e1f-ad90-9243cac5da89`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:38,996::task::595::Storage.TaskManager.Task::(_updateState) Task=`6f7d6acc-ce5c-4e1f-ad90-9243cac5da89`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:38,996::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:38,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:38,996::task::993::Storage.TaskManager.Task::(_decref) Task=`6f7d6acc-ce5c-4e1f-ad90-9243cac5da89`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:53:39,007::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:53:39,007::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ecb974b-6538-41d6-8d17-1f4b245aed25`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:53:39,007::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:53:39,007::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2a73f5d4-226c-439f-b363-4048c11b3100`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:53:39,007::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:53:39,008::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:53:39,008::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2a73f5d4-226c-439f-b363-4048c11b3100`::Granted request >Thread-10197::DEBUG::2014-08-11 17:53:39,008::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`6ecb974b-6538-41d6-8d17-1f4b245aed25`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:53:39,008::task::993::Storage.TaskManager.Task::(_decref) Task=`6ecb974b-6538-41d6-8d17-1f4b245aed25`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:53:39,024::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:39,024::task::1191::Storage.TaskManager.Task::(prepare) Task=`6ecb974b-6538-41d6-8d17-1f4b245aed25`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:39,025::task::595::Storage.TaskManager.Task::(_updateState) Task=`6ecb974b-6538-41d6-8d17-1f4b245aed25`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:53:39,025::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:53:39,025::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:53:39,025::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:53:39,025::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:53:39,025::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:53:39,025::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:53:39,025::task::993::Storage.TaskManager.Task::(_decref) Task=`6ecb974b-6538-41d6-8d17-1f4b245aed25`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) (543563) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) (543563) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:40,002::__init__::225::IOProcess::(_processLogs) (543563) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:40,003::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::DEBUG::2014-08-11 17:53:40,003::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:53:40,004::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:53:40,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`a70f8a7d-14a3-4988-aa37-6ac91bf2fbbf`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:40,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:53:40,064::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146772', 'lastCheck': '10.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00981388', 'lastCheck': '4.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:40,064::task::1191::Storage.TaskManager.Task::(prepare) Task=`a70f8a7d-14a3-4988-aa37-6ac91bf2fbbf`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00146772', 'lastCheck': '10.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00981388', 'lastCheck': '4.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:40,064::task::595::Storage.TaskManager.Task::(_updateState) Task=`a70f8a7d-14a3-4988-aa37-6ac91bf2fbbf`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:40,064::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-27::DEBUG::2014-08-11 17:53:40,064::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000828764 s, 442 kB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:53:40,065::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:40,065::task::993::Storage.TaskManager.Task::(_decref) Task=`a70f8a7d-14a3-4988-aa37-6ac91bf2fbbf`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:53:40,066::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:40,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:40,067::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:40,067::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:40,068::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:40,068::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:40,069::__init__::225::IOProcess::(_processLogs) (543564) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:40,069::__init__::225::IOProcess::(_processLogs) (543564) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:40,070::__init__::225::IOProcess::(_processLogs) (543564) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:40,071::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:40,072::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:53:40,090::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:53:40,092::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:40,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:40,597::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0500889 s, 20.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:40,772::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:40,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:40,773::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:53:41,121::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10256::DEBUG::2014-08-11 17:53:42,483::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:53:42,605::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:42,696::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026019 s, 39.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:42,965::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:42,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:42,966::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:44,704::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:44,830::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0661217 s, 15.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:45,778::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:45,779::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:45,779::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:53:45,996::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:45,996::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:45,996::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:45,996::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) (543565) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) (543565) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543565) Building response >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) (543565) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:45,997::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:45,998::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:53:45,998::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:53:46,058::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00108314 s, 457 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:46,059::__init__::225::IOProcess::(_processLogs) (543566) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:46,060::__init__::225::IOProcess::(_processLogs) (543566) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:46,060::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543566) Building response >Thread-19::DEBUG::2014-08-11 17:53:46,060::__init__::225::IOProcess::(_processLogs) (543566) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:46,060::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:53:46,061::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:53:46,061::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:46,061::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:53:46,061::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:46,061::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:46,061::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) (543567) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) (543567) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) (543567) Building response >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) (543567) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:46,062::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) (543568) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:46,063::__init__::225::IOProcess::(_processLogs) (543568) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) (543568) Building response >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) (543568) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:46,064::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) (543569) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) (543569) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) (543569) Building response >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) (543569) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:46,065::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:53:46,838::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:46,990::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0924897 s, 11.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:47,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:47,972::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:47,973::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:48,998::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:53:49,066::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:53:49,066::task::595::Storage.TaskManager.Task::(_updateState) Task=`2598bb6e-b747-403e-a3d7-e0356a98c3b7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:49,067::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:53:49,070::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013767 s, 74.4 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:53:49,083::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:49,083::task::1191::Storage.TaskManager.Task::(prepare) Task=`2598bb6e-b747-403e-a3d7-e0356a98c3b7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:49,083::task::595::Storage.TaskManager.Task::(_updateState) Task=`2598bb6e-b747-403e-a3d7-e0356a98c3b7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:49,083::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:49,083::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:49,083::task::993::Storage.TaskManager.Task::(_decref) Task=`2598bb6e-b747-403e-a3d7-e0356a98c3b7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:53:49,094::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:53:49,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`beaaecdc-da98-49a0-87ce-9a6e13a5738e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:53:49,094::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:53:49,095::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2b0a11a6-9cd6-4762-91f3-8e3fd258e671`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:53:49,095::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:53:49,095::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:53:49,095::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2b0a11a6-9cd6-4762-91f3-8e3fd258e671`::Granted request >Thread-10197::DEBUG::2014-08-11 17:53:49,095::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`beaaecdc-da98-49a0-87ce-9a6e13a5738e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:53:49,095::task::993::Storage.TaskManager.Task::(_decref) Task=`beaaecdc-da98-49a0-87ce-9a6e13a5738e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:53:49,112::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:49,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`beaaecdc-da98-49a0-87ce-9a6e13a5738e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:49,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`beaaecdc-da98-49a0-87ce-9a6e13a5738e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:53:49,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:53:49,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:53:49,113::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:53:49,113::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:53:49,113::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:53:49,113::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:53:49,113::task::993::Storage.TaskManager.Task::(_decref) Task=`beaaecdc-da98-49a0-87ce-9a6e13a5738e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:53:50,072::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:50,072::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:50,072::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) (543570) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) (543570) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) (543570) Building response >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) (543570) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:50,073::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:53:50,074::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:53:50,134::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000341002 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:50,136::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:50,137::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:50,138::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:50,140::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:50,140::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:50,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:50,142::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:50,142::__init__::225::IOProcess::(_processLogs) (543571) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:50,143::__init__::225::IOProcess::(_processLogs) (543571) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:50,145::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543571) Building response >Thread-19::DEBUG::2014-08-11 17:53:50,146::__init__::225::IOProcess::(_processLogs) (543571) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:50,147::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:50,147::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:50,784::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:50,785::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:50,785::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:51,079::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:51,151::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.01304 s, 78.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:52,978::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:52,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:52,979::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:53,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:53,253::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0360761 s, 28.4 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:53:55,261::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:53:55,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`f171925e-0480-470e-bb54-b6af30a116be`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:55,321::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:53:55,321::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341002', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108314', 'lastCheck': '9.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:55,321::task::1191::Storage.TaskManager.Task::(prepare) Task=`f171925e-0480-470e-bb54-b6af30a116be`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341002', 'lastCheck': '5.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00108314', 'lastCheck': '9.3', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:53:55,321::task::595::Storage.TaskManager.Task::(_updateState) Task=`f171925e-0480-470e-bb54-b6af30a116be`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:55,321::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:55,321::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:55,321::task::993::Storage.TaskManager.Task::(_decref) Task=`f171925e-0480-470e-bb54-b6af30a116be`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:53:55,341::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:53:55,341::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:53:55,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444736 s, 23.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:53:55,791::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:55,791::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:53:55,791::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:53:56,065::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:56,065::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) (543572) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) (543572) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543572) Building response >Thread-19::DEBUG::2014-08-11 17:53:56,066::__init__::225::IOProcess::(_processLogs) (543572) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:56,067::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:56,067::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:53:56,067::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:53:56,128::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00184335 s, 269 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) (543573) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:53:56,129::__init__::225::IOProcess::(_processLogs) (543573) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:53:56,133::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543573) Building response >Thread-19::DEBUG::2014-08-11 17:53:56,133::__init__::225::IOProcess::(_processLogs) (543573) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:56,133::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:53:56,134::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:53:56,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:56,135::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:53:56,135::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:56,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:56,135::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:56,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) (543574) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) (543574) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) (543574) Building response >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) (543574) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:56,136::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:56,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:56,137::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:53:56,137::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:56,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) (543575) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) (543575) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) (543575) Building response >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) (543575) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:56,138::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:53:56,139::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:53:56,140::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:53:56,140::__init__::225::IOProcess::(_processLogs) (543576) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:53:56,140::__init__::225::IOProcess::(_processLogs) (543576) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:53:56,140::__init__::225::IOProcess::(_processLogs) (543576) Building response >Thread-19::DEBUG::2014-08-11 17:53:56,140::__init__::225::IOProcess::(_processLogs) (543576) Queuing response >Thread-19::DEBUG::2014-08-11 17:53:56,140::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:53:56,141::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10017::DEBUG::2014-08-11 17:53:56,141::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:53:57,373::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:57,473::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.03983 s, 25.7 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:53:57,491::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:57,985::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:57,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:53:57,986::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:53:58,151::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Thread-10237::DEBUG::2014-08-11 17:53:59,162::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:53:59,162::task::595::Storage.TaskManager.Task::(_updateState) Task=`00224e43-9916-469b-93c6-25a7b8a853fa`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:53:59,162::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:53:59,220::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:59,220::task::1191::Storage.TaskManager.Task::(prepare) Task=`00224e43-9916-469b-93c6-25a7b8a853fa`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:53:59,220::task::595::Storage.TaskManager.Task::(_updateState) Task=`00224e43-9916-469b-93c6-25a7b8a853fa`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:53:59,220::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:53:59,220::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:53:59,220::task::993::Storage.TaskManager.Task::(_decref) Task=`00224e43-9916-469b-93c6-25a7b8a853fa`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:53:59,231::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:53:59,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb3f4d4-dd1b-4e49-90b8-b2367538d3fa`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:53:59,231::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:53:59,232::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d1983487-dfcf-4191-a295-cbbf637fc3af`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:53:59,232::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:53:59,232::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:53:59,232::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`d1983487-dfcf-4191-a295-cbbf637fc3af`::Granted request >Thread-10197::DEBUG::2014-08-11 17:53:59,232::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`afb3f4d4-dd1b-4e49-90b8-b2367538d3fa`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:53:59,232::task::993::Storage.TaskManager.Task::(_decref) Task=`afb3f4d4-dd1b-4e49-90b8-b2367538d3fa`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:53:59,249::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:59,250::task::1191::Storage.TaskManager.Task::(prepare) Task=`afb3f4d4-dd1b-4e49-90b8-b2367538d3fa`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:53:59,250::task::595::Storage.TaskManager.Task::(_updateState) Task=`afb3f4d4-dd1b-4e49-90b8-b2367538d3fa`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:53:59,250::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:53:59,250::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:53:59,250::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:53:59,250::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:53:59,250::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:53:59,250::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:53:59,250::task::993::Storage.TaskManager.Task::(_decref) Task=`afb3f4d4-dd1b-4e49-90b8-b2367538d3fa`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:53:59,482::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:53:59,606::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0633632 s, 16.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:00,146::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:00,146::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:00,147::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:00,147::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-27::DEBUG::2014-08-11 17:54:00,147::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:54:00,148::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:00,207::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:54:00,209::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000367908 s, 995 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:00,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:00,240::__init__::225::IOProcess::(_processLogs) (543577) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:00,241::__init__::225::IOProcess::(_processLogs) (543577) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:00,242::__init__::225::IOProcess::(_processLogs) (543577) Building response >Thread-19::DEBUG::2014-08-11 17:54:00,244::__init__::225::IOProcess::(_processLogs) (543577) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:00,244::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:00,245::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:00,247::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:00,248::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:00,249::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:00,250::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:00,251::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:00,251::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:00,252::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:00,253::__init__::225::IOProcess::(_processLogs) (543578) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:00,254::__init__::225::IOProcess::(_processLogs) (543578) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:00,255::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543578) Building response >Thread-19::DEBUG::2014-08-11 17:54:00,256::__init__::225::IOProcess::(_processLogs) (543578) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:00,256::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:00,256::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:00,795::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:00,796::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:00,796::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:01,615::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:01,717::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0436885 s, 23.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:02,991::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:02,992::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:02,992::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:03,789::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:03,895::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0463661 s, 22.1 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:54:05,212::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >GuestMonitor-vm::DEBUG::2014-08-11 17:54:05,801::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:05,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:05,802::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:05,903::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:06,010::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0462466 s, 22.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:06,140::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) (543579) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) (543579) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543579) Building response >Thread-19::DEBUG::2014-08-11 17:54:06,141::__init__::225::IOProcess::(_processLogs) (543579) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:06,142::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:06,142::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:54:06,143::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:54:06,203::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.0010112 s, 490 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:06,203::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:06,203::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:06,203::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) (543580) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) (543580) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543580) Building response >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) (543580) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:06,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:54:06,205::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:06,205::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:06,205::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:54:06,205::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:06,205::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:06,205::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) (543581) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) (543581) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) (543581) Building response >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) (543581) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:06,206::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:06,207::__init__::225::IOProcess::(_processLogs) (543582) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) (543582) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) (543582) Building response >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) (543582) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:06,208::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:06,209::__init__::225::IOProcess::(_processLogs) (543583) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:06,209::__init__::225::IOProcess::(_processLogs) (543583) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:06,209::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543583) Building response >Thread-19::DEBUG::2014-08-11 17:54:06,209::__init__::225::IOProcess::(_processLogs) (543583) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:06,210::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:54:06,210::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:07,998::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:07,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:07,999::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:08,019::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:08,115::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0370922 s, 27.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:54:09,309::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:54:09,309::task::595::Storage.TaskManager.Task::(_updateState) Task=`be2d9038-c19d-452e-bde1-f9b847602af9`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:09,309::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:54:09,361::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:09,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`be2d9038-c19d-452e-bde1-f9b847602af9`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:09,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`be2d9038-c19d-452e-bde1-f9b847602af9`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:09,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:09,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:09,362::task::993::Storage.TaskManager.Task::(_decref) Task=`be2d9038-c19d-452e-bde1-f9b847602af9`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:54:09,373::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:54:09,373::task::595::Storage.TaskManager.Task::(_updateState) Task=`7705f9c8-0db8-4e99-8089-28b5c982d815`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:54:09,374::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:54:09,374::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`54b47e56-c238-4836-9eea-0e59dcc4ffd4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:54:09,374::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:54:09,374::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:54:09,374::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`54b47e56-c238-4836-9eea-0e59dcc4ffd4`::Granted request >Thread-10197::DEBUG::2014-08-11 17:54:09,374::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7705f9c8-0db8-4e99-8089-28b5c982d815`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:54:09,374::task::993::Storage.TaskManager.Task::(_decref) Task=`7705f9c8-0db8-4e99-8089-28b5c982d815`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:54:09,391::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:09,391::task::1191::Storage.TaskManager.Task::(prepare) Task=`7705f9c8-0db8-4e99-8089-28b5c982d815`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:09,391::task::595::Storage.TaskManager.Task::(_updateState) Task=`7705f9c8-0db8-4e99-8089-28b5c982d815`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:54:09,391::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:54:09,391::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:54:09,392::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:54:09,392::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:54:09,392::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:54:09,392::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:54:09,392::task::993::Storage.TaskManager.Task::(_decref) Task=`7705f9c8-0db8-4e99-8089-28b5c982d815`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:54:10,123::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:10,194::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124147 s, 82.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) (543584) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:10,257::__init__::225::IOProcess::(_processLogs) (543584) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:10,258::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543584) Building response >Thread-27::DEBUG::2014-08-11 17:54:10,258::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:54:10,258::__init__::225::IOProcess::(_processLogs) (543584) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:10,317::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:10,318::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:54:10,319::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000635959 s, 576 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:10,320::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:10,321::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:10,322::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:10,322::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:10,323::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:10,323::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:10,324::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:10,325::__init__::225::IOProcess::(_processLogs) (543585) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:10,326::__init__::225::IOProcess::(_processLogs) (543585) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:10,326::__init__::225::IOProcess::(_processLogs) (543585) Building response >Thread-19::DEBUG::2014-08-11 17:54:10,327::__init__::225::IOProcess::(_processLogs) (543585) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:10,327::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:10,327::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:54:10,621::task::595::Storage.TaskManager.Task::(_updateState) Task=`99253bbf-3e45-47cc-8596-ee0bdd767bff`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:10,621::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:54:10,621::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635959', 'lastCheck': '0.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010112', 'lastCheck': '4.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:10,621::task::1191::Storage.TaskManager.Task::(prepare) Task=`99253bbf-3e45-47cc-8596-ee0bdd767bff`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000635959', 'lastCheck': '0.3', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.0010112', 'lastCheck': '4.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:10,622::task::595::Storage.TaskManager.Task::(_updateState) Task=`99253bbf-3e45-47cc-8596-ee0bdd767bff`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:10,622::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:10,622::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:10,622::task::993::Storage.TaskManager.Task::(_decref) Task=`99253bbf-3e45-47cc-8596-ee0bdd767bff`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:54:10,638::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:54:10,639::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:10,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:10,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:10,808::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:54:11,187::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:54:12,202::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:12,309::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0482338 s, 21.2 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:54:12,547::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:13,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:13,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:13,005::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:14,317::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:14,388::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123723 s, 82.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:15,809::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:15,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:15,810::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) (543586) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:16,211::__init__::225::IOProcess::(_processLogs) (543586) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:16,212::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543586) Building response >Thread-19::DEBUG::2014-08-11 17:54:16,212::__init__::225::IOProcess::(_processLogs) (543586) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:16,212::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-28::DEBUG::2014-08-11 17:54:16,213::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:54:16,213::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:54:16,285::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00642583 s, 77.0 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:16,286::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:16,286::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:16,286::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:16,286::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:16,286::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) (543587) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) (543587) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) (543587) Building response >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) (543587) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:16,287::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:16,288::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) (543588) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) (543588) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) (543588) Building response >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) (543588) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:16,289::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) (543589) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) (543589) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) (543589) Building response >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) (543589) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:16,290::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:16,291::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:16,292::__init__::225::IOProcess::(_processLogs) (543590) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:16,292::__init__::225::IOProcess::(_processLogs) (543590) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:16,292::__init__::225::IOProcess::(_processLogs) (543590) Building response >Thread-19::DEBUG::2014-08-11 17:54:16,292::__init__::225::IOProcess::(_processLogs) (543590) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:16,292::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:16,292::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:54:16,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:16,468::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.013195 s, 77.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:18,006::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:18,007::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:18,007::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:18,476::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:18,555::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0198103 s, 51.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:54:19,456::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:54:19,456::task::595::Storage.TaskManager.Task::(_updateState) Task=`213bb633-133c-4930-8abd-f37c7f8a2aee`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:19,456::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:54:19,511::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:19,511::task::1191::Storage.TaskManager.Task::(prepare) Task=`213bb633-133c-4930-8abd-f37c7f8a2aee`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:19,511::task::595::Storage.TaskManager.Task::(_updateState) Task=`213bb633-133c-4930-8abd-f37c7f8a2aee`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:19,511::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:19,511::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:19,511::task::993::Storage.TaskManager.Task::(_decref) Task=`213bb633-133c-4930-8abd-f37c7f8a2aee`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:54:19,523::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:54:19,523::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fef8caa-509a-47d2-a34b-60c4f6efa3e4`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:54:19,523::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:54:19,523::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4a37c65c-3218-4190-9687-0c8f2ab45dab`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:54:19,523::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:54:19,524::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:54:19,524::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4a37c65c-3218-4190-9687-0c8f2ab45dab`::Granted request >Thread-10197::DEBUG::2014-08-11 17:54:19,524::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3fef8caa-509a-47d2-a34b-60c4f6efa3e4`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:54:19,524::task::993::Storage.TaskManager.Task::(_decref) Task=`3fef8caa-509a-47d2-a34b-60c4f6efa3e4`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:54:19,540::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:19,541::task::1191::Storage.TaskManager.Task::(prepare) Task=`3fef8caa-509a-47d2-a34b-60c4f6efa3e4`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:19,541::task::595::Storage.TaskManager.Task::(_updateState) Task=`3fef8caa-509a-47d2-a34b-60c4f6efa3e4`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:54:19,541::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:54:19,541::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:54:19,541::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:54:19,541::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:54:19,541::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:54:19,541::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:54:19,541::task::993::Storage.TaskManager.Task::(_decref) Task=`3fef8caa-509a-47d2-a34b-60c4f6efa3e4`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) (543591) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:20,326::__init__::225::IOProcess::(_processLogs) (543591) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:20,328::__init__::225::IOProcess::(_processLogs) DEBUG|(543591) Building response >Thread-19::DEBUG::2014-08-11 17:54:20,328::__init__::225::IOProcess::(_processLogs) (543591) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:20,328::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:20,328::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:54:20,329::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:54:20,389::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00101697 s, 360 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:20,391::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:20,391::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:20,392::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:20,393::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:20,394::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:20,394::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:20,395::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:20,396::__init__::225::IOProcess::(_processLogs) (543592) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:20,396::__init__::225::IOProcess::(_processLogs) (543592) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:20,398::__init__::225::IOProcess::(_processLogs) DEBUG|(543592) Building response >Thread-19::DEBUG::2014-08-11 17:54:20,399::__init__::225::IOProcess::(_processLogs) (543592) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:20,399::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:20,399::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:54:20,564::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:20,669::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0453925 s, 22.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:20,842::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:20,846::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:20,850::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:22,677::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:22,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0425698 s, 24.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:23,011::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:23,012::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:23,012::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:24,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:24,878::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0326249 s, 31.4 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:54:25,835::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f64b596-b7bd-4c61-82c6-4866174319e6`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:25,835::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:54:25,835::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101697', 'lastCheck': '5.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00642583', 'lastCheck': '9.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:25,835::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f64b596-b7bd-4c61-82c6-4866174319e6`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00101697', 'lastCheck': '5.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00642583', 'lastCheck': '9.5', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:25,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f64b596-b7bd-4c61-82c6-4866174319e6`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:25,836::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:25,836::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:25,836::task::993::Storage.TaskManager.Task::(_decref) Task=`3f64b596-b7bd-4c61-82c6-4866174319e6`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:54:25,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:25,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:25,853::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:54:25,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:54:25,855::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:54:26,189::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c3864b6-f451-4780-8223-832b56b2cd2c`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:54:26,189::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) (543593) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:54:26,190::__init__::225::IOProcess::(_processLogs) (543593) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:54:26,194::__init__::225::IOProcess::(_processLogs) DEBUG|(543593) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,194::__init__::225::IOProcess::(_processLogs) (543593) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,194::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,194::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:54:26,195::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,195::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:54:26,195::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,195::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::INFO::2014-08-11 17:54:26,195::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:54:26,196::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:54:26,196::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c3864b6-f451-4780-8223-832b56b2cd2c`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:54:26,196::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:54:26,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c3864b6-f451-4780-8223-832b56b2cd2c`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:54:26,197::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:54:26,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:54:26,197::__init__::225::IOProcess::(_processLogs) (543594) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:54:26,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:54:26,198::__init__::225::IOProcess::(_processLogs) (543594) Got request for method 'stat' >Thread-10017::DEBUG::2014-08-11 17:54:26,198::task::993::Storage.TaskManager.Task::(_decref) Task=`3c3864b6-f451-4780-8223-832b56b2cd2c`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:54:26,198::__init__::225::IOProcess::(_processLogs) (543594) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,198::__init__::225::IOProcess::(_processLogs) (543594) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,199::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,199::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:54:26,220::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:54:26,292::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,292::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:26,292::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,292::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:26,293::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:26,293::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:26,293::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:26,293::__init__::225::IOProcess::(_processLogs) (543595) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:26,293::__init__::225::IOProcess::(_processLogs) (543595) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:26,294::__init__::225::IOProcess::(_processLogs) DEBUG|(543595) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,294::__init__::225::IOProcess::(_processLogs) (543595) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,294::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,295::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:54:26,295::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:54:26,366::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000466497 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) (543596) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:26,367::__init__::225::IOProcess::(_processLogs) (543596) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:26,368::__init__::225::IOProcess::(_processLogs) DEBUG|(543596) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,368::__init__::225::IOProcess::(_processLogs) (543596) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,368::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,368::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:26,369::__init__::225::IOProcess::(_processLogs) (543597) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) (543597) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) (543597) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) (543597) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:54:26,370::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) (543598) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) (543598) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) (543598) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) (543598) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,371::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:26,372::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:26,372::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:54:26,372::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:26,372::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:26,372::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) (543599) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) (543599) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) (543599) Building response >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) (543599) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:26,373::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:54:26,887::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:26,958::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0126802 s, 80.8 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:54:27,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`f929fe94-5a91-47ac-b476-175c457db849`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:54:27,549::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) (543600) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:54:27,550::__init__::225::IOProcess::(_processLogs) (543600) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:54:27,571::__init__::225::IOProcess::(_processLogs) DEBUG|(543600) Building response >Thread-19::DEBUG::2014-08-11 17:54:27,571::__init__::225::IOProcess::(_processLogs) (543600) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:27,571::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:27,572::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:54:27,572::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:27,572::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:54:27,572::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:27,573::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10256::INFO::2014-08-11 17:54:27,573::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:54:27,573::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10256::DEBUG::2014-08-11 17:54:27,573::task::1191::Storage.TaskManager.Task::(prepare) Task=`f929fe94-5a91-47ac-b476-175c457db849`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:54:27,574::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10256::DEBUG::2014-08-11 17:54:27,574::task::595::Storage.TaskManager.Task::(_updateState) Task=`f929fe94-5a91-47ac-b476-175c457db849`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:54:27,574::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:54:27,574::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:54:27,575::__init__::225::IOProcess::(_processLogs) (543601) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:54:27,575::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:54:27,575::__init__::225::IOProcess::(_processLogs) (543601) Got request for method 'stat' >Thread-10256::DEBUG::2014-08-11 17:54:27,575::task::993::Storage.TaskManager.Task::(_decref) Task=`f929fe94-5a91-47ac-b476-175c457db849`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:54:27,576::__init__::225::IOProcess::(_processLogs) (543601) Building response >Thread-19::DEBUG::2014-08-11 17:54:27,576::__init__::225::IOProcess::(_processLogs) (543601) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:27,576::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:27,576::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:54:27,596::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:28,016::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:28,016::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:28,016::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:54:28,284::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:54:28,966::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:29,090::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0611923 s, 16.7 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:54:29,610::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:54:29,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`32620e1d-a9aa-4232-8e9a-75ba527d64e0`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:29,610::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:54:29,663::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:29,663::task::1191::Storage.TaskManager.Task::(prepare) Task=`32620e1d-a9aa-4232-8e9a-75ba527d64e0`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:29,664::task::595::Storage.TaskManager.Task::(_updateState) Task=`32620e1d-a9aa-4232-8e9a-75ba527d64e0`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:29,664::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:29,664::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:29,664::task::993::Storage.TaskManager.Task::(_decref) Task=`32620e1d-a9aa-4232-8e9a-75ba527d64e0`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:54:29,675::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:54:29,675::task::595::Storage.TaskManager.Task::(_updateState) Task=`81c969fc-bf33-410d-b254-80bb6849c45a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:54:29,675::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:54:29,676::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`79b6474b-9f62-4ede-b0cf-506ddcc4f80e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:54:29,676::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:54:29,676::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:54:29,677::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`79b6474b-9f62-4ede-b0cf-506ddcc4f80e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:54:29,677::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81c969fc-bf33-410d-b254-80bb6849c45a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:54:29,677::task::993::Storage.TaskManager.Task::(_decref) Task=`81c969fc-bf33-410d-b254-80bb6849c45a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:54:29,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:29,694::task::1191::Storage.TaskManager.Task::(prepare) Task=`81c969fc-bf33-410d-b254-80bb6849c45a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:29,694::task::595::Storage.TaskManager.Task::(_updateState) Task=`81c969fc-bf33-410d-b254-80bb6849c45a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:54:29,694::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:54:29,694::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:54:29,694::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:54:29,694::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:54:29,694::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:54:29,695::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:54:29,695::task::993::Storage.TaskManager.Task::(_decref) Task=`81c969fc-bf33-410d-b254-80bb6849c45a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) (543602) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:30,400::__init__::225::IOProcess::(_processLogs) (543602) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:30,401::__init__::225::IOProcess::(_processLogs) DEBUG|(543602) Building response >Thread-19::DEBUG::2014-08-11 17:54:30,401::__init__::225::IOProcess::(_processLogs) (543602) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:30,401::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:30,401::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:54:30,402::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:54:30,489::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000367985 s, 995 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) (543603) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) (543603) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:30,490::__init__::225::IOProcess::(_processLogs) (543603) Building response >Thread-19::DEBUG::2014-08-11 17:54:30,491::__init__::225::IOProcess::(_processLogs) (543603) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:30,491::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:30,491::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:30,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:30,859::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:30,860::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:31,113::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:31,215::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0410406 s, 25.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:33,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:33,022::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:33,022::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:33,224::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:33,310::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0257255 s, 39.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:54:35,291::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:54:35,316::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:35,449::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0740759 s, 13.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:35,865::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:35,866::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:35,866::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:54:36,373::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:36,373::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:36,373::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:36,373::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:36,373::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:36,373::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:36,374::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:36,374::__init__::225::IOProcess::(_processLogs) (543604) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:36,374::__init__::225::IOProcess::(_processLogs) (543604) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:36,374::__init__::225::IOProcess::(_processLogs) DEBUG|(543604) Building response >Thread-19::DEBUG::2014-08-11 17:54:36,375::__init__::225::IOProcess::(_processLogs) (543604) Queuing response >Thread-28::DEBUG::2014-08-11 17:54:36,375::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:54:36,375::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:36,434::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:54:36,434::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000458683 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:36,435::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:36,435::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:36,435::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:36,435::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) (543605) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) (543605) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) (543605) Building response >Thread-19::DEBUG::2014-08-11 17:54:36,436::__init__::225::IOProcess::(_processLogs) (543605) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:36,437::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) (543606) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) (543606) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) (543606) Building response >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) (543606) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:54:36,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) (543607) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) (543607) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) (543607) Building response >Thread-19::DEBUG::2014-08-11 17:54:36,439::__init__::225::IOProcess::(_processLogs) (543607) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:36,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:36,440::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:36,440::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:36,440::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:54:36,440::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:36,440::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) (543608) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) (543608) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) (543608) Building response >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) (543608) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:36,441::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:54:37,458::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:37,560::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0444174 s, 23.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:38,028::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:38,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:38,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:39,569::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:39,666::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0377803 s, 27.1 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:54:39,757::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:54:39,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd4aba12-718c-4cbd-adc4-10ee11a66e2b`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:39,757::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:54:39,804::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:39,804::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd4aba12-718c-4cbd-adc4-10ee11a66e2b`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:39,804::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd4aba12-718c-4cbd-adc4-10ee11a66e2b`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:39,804::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:39,804::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:39,804::task::993::Storage.TaskManager.Task::(_decref) Task=`fd4aba12-718c-4cbd-adc4-10ee11a66e2b`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:54:39,815::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:54:39,816::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc3f8c80-9d12-44c9-ac3b-1a99638b1d0a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:54:39,816::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:54:39,816::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f3a7535f-2dda-42a4-8bc5-014ec0804b84`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:54:39,816::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:54:39,816::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:54:39,816::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`f3a7535f-2dda-42a4-8bc5-014ec0804b84`::Granted request >Thread-10197::DEBUG::2014-08-11 17:54:39,817::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bc3f8c80-9d12-44c9-ac3b-1a99638b1d0a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:54:39,817::task::993::Storage.TaskManager.Task::(_decref) Task=`bc3f8c80-9d12-44c9-ac3b-1a99638b1d0a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:54:39,834::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:39,834::task::1191::Storage.TaskManager.Task::(prepare) Task=`bc3f8c80-9d12-44c9-ac3b-1a99638b1d0a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:39,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`bc3f8c80-9d12-44c9-ac3b-1a99638b1d0a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:54:39,834::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:54:39,834::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:54:39,834::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:54:39,834::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:54:39,834::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:54:39,834::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:54:39,834::task::993::Storage.TaskManager.Task::(_decref) Task=`bc3f8c80-9d12-44c9-ac3b-1a99638b1d0a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:54:40,492::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:40,492::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:40,492::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:40,492::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:40,492::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:40,492::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:40,493::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:40,493::__init__::225::IOProcess::(_processLogs) (543609) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:40,493::__init__::225::IOProcess::(_processLogs) (543609) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:40,493::__init__::225::IOProcess::(_processLogs) DEBUG|(543609) Building response >Thread-19::DEBUG::2014-08-11 17:54:40,494::__init__::225::IOProcess::(_processLogs) (543609) Queuing response >Thread-27::DEBUG::2014-08-11 17:54:40,494::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:54:40,494::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:40,552::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:54:40,554::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00103375 s, 354 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:40,555::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:40,556::__init__::225::IOProcess::(_processLogs) (543610) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:40,556::__init__::225::IOProcess::(_processLogs) (543610) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:40,556::__init__::225::IOProcess::(_processLogs) DEBUG|(543610) Building response >Thread-19::DEBUG::2014-08-11 17:54:40,556::__init__::225::IOProcess::(_processLogs) (543610) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:40,557::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:40,557::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:40,868::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:40,869::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:40,869::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:54:41,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f286944-625e-43d3-b429-fbef8625fb31`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:41,097::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:54:41,097::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103375', 'lastCheck': '0.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458683', 'lastCheck': '4.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:41,097::task::1191::Storage.TaskManager.Task::(prepare) Task=`3f286944-625e-43d3-b429-fbef8625fb31`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00103375', 'lastCheck': '0.5', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000458683', 'lastCheck': '4.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:41,097::task::595::Storage.TaskManager.Task::(_updateState) Task=`3f286944-625e-43d3-b429-fbef8625fb31`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:41,097::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:41,097::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:41,097::task::993::Storage.TaskManager.Task::(_decref) Task=`3f286944-625e-43d3-b429-fbef8625fb31`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:54:41,115::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:54:41,115::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:54:41,228::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:54:41,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:41,779::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0452808 s, 22.6 MB/s\n'; <rc> = 0 >Thread-10256::DEBUG::2014-08-11 17:54:42,634::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:43,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:43,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:43,035::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:43,787::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:43,859::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0132876 s, 77.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:54:45,866::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:54:45,925::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:45,925::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:45,925::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:45,942::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0153459 s, 66.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:46,441::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:46,441::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) (543611) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:46,442::__init__::225::IOProcess::(_processLogs) (543611) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:46,443::__init__::225::IOProcess::(_processLogs) DEBUG|(543611) Building response >Thread-19::DEBUG::2014-08-11 17:54:46,443::__init__::225::IOProcess::(_processLogs) (543611) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:46,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:46,443::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:54:46,444::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:54:46,589::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00444813 s, 111 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:46,592::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:46,593::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:46,594::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:46,595::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:46,595::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:46,595::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:46,596::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:46,596::__init__::225::IOProcess::(_processLogs) (543612) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:46,596::__init__::225::IOProcess::(_processLogs) (543612) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:46,597::__init__::225::IOProcess::(_processLogs) DEBUG|(543612) Building response >Thread-19::DEBUG::2014-08-11 17:54:46,599::__init__::225::IOProcess::(_processLogs) (543612) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:46,599::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:46,600::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:46,600::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:46,601::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:54:46,602::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:46,602::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:46,603::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:46,603::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:46,603::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) (543613) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) (543613) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) (543613) Building response >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) (543613) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:54:46,604::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) (543614) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) (543614) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) (543614) Building response >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) (543614) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:46,605::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:46,606::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:46,606::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:46,606::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:54:46,606::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:46,606::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:46,606::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) (543615) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) (543615) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) (543615) Building response >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) (543615) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:46,607::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:54:47,949::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:48,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:48,040::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:48,041::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:48,066::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0576869 s, 17.8 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:54:49,887::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:54:49,887::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b257bf2-c73c-48d5-a2d8-0b07d92cfd58`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:49,887::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:54:49,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:49,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`5b257bf2-c73c-48d5-a2d8-0b07d92cfd58`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:54:49,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`5b257bf2-c73c-48d5-a2d8-0b07d92cfd58`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:49,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:49,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:49,939::task::993::Storage.TaskManager.Task::(_decref) Task=`5b257bf2-c73c-48d5-a2d8-0b07d92cfd58`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:54:49,950::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:54:49,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfa4f1ff-c9fc-482c-8f13-d26dcfcd7ad9`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:54:49,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:54:49,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4ef70e52-70bd-416d-9183-112d0fe190e3`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:54:49,950::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:54:49,950::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:54:49,950::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`4ef70e52-70bd-416d-9183-112d0fe190e3`::Granted request >Thread-10197::DEBUG::2014-08-11 17:54:49,951::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bfa4f1ff-c9fc-482c-8f13-d26dcfcd7ad9`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:54:49,951::task::993::Storage.TaskManager.Task::(_decref) Task=`bfa4f1ff-c9fc-482c-8f13-d26dcfcd7ad9`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:54:49,982::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:49,982::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfa4f1ff-c9fc-482c-8f13-d26dcfcd7ad9`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:54:49,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfa4f1ff-c9fc-482c-8f13-d26dcfcd7ad9`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:54:49,982::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:54:49,983::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:54:49,983::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:54:49,983::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:54:49,983::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:54:49,983::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:54:49,983::task::993::Storage.TaskManager.Task::(_decref) Task=`bfa4f1ff-c9fc-482c-8f13-d26dcfcd7ad9`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:54:50,074::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:50,153::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0196164 s, 52.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:50,557::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:50,557::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:50,557::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:50,557::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) (543616) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) (543616) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) DEBUG|(543616) Building response >Thread-19::DEBUG::2014-08-11 17:54:50,558::__init__::225::IOProcess::(_processLogs) (543616) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:50,559::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:54:50,559::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:54:50,559::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:54:50,638::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00399481 s, 91.6 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:50,638::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:50,638::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:50,638::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:50,639::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:50,639::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:50,639::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:50,639::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:50,639::__init__::225::IOProcess::(_processLogs) (543617) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:50,639::__init__::225::IOProcess::(_processLogs) (543617) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:50,640::__init__::225::IOProcess::(_processLogs) DEBUG|(543617) Building response >Thread-19::DEBUG::2014-08-11 17:54:50,640::__init__::225::IOProcess::(_processLogs) (543617) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:50,640::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:54:50,641::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:50,929::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:50,931::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:50,933::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:52,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:52,267::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0482831 s, 21.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:53,045::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:53,046::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:53,046::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:54,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:54,360::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0262971 s, 38.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:54:55,939::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:55,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:54:55,940::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:54:56,235::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:54:56,319::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d3420de-890d-492d-b914-e24633c5def6`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:54:56,320::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:54:56,320::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00399481', 'lastCheck': '5.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00444813', 'lastCheck': '9.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:56,320::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d3420de-890d-492d-b914-e24633c5def6`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00399481', 'lastCheck': '5.7', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00444813', 'lastCheck': '9.7', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:54:56,320::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d3420de-890d-492d-b914-e24633c5def6`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:54:56,320::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:54:56,320::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:54:56,320::task::993::Storage.TaskManager.Task::(_decref) Task=`5d3420de-890d-492d-b914-e24633c5def6`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:54:56,337::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:54:56,338::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:54:56,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:56,450::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.019921 s, 51.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:56,607::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:56,607::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:56,607::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) (543618) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) (543618) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:56,608::__init__::225::IOProcess::(_processLogs) DEBUG|(543618) Building response >Thread-28::DEBUG::2014-08-11 17:54:56,609::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:54:56,609::__init__::225::IOProcess::(_processLogs) (543618) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:56,669::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:56,669::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:54:56,671::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00197436 s, 251 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:54:56,673::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:56,673::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:54:56,674::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:56,674::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:56,675::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:56,675::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:56,675::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:56,676::__init__::225::IOProcess::(_processLogs) (543619) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:54:56,676::__init__::225::IOProcess::(_processLogs) (543619) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:54:56,677::__init__::225::IOProcess::(_processLogs) DEBUG|(543619) Building response >Thread-19::DEBUG::2014-08-11 17:54:56,677::__init__::225::IOProcess::(_processLogs) (543619) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:56,677::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:56,678::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) (543620) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) (543620) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) (543620) Building response >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) (543620) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:56,679::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) (543621) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) (543621) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) (543621) Building response >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) (543621) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:56,680::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:56,681::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:54:56,681::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:54:56,681::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:54:56,681::__init__::225::IOProcess::(_processLogs) DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:54:56,681::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:54:56,681::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) (543622) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) (543622) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) (543622) Building response >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) (543622) Queuing response >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:54:56,682::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10256::DEBUG::2014-08-11 17:54:57,642::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:58,050::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:58,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:54:58,051::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:54:58,337::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:54:58,456::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:54:58,527::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124446 s, 82.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:55:00,018::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:55:00,018::task::595::Storage.TaskManager.Task::(_updateState) Task=`49b71dd5-08b1-46b8-acd3-5416892d03c5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:00,018::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:55:00,069::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:00,069::task::1191::Storage.TaskManager.Task::(prepare) Task=`49b71dd5-08b1-46b8-acd3-5416892d03c5`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:00,069::task::595::Storage.TaskManager.Task::(_updateState) Task=`49b71dd5-08b1-46b8-acd3-5416892d03c5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:00,069::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:00,069::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:00,070::task::993::Storage.TaskManager.Task::(_decref) Task=`49b71dd5-08b1-46b8-acd3-5416892d03c5`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:55:00,081::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:55:00,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc8e6a9c-3399-4830-937e-1a43b1c51bff`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:55:00,081::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:55:00,081::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`81de18a5-285f-4648-9560-478f680c054e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:55:00,081::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:55:00,081::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:55:00,081::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`81de18a5-285f-4648-9560-478f680c054e`::Granted request >Thread-10197::DEBUG::2014-08-11 17:55:00,082::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fc8e6a9c-3399-4830-937e-1a43b1c51bff`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:55:00,082::task::993::Storage.TaskManager.Task::(_decref) Task=`fc8e6a9c-3399-4830-937e-1a43b1c51bff`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:55:00,098::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:00,098::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc8e6a9c-3399-4830-937e-1a43b1c51bff`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:00,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc8e6a9c-3399-4830-937e-1a43b1c51bff`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:55:00,098::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:55:00,099::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:55:00,099::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:55:00,099::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:55:00,099::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:55:00,099::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:55:00,099::task::993::Storage.TaskManager.Task::(_decref) Task=`fc8e6a9c-3399-4830-937e-1a43b1c51bff`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:55:00,535::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:00,633::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0382952 s, 26.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) (543623) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) (543623) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:00,642::__init__::225::IOProcess::(_processLogs) DEBUG|(543623) Building response >Thread-19::DEBUG::2014-08-11 17:55:00,643::__init__::225::IOProcess::(_processLogs) (543623) Queuing response >Thread-27::DEBUG::2014-08-11 17:55:00,643::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:55:00,644::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:00,703::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:55:00,704::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00116873 s, 313 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:00,706::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:00,706::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:00,707::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:00,707::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:00,707::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:00,708::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:00,708::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:00,709::__init__::225::IOProcess::(_processLogs) (543624) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:00,709::__init__::225::IOProcess::(_processLogs) (543624) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:00,710::__init__::225::IOProcess::(_processLogs) DEBUG|(543624) Building response >Thread-19::DEBUG::2014-08-11 17:55:00,711::__init__::225::IOProcess::(_processLogs) (543624) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:00,712::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:00,713::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:00,943::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:00,945::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:00,947::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:02,641::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:02,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189249 s, 54.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:03,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:03,056::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:03,057::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:04,729::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:04,840::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0518806 s, 19.7 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:55:05,345::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >GuestMonitor-vm::DEBUG::2014-08-11 17:55:05,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:05,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:05,954::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:06,682::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:06,682::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:06,682::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:06,683::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:06,683::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:06,683::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:06,683::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:06,683::__init__::225::IOProcess::(_processLogs) (543625) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:06,683::__init__::225::IOProcess::(_processLogs) (543625) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:06,684::__init__::225::IOProcess::(_processLogs) DEBUG|(543625) Building response >Thread-19::DEBUG::2014-08-11 17:55:06,684::__init__::225::IOProcess::(_processLogs) (543625) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:06,684::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:06,684::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:55:06,685::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:55:06,745::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000301121 s, 1.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:06,747::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:06,747::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:06,748::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:06,749::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:06,749::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:06,750::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:06,750::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:06,750::__init__::225::IOProcess::(_processLogs) (543626) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:06,751::__init__::225::IOProcess::(_processLogs) (543626) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:06,752::__init__::225::IOProcess::(_processLogs) DEBUG|(543626) Building response >Thread-19::DEBUG::2014-08-11 17:55:06,753::__init__::225::IOProcess::(_processLogs) (543626) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:06,753::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:06,753::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:06,754::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:06,754::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:55:06,755::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:06,755::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:06,755::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:06,755::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) (543627) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) (543627) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) (543627) Building response >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) (543627) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:06,756::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) (543628) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) (543628) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:06,757::__init__::225::IOProcess::(_processLogs) (543628) Building response >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) (543628) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:06,758::__init__::225::IOProcess::(_processLogs) (543629) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:06,759::__init__::225::IOProcess::(_processLogs) (543629) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:06,759::__init__::225::IOProcess::(_processLogs) DEBUG|(543629) Building response >Thread-19::DEBUG::2014-08-11 17:55:06,759::__init__::225::IOProcess::(_processLogs) (543629) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:06,759::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:06,759::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:55:06,849::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:06,963::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551052 s, 18.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:08,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:08,060::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:08,061::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:08,969::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:09,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0438873 s, 23.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:55:10,270::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:55:10,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`be1801ef-36c4-4ab8-85cd-4319ed8e226e`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:10,271::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:55:10,298::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:10,298::task::1191::Storage.TaskManager.Task::(prepare) Task=`be1801ef-36c4-4ab8-85cd-4319ed8e226e`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:10,299::task::595::Storage.TaskManager.Task::(_updateState) Task=`be1801ef-36c4-4ab8-85cd-4319ed8e226e`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:10,299::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:10,299::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:10,299::task::993::Storage.TaskManager.Task::(_decref) Task=`be1801ef-36c4-4ab8-85cd-4319ed8e226e`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:55:10,311::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:55:10,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`d865ff20-d663-44ba-a0d1-24646f996e74`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:55:10,311::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:55:10,311::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2f1b27d7-d679-4fae-94e3-45607c64c127`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:55:10,311::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:55:10,312::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:55:10,312::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`2f1b27d7-d679-4fae-94e3-45607c64c127`::Granted request >Thread-10197::DEBUG::2014-08-11 17:55:10,312::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d865ff20-d663-44ba-a0d1-24646f996e74`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:55:10,312::task::993::Storage.TaskManager.Task::(_decref) Task=`d865ff20-d663-44ba-a0d1-24646f996e74`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:55:10,328::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:10,328::task::1191::Storage.TaskManager.Task::(prepare) Task=`d865ff20-d663-44ba-a0d1-24646f996e74`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:10,328::task::595::Storage.TaskManager.Task::(_updateState) Task=`d865ff20-d663-44ba-a0d1-24646f996e74`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:55:10,328::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:55:10,328::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:55:10,328::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:55:10,328::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:55:10,328::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:55:10,328::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:55:10,329::task::993::Storage.TaskManager.Task::(_decref) Task=`d865ff20-d663-44ba-a0d1-24646f996e74`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:10,711::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:10,711::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) (543630) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:10,712::__init__::225::IOProcess::(_processLogs) (543630) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:10,713::__init__::225::IOProcess::(_processLogs) DEBUG|(543630) Building response >Thread-19::DEBUG::2014-08-11 17:55:10,713::__init__::225::IOProcess::(_processLogs) (543630) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:10,713::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:10,713::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:55:10,713::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:55:10,785::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00102481 s, 357 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:10,786::__init__::225::IOProcess::(_processLogs) (543631) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:10,787::__init__::225::IOProcess::(_processLogs) (543631) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:10,787::__init__::225::IOProcess::(_processLogs) DEBUG|(543631) Building response >Thread-19::DEBUG::2014-08-11 17:55:10,787::__init__::225::IOProcess::(_processLogs) (543631) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:10,788::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:10,788::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:10,960::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:10,960::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:10,960::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:11,080::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:11,159::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0214688 s, 47.7 MB/s\n'; <rc> = 0 >Thread-10017::DEBUG::2014-08-11 17:55:11,243::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:55:11,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`4140c791-b270-4d9e-8dfc-7e525d2f3caa`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:11,646::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:55:11,646::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102481', 'lastCheck': '0.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301121', 'lastCheck': '4.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:55:11,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`4140c791-b270-4d9e-8dfc-7e525d2f3caa`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00102481', 'lastCheck': '0.9', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000301121', 'lastCheck': '4.9', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:55:11,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`4140c791-b270-4d9e-8dfc-7e525d2f3caa`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:11,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:11,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:11,647::task::993::Storage.TaskManager.Task::(_decref) Task=`4140c791-b270-4d9e-8dfc-7e525d2f3caa`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:55:11,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:55:11,665::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10256::DEBUG::2014-08-11 17:55:12,651::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:13,062::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:13,062::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:13,062::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:13,168::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:13,239::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0124794 s, 82.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:55:15,246::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:15,335::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0296117 s, 34.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:15,964::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:15,964::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:15,964::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) (543632) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:16,760::__init__::225::IOProcess::(_processLogs) (543632) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:16,761::__init__::225::IOProcess::(_processLogs) DEBUG|(543632) Building response >Thread-19::DEBUG::2014-08-11 17:55:16,761::__init__::225::IOProcess::(_processLogs) (543632) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:16,761::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:55:16,761::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:55:16,762::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:55:16,822::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00077656 s, 637 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:16,823::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:16,824::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:16,824::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:16,824::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:16,825::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:16,825::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:16,826::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:16,826::__init__::225::IOProcess::(_processLogs) (543633) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:16,827::__init__::225::IOProcess::(_processLogs) (543633) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:16,827::__init__::225::IOProcess::(_processLogs) DEBUG|(543633) Building response >Thread-19::DEBUG::2014-08-11 17:55:16,830::__init__::225::IOProcess::(_processLogs) (543633) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:16,830::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:16,830::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) (543634) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:16,831::__init__::225::IOProcess::(_processLogs) (543634) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) DEBUG|(543634) Building response >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) (543634) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:16,832::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) (543635) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) (543635) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) DEBUG|(543635) Building response >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) (543635) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:16,833::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:16,834::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:16,835::__init__::225::IOProcess::(_processLogs) (543636) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:16,835::__init__::225::IOProcess::(_processLogs) (543636) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:16,835::__init__::225::IOProcess::(_processLogs) (543636) Building response >Thread-19::DEBUG::2014-08-11 17:55:16,835::__init__::225::IOProcess::(_processLogs) (543636) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:16,835::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:16,835::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:55:17,343::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:17,498::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0947753 s, 10.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:18,068::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:18,069::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:18,069::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:19,506::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:19,577::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0121234 s, 84.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:55:20,384::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:55:20,385::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cc773a6-7aab-4fbd-87d4-2984258310a7`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:20,385::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:55:20,460::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:20,461::task::1191::Storage.TaskManager.Task::(prepare) Task=`2cc773a6-7aab-4fbd-87d4-2984258310a7`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:20,461::task::595::Storage.TaskManager.Task::(_updateState) Task=`2cc773a6-7aab-4fbd-87d4-2984258310a7`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:20,461::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:20,461::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:20,461::task::993::Storage.TaskManager.Task::(_decref) Task=`2cc773a6-7aab-4fbd-87d4-2984258310a7`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:55:20,473::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:55:20,473::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca42c3ff-ac30-4526-b415-0434ed9fcdf2`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:55:20,473::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:55:20,474::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fa7c3aa8-31aa-4e2d-99f8-0a9df3462951`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:55:20,474::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:55:20,474::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:55:20,474::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`fa7c3aa8-31aa-4e2d-99f8-0a9df3462951`::Granted request >Thread-10197::DEBUG::2014-08-11 17:55:20,474::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ca42c3ff-ac30-4526-b415-0434ed9fcdf2`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:55:20,474::task::993::Storage.TaskManager.Task::(_decref) Task=`ca42c3ff-ac30-4526-b415-0434ed9fcdf2`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:55:20,490::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:20,490::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca42c3ff-ac30-4526-b415-0434ed9fcdf2`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:20,491::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca42c3ff-ac30-4526-b415-0434ed9fcdf2`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:55:20,491::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:55:20,491::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:55:20,491::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:55:20,491::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:55:20,491::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:55:20,491::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:55:20,491::task::993::Storage.TaskManager.Task::(_decref) Task=`ca42c3ff-ac30-4526-b415-0434ed9fcdf2`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:20,788::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:20,789::__init__::225::IOProcess::(_processLogs) (543637) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:20,789::__init__::225::IOProcess::(_processLogs) (543637) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:20,789::__init__::225::IOProcess::(_processLogs) DEBUG|(543637) Building response >Thread-19::DEBUG::2014-08-11 17:55:20,789::__init__::225::IOProcess::(_processLogs) (543637) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:20,789::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:20,790::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:55:20,790::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:55:20,851::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000584335 s, 626 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:20,854::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:20,855::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:20,856::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:20,857::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:20,857::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:20,858::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:20,858::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:20,858::__init__::225::IOProcess::(_processLogs) (543638) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:20,858::__init__::225::IOProcess::(_processLogs) (543638) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:20,859::__init__::225::IOProcess::(_processLogs) DEBUG|(543638) Building response >Thread-19::DEBUG::2014-08-11 17:55:20,861::__init__::225::IOProcess::(_processLogs) (543638) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:20,861::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:20,861::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:20,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:20,970::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:20,971::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:21,585::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:21,691::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0477306 s, 21.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:23,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:23,075::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:23,076::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:23,699::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:23,774::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0128193 s, 79.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:55:25,783::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:25,898::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0563462 s, 18.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:25,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:25,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:25,976::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:55:26,272::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ab47fcd-82a3-4347-928d-9b7988a3d340`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:55:26,272::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:55:26,272::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:26,272::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:55:26,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:26,273::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:26,273::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:26,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:26,273::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:26,273::__init__::225::IOProcess::(_processLogs) (543639) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:55:26,273::__init__::225::IOProcess::(_processLogs) (543639) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:55:26,276::__init__::225::IOProcess::(_processLogs) DEBUG|(543639) Building response >Thread-19::DEBUG::2014-08-11 17:55:26,276::__init__::225::IOProcess::(_processLogs) (543639) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,276::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,277::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:55:26,277::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:26,277::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:55:26,277::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10017::INFO::2014-08-11 17:55:26,277::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:55:26,277::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-10017::DEBUG::2014-08-11 17:55:26,278::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ab47fcd-82a3-4347-928d-9b7988a3d340`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:55:26,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:55:26,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ab47fcd-82a3-4347-928d-9b7988a3d340`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:55:26,279::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:55:26,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:55:26,279::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:55:26,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:55:26,280::__init__::225::IOProcess::(_processLogs) (543640) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:55:26,280::task::993::Storage.TaskManager.Task::(_decref) Task=`0ab47fcd-82a3-4347-928d-9b7988a3d340`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:26,280::__init__::225::IOProcess::(_processLogs) (543640) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:55:26,280::__init__::225::IOProcess::(_processLogs) (543640) Building response >Thread-19::DEBUG::2014-08-11 17:55:26,281::__init__::225::IOProcess::(_processLogs) (543640) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,281::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:55:26,301::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:55:26,835::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:26,835::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:26,835::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:26,835::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:26,836::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:26,836::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:26,836::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:26,836::__init__::225::IOProcess::(_processLogs) (543641) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:26,836::__init__::225::IOProcess::(_processLogs) (543641) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:26,836::__init__::225::IOProcess::(_processLogs) DEBUG|(543641) Building response >Thread-28::DEBUG::2014-08-11 17:55:26,837::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:55:26,837::__init__::225::IOProcess::(_processLogs) (543641) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,897::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,899::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:55:26,900::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000383485 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:26,903::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-10237::DEBUG::2014-08-11 17:55:26,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`31f48f9c-fb7d-455a-aaf8-c7defaa0fb0a`::moving from state init -> state preparing >Thread-19::DEBUG::2014-08-11 17:55:26,904::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-10237::INFO::2014-08-11 17:55:26,905::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-19::DEBUG::2014-08-11 17:55:26,905::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:26,907::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10237::INFO::2014-08-11 17:55:26,907::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584335', 'lastCheck': '6.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077656', 'lastCheck': '10.1', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:55:26,908::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10237::DEBUG::2014-08-11 17:55:26,908::task::1191::Storage.TaskManager.Task::(prepare) Task=`31f48f9c-fb7d-455a-aaf8-c7defaa0fb0a`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000584335', 'lastCheck': '6.0', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00077656', 'lastCheck': '10.1', 'valid': True}} >Thread-19::DEBUG::2014-08-11 17:55:26,909::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10237::DEBUG::2014-08-11 17:55:26,909::task::595::Storage.TaskManager.Task::(_updateState) Task=`31f48f9c-fb7d-455a-aaf8-c7defaa0fb0a`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:55:26,910::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10237::DEBUG::2014-08-11 17:55:26,910::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:55:26,911::__init__::225::IOProcess::(_processLogs) (543642) Finding callback 'statvfs'... >Thread-10237::DEBUG::2014-08-11 17:55:26,911::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:55:26,912::__init__::225::IOProcess::(_processLogs) (543642) Got request for method 'statvfs' >Thread-10237::DEBUG::2014-08-11 17:55:26,912::task::993::Storage.TaskManager.Task::(_decref) Task=`31f48f9c-fb7d-455a-aaf8-c7defaa0fb0a`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:26,914::__init__::225::IOProcess::(_processLogs) DEBUG|(543642) Building response >Thread-19::DEBUG::2014-08-11 17:55:26,915::__init__::225::IOProcess::(_processLogs) (543642) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,916::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,917::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:26,917::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:26,918::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:55:26,919::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:26,919::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:26,920::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:26,920::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:26,921::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:26,922::__init__::225::IOProcess::(_processLogs) DEBUG|(543643) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:26,923::__init__::225::IOProcess::(_processLogs) (543643) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:26,923::__init__::225::IOProcess::(_processLogs) (543643) Building response >Thread-19::DEBUG::2014-08-11 17:55:26,924::__init__::225::IOProcess::(_processLogs) (543643) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,925::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,925::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:26,926::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:26,926::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:55:26,926::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:26,926::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:26,926::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:26,926::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) (543644) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) (543644) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) (543644) Building response >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) (543644) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,927::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:26,928::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:26,928::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:55:26,928::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:26,928::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:26,928::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:26,928::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) (543645) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) (543645) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) (543645) Building response >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) (543645) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:26,929::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:55:26,937::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:55:26,938::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10256::DEBUG::2014-08-11 17:55:27,653::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6573f32-7e41-463f-8fd3-0c47e513edab`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:55:27,653::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:55:27,653::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:27,653::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) (543646) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:55:27,654::__init__::225::IOProcess::(_processLogs) (543646) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:55:27,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543646) Building response >Thread-19::DEBUG::2014-08-11 17:55:27,657::__init__::225::IOProcess::(_processLogs) (543646) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:27,657::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:27,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:55:27,657::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:27,658::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:55:27,658::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:27,658::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-10256::INFO::2014-08-11 17:55:27,658::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:55:27,658::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10256::DEBUG::2014-08-11 17:55:27,659::task::1191::Storage.TaskManager.Task::(prepare) Task=`e6573f32-7e41-463f-8fd3-0c47e513edab`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-10256::DEBUG::2014-08-11 17:55:27,659::task::595::Storage.TaskManager.Task::(_updateState) Task=`e6573f32-7e41-463f-8fd3-0c47e513edab`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:55:27,659::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10256::DEBUG::2014-08-11 17:55:27,659::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:55:27,660::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:55:27,660::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:55:27,660::__init__::225::IOProcess::(_processLogs) (543647) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:55:27,660::task::993::Storage.TaskManager.Task::(_decref) Task=`e6573f32-7e41-463f-8fd3-0c47e513edab`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:27,661::__init__::225::IOProcess::(_processLogs) (543647) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:55:27,661::__init__::225::IOProcess::(_processLogs) (543647) Building response >Thread-19::DEBUG::2014-08-11 17:55:27,661::__init__::225::IOProcess::(_processLogs) (543647) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:27,661::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:27,661::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:55:27,711::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:55:27,906::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:27,980::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.014661 s, 69.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:28,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:28,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:28,082::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:55:28,412::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:55:29,988::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:30,059::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122611 s, 83.5 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:55:30,562::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:55:30,563::task::595::Storage.TaskManager.Task::(_updateState) Task=`b857cdbd-0597-4d39-903b-6ba741231949`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:30,564::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:55:30,607::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:30,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`b857cdbd-0597-4d39-903b-6ba741231949`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:30,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`b857cdbd-0597-4d39-903b-6ba741231949`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:30,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:30,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:30,608::task::993::Storage.TaskManager.Task::(_decref) Task=`b857cdbd-0597-4d39-903b-6ba741231949`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:55:30,618::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:55:30,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`3319becf-6fb0-4a9c-a3e9-a3d5785f6bbb`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:55:30,619::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:55:30,619::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b26d986e-8a62-4802-b0fa-66f1d9bad409`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:55:30,619::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:55:30,619::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:55:30,619::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`b26d986e-8a62-4802-b0fa-66f1d9bad409`::Granted request >Thread-10197::DEBUG::2014-08-11 17:55:30,619::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3319becf-6fb0-4a9c-a3e9-a3d5785f6bbb`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:55:30,620::task::993::Storage.TaskManager.Task::(_decref) Task=`3319becf-6fb0-4a9c-a3e9-a3d5785f6bbb`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:55:30,635::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:30,636::task::1191::Storage.TaskManager.Task::(prepare) Task=`3319becf-6fb0-4a9c-a3e9-a3d5785f6bbb`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:30,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`3319becf-6fb0-4a9c-a3e9-a3d5785f6bbb`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:55:30,636::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:55:30,636::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:55:30,636::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:55:30,636::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:55:30,636::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:55:30,636::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:55:30,636::task::993::Storage.TaskManager.Task::(_decref) Task=`3319becf-6fb0-4a9c-a3e9-a3d5785f6bbb`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:30,861::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:30,861::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:30,861::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:30,861::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:30,861::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:30,862::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-27::DEBUG::2014-08-11 17:55:30,862::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:55:30,862::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:30,922::__init__::225::IOProcess::(_processLogs) (543648) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:30,924::__init__::225::IOProcess::(_processLogs) (543648) Got request for method 'statvfs' >Thread-27::DEBUG::2014-08-11 17:55:30,925::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000713758 s, 513 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:30,926::__init__::225::IOProcess::(_processLogs) (543648) Building response >Thread-19::DEBUG::2014-08-11 17:55:30,928::__init__::225::IOProcess::(_processLogs) (543648) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:30,929::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:30,930::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:30,932::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:30,934::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:30,935::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:30,937::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:30,938::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:30,938::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:30,938::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:30,939::__init__::225::IOProcess::(_processLogs) (543649) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:30,939::__init__::225::IOProcess::(_processLogs) (543649) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:30,940::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543649) Building response >Thread-19::DEBUG::2014-08-11 17:55:30,941::__init__::225::IOProcess::(_processLogs) (543649) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:30,941::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:30,942::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:30,982::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:30,983::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:30,983::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:32,071::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:32,221::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0894833 s, 11.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:33,088::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:33,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:33,089::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:34,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:34,348::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0129876 s, 78.8 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:55:35,419::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >GuestMonitor-vm::DEBUG::2014-08-11 17:55:35,989::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:35,989::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:35,989::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:36,356::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:36,488::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0536116 s, 19.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:36,929::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:36,929::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:36,929::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:36,929::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:36,929::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) (543650) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) (543650) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543650) Building response >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) (543650) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:36,930::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:55:36,931::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:55:36,991::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000669202 s, 740 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:36,993::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:36,993::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:36,994::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:36,994::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:36,994::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:36,995::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:36,995::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:36,996::__init__::225::IOProcess::(_processLogs) (543651) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:36,996::__init__::225::IOProcess::(_processLogs) (543651) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:36,997::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543651) Building response >Thread-19::DEBUG::2014-08-11 17:55:36,998::__init__::225::IOProcess::(_processLogs) (543651) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:36,998::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:36,999::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:37,000::__init__::225::IOProcess::(_processLogs) (543652) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) (543652) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) (543652) Building response >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) (543652) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:37,001::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) (543653) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) (543653) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) (543653) Building response >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) (543653) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:37,002::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:37,003::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:37,003::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:55:37,003::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:37,003::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:37,003::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:37,003::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) (543654) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) (543654) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) (543654) Building response >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) (543654) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:37,004::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:38,092::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:38,092::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:38,093::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:38,495::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:38,626::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0724565 s, 14.1 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:55:40,635::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10237::DEBUG::2014-08-11 17:55:40,693::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:55:40,693::task::595::Storage.TaskManager.Task::(_updateState) Task=`add35610-5468-447d-b221-0d1d322a1941`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:40,694::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Dummy-51::DEBUG::2014-08-11 17:55:40,802::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.108203 s, 9.5 MB/s\n'; <rc> = 0 >Thread-10237::INFO::2014-08-11 17:55:40,810::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:40,810::task::1191::Storage.TaskManager.Task::(prepare) Task=`add35610-5468-447d-b221-0d1d322a1941`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:40,810::task::595::Storage.TaskManager.Task::(_updateState) Task=`add35610-5468-447d-b221-0d1d322a1941`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:40,811::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:40,811::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:40,811::task::993::Storage.TaskManager.Task::(_decref) Task=`add35610-5468-447d-b221-0d1d322a1941`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:55:40,822::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:55:40,822::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f104d0d-e694-4570-a680-3a330e8323df`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:55:40,823::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:55:40,823::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7ef5a31d-bf5d-45a6-af5b-e0922f1f7d96`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:55:40,823::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:55:40,823::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:55:40,823::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`7ef5a31d-bf5d-45a6-af5b-e0922f1f7d96`::Granted request >Thread-10197::DEBUG::2014-08-11 17:55:40,823::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5f104d0d-e694-4570-a680-3a330e8323df`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:55:40,823::task::993::Storage.TaskManager.Task::(_decref) Task=`5f104d0d-e694-4570-a680-3a330e8323df`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:55:40,842::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:40,842::task::1191::Storage.TaskManager.Task::(prepare) Task=`5f104d0d-e694-4570-a680-3a330e8323df`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:40,842::task::595::Storage.TaskManager.Task::(_updateState) Task=`5f104d0d-e694-4570-a680-3a330e8323df`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:55:40,842::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:55:40,842::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:55:40,842::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:55:40,842::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:55:40,842::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:55:40,842::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:55:40,842::task::993::Storage.TaskManager.Task::(_decref) Task=`5f104d0d-e694-4570-a680-3a330e8323df`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:40,942::__init__::225::IOProcess::(_processLogs) (543655) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:40,943::__init__::225::IOProcess::(_processLogs) (543655) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:40,943::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543655) Building response >Thread-19::DEBUG::2014-08-11 17:55:40,943::__init__::225::IOProcess::(_processLogs) (543655) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:40,943::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:40,944::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:55:40,945::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:55:41,008::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-27::DEBUG::2014-08-11 17:55:41,008::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000899453 s, 407 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:41,012::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:41,014::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:41,016::__init__::225::IOProcess::(_processLogs) Marshaling message... >GuestMonitor-vm::DEBUG::2014-08-11 17:55:41,016::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:41,017::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:41,018::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:41,020::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >GuestMonitor-vm::DEBUG::2014-08-11 17:55:41,021::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:41,021::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:41,022::__init__::225::IOProcess::(_processLogs) (543656) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:41,023::__init__::225::IOProcess::(_processLogs) (543656) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:41,024::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543656) Building response >Thread-19::DEBUG::2014-08-11 17:55:41,025::__init__::225::IOProcess::(_processLogs) (543656) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:41,025::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:41,025::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10017::DEBUG::2014-08-11 17:55:41,341::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:55:42,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`468fa44f-4117-45f4-b6cc-cd4567b1a7f3`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:42,124::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:55:42,124::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899453', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669202', 'lastCheck': '5.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:55:42,124::task::1191::Storage.TaskManager.Task::(prepare) Task=`468fa44f-4117-45f4-b6cc-cd4567b1a7f3`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000899453', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000669202', 'lastCheck': '5.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:55:42,124::task::595::Storage.TaskManager.Task::(_updateState) Task=`468fa44f-4117-45f4-b6cc-cd4567b1a7f3`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:42,124::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:42,124::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:42,124::task::993::Storage.TaskManager.Task::(_decref) Task=`468fa44f-4117-45f4-b6cc-cd4567b1a7f3`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:55:42,136::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:55:42,136::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10256::DEBUG::2014-08-11 17:55:42,719::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:55:42,812::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:42,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.054368 s, 18.8 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:43,113::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:43,114::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:43,114::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:44,934::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:45,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0666959 s, 15.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:46,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:46,029::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:46,030::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) (543657) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:47,004::__init__::225::IOProcess::(_processLogs) (543657) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:47,005::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543657) Building response >Thread-19::DEBUG::2014-08-11 17:55:47,005::__init__::225::IOProcess::(_processLogs) (543657) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:47,005::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:47,006::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:55:47,006::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:47,067::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-28::DEBUG::2014-08-11 17:55:47,068::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00212509 s, 233 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:47,128::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:47,129::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:47,129::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:47,130::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:47,130::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:47,130::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:47,131::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:47,131::__init__::225::IOProcess::(_processLogs) (543658) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:47,131::__init__::225::IOProcess::(_processLogs) (543658) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:47,131::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543658) Building response >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) (543658) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:47,132::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) (543659) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) (543659) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) (543659) Building response >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) (543659) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:47,133::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) (543660) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) (543660) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) (543660) Building response >Thread-19::DEBUG::2014-08-11 17:55:47,134::__init__::225::IOProcess::(_processLogs) (543660) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:47,135::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:47,135::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:47,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:47,135::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:55:47,135::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:47,135::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) (543661) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) (543661) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) (543661) Building response >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) (543661) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:47,136::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:55:47,182::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0541205 s, 18.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:48,120::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:48,120::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:48,121::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:49,189::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:49,275::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.026952 s, 38.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:55:50,908::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:55:50,908::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b12e6af-70c9-4989-89d5-e7a228bbf0f4`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:50,908::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:55:50,938::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:50,938::task::1191::Storage.TaskManager.Task::(prepare) Task=`6b12e6af-70c9-4989-89d5-e7a228bbf0f4`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:55:50,938::task::595::Storage.TaskManager.Task::(_updateState) Task=`6b12e6af-70c9-4989-89d5-e7a228bbf0f4`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:50,938::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:50,938::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:50,938::task::993::Storage.TaskManager.Task::(_decref) Task=`6b12e6af-70c9-4989-89d5-e7a228bbf0f4`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:55:50,950::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:55:50,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`e309c86f-53f6-4d2d-912e-fc0e5512e88e`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:55:50,950::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:55:50,950::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`39eef612-4559-41e1-8b67-bdfcba03c50f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:55:50,951::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:55:50,951::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:55:50,951::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`39eef612-4559-41e1-8b67-bdfcba03c50f`::Granted request >Thread-10197::DEBUG::2014-08-11 17:55:50,951::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e309c86f-53f6-4d2d-912e-fc0e5512e88e`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:55:50,951::task::993::Storage.TaskManager.Task::(_decref) Task=`e309c86f-53f6-4d2d-912e-fc0e5512e88e`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:55:50,967::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:50,967::task::1191::Storage.TaskManager.Task::(prepare) Task=`e309c86f-53f6-4d2d-912e-fc0e5512e88e`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:55:50,967::task::595::Storage.TaskManager.Task::(_updateState) Task=`e309c86f-53f6-4d2d-912e-fc0e5512e88e`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:55:50,967::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:55:50,967::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:55:50,967::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:55:50,968::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:55:50,968::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:55:50,968::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:55:50,968::task::993::Storage.TaskManager.Task::(_decref) Task=`e309c86f-53f6-4d2d-912e-fc0e5512e88e`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:55:51,025::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:51,025::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) (543662) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:51,026::__init__::225::IOProcess::(_processLogs) (543662) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:51,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543662) Building response >Thread-19::DEBUG::2014-08-11 17:55:51,028::__init__::225::IOProcess::(_processLogs) (543662) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:51,028::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-27::DEBUG::2014-08-11 17:55:51,029::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:55:51,029::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:55:51,090::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000387856 s, 944 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:51,092::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:51,092::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:51,094::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:51,094::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:51,095::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:51,096::__init__::225::IOProcess::(_processLogs) Waiting for next request... >GuestMonitor-vm::DEBUG::2014-08-11 17:55:51,097::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:51,097::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:51,098::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:51,099::__init__::225::IOProcess::(_processLogs) (543663) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:51,100::__init__::225::IOProcess::(_processLogs) (543663) Got request for method 'statvfs' >GuestMonitor-vm::DEBUG::2014-08-11 17:55:51,101::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:55:51,102::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543663) Building response >Thread-19::DEBUG::2014-08-11 17:55:51,103::__init__::225::IOProcess::(_processLogs) (543663) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:51,104::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:51,105::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:55:51,283::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:51,397::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0550077 s, 18.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:53,126::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:53,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:53,127::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:53,404::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:53,493::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.028539 s, 35.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:55:55,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:55,612::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.051427 s, 19.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:55:56,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:56,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:55:56,110::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:55:56,348::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:55:57,136::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:57,136::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:57,136::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:57,136::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:57,136::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:57,136::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:57,137::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:57,137::__init__::225::IOProcess::(_processLogs) (543664) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:57,137::__init__::225::IOProcess::(_processLogs) (543664) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:57,137::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543664) Building response >Thread-28::DEBUG::2014-08-11 17:55:57,137::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:55:57,138::__init__::225::IOProcess::(_processLogs) (543664) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:57,196::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:57,197::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:55:57,199::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00164219 s, 301 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:55:57,200::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:57,201::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:55:57,202::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:57,202::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:57,203::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:57,203::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:57,203::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:57,204::__init__::225::IOProcess::(_processLogs) (543665) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:55:57,204::__init__::225::IOProcess::(_processLogs) (543665) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:55:57,205::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543665) Building response >Thread-19::DEBUG::2014-08-11 17:55:57,206::__init__::225::IOProcess::(_processLogs) (543665) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:57,206::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:57,207::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:55:57,208::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:57,208::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:55:57,208::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:57,208::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:57,208::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:57,208::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) (543666) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) (543666) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) (543666) Building response >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) (543666) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:57,209::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) (543667) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) (543667) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:57,210::__init__::225::IOProcess::(_processLogs) (543667) Building response >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) (543667) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:55:57,211::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) (543668) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) (543668) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) (543668) Building response >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) (543668) Queuing response >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:55:57,212::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:55:57,290::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ac68f22-e2a9-4d19-af24-ce054ad59496`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:55:57,291::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:55:57,291::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387856', 'lastCheck': '6.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00164219', 'lastCheck': '0.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:55:57,291::task::1191::Storage.TaskManager.Task::(prepare) Task=`9ac68f22-e2a9-4d19-af24-ce054ad59496`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387856', 'lastCheck': '6.2', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00164219', 'lastCheck': '0.1', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:55:57,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`9ac68f22-e2a9-4d19-af24-ce054ad59496`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:55:57,291::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:55:57,291::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:55:57,291::task::993::Storage.TaskManager.Task::(_decref) Task=`9ac68f22-e2a9-4d19-af24-ce054ad59496`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:55:57,305::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:55:57,305::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:55:57,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-10256::DEBUG::2014-08-11 17:55:57,727::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:55:57,772::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0719698 s, 14.2 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:58,132::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:58,132::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:55:58,132::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:55:58,469::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:55:59,780::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:55:59,926::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0855293 s, 12.0 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:56:01,031::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:56:01,032::task::595::Storage.TaskManager.Task::(_updateState) Task=`16b61e5f-b48b-4d09-9058-fb8c60605a79`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:56:01,032::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:56:01,076::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:01,076::task::1191::Storage.TaskManager.Task::(prepare) Task=`16b61e5f-b48b-4d09-9058-fb8c60605a79`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:01,076::task::595::Storage.TaskManager.Task::(_updateState) Task=`16b61e5f-b48b-4d09-9058-fb8c60605a79`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:56:01,076::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:56:01,076::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:56:01,076::task::993::Storage.TaskManager.Task::(_decref) Task=`16b61e5f-b48b-4d09-9058-fb8c60605a79`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:56:01,087::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:56:01,088::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cefeb53-7de7-497a-a770-3bf7b630b1f5`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:56:01,088::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:56:01,088::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a7c7ff2d-ebed-4a93-9cfa-4f8448977f32`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:56:01,088::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:56:01,088::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:56:01,088::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`a7c7ff2d-ebed-4a93-9cfa-4f8448977f32`::Granted request >Thread-10197::DEBUG::2014-08-11 17:56:01,089::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4cefeb53-7de7-497a-a770-3bf7b630b1f5`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:56:01,089::task::993::Storage.TaskManager.Task::(_decref) Task=`4cefeb53-7de7-497a-a770-3bf7b630b1f5`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) (543669) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:01,104::__init__::225::IOProcess::(_processLogs) (543669) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:01,105::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543669) Building response >Thread-19::DEBUG::2014-08-11 17:56:01,106::__init__::225::IOProcess::(_processLogs) (543669) Queuing response >Thread-10197::INFO::2014-08-11 17:56:01,106::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-19::DEBUG::2014-08-11 17:56:01,106::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:56:01,106::task::1191::Storage.TaskManager.Task::(prepare) Task=`4cefeb53-7de7-497a-a770-3bf7b630b1f5`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:01,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`4cefeb53-7de7-497a-a770-3bf7b630b1f5`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:56:01,107::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-10197::DEBUG::2014-08-11 17:56:01,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-27::DEBUG::2014-08-11 17:56:01,108::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-10197::DEBUG::2014-08-11 17:56:01,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:56:01,168::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-27::DEBUG::2014-08-11 17:56:01,170::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000932846 s, 392 kB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:01,171::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10197::DEBUG::2014-08-11 17:56:01,171::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:56:01,173::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-19::DEBUG::2014-08-11 17:56:01,173::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-10197::DEBUG::2014-08-11 17:56:01,174::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-19::DEBUG::2014-08-11 17:56:01,175::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:01,177::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::DEBUG::2014-08-11 17:56:01,177::task::993::Storage.TaskManager.Task::(_decref) Task=`4cefeb53-7de7-497a-a770-3bf7b630b1f5`::ref 0 aborting False >GuestMonitor-vm::DEBUG::2014-08-11 17:56:01,177::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:56:01,178::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:01,179::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:01,181::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:01,182::__init__::225::IOProcess::(_processLogs) Extracting request information... >GuestMonitor-vm::DEBUG::2014-08-11 17:56:01,183::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:56:01,184::__init__::225::IOProcess::(_processLogs) (543670) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:01,185::__init__::225::IOProcess::(_processLogs) (543670) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:01,186::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543670) Building response >Thread-19::DEBUG::2014-08-11 17:56:01,187::__init__::225::IOProcess::(_processLogs) (543670) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:01,188::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:01,188::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:56:01,935::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:02,014::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0189923 s, 53.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:03,137::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:03,138::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:03,138::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:04,075::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:04,155::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0204814 s, 50.0 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:56:05,476::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:56:06,164::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >GuestMonitor-vm::DEBUG::2014-08-11 17:56:06,223::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:06,223::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:06,224::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:06,235::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0122502 s, 83.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:07,212::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:07,212::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:07,212::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:07,213::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:07,213::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:07,213::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:07,213::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:07,213::__init__::225::IOProcess::(_processLogs) (543671) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:07,213::__init__::225::IOProcess::(_processLogs) (543671) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:07,214::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543671) Building response >Thread-19::DEBUG::2014-08-11 17:56:07,214::__init__::225::IOProcess::(_processLogs) (543671) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:07,214::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:07,214::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:56:07,214::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:56:07,275::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000756901 s, 654 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:07,276::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:07,277::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:07,278::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:07,278::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:07,278::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:07,278::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:07,278::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:07,278::__init__::225::IOProcess::(_processLogs) (543672) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:07,279::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543672) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:07,279::__init__::225::IOProcess::(_processLogs) (543672) Building response >Thread-19::DEBUG::2014-08-11 17:56:07,279::__init__::225::IOProcess::(_processLogs) (543672) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:07,279::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:07,279::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:07,280::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) (543673) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) (543673) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) (543673) Building response >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) (543673) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:56:07,281::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) (543674) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) (543674) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) (543674) Building response >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) (543674) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:07,282::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) (543675) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) (543675) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:07,283::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543675) Building response >Thread-19::DEBUG::2014-08-11 17:56:07,284::__init__::225::IOProcess::(_processLogs) (543675) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:07,284::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:07,284::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:08,144::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:08,144::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:08,145::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:08,243::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:08,347::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0459679 s, 22.3 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:56:10,355::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:10,501::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0860483 s, 11.9 MB/s\n'; <rc> = 0 >Thread-27::DEBUG::2014-08-11 17:56:11,187::domainMonitor::192::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,189::__init__::225::IOProcess::(_processLogs) (543676) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) (543676) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Message size is 162 >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) (543677) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:56:11,190::__init__::225::IOProcess::(_processLogs) (543677) Got request for method 'glob' >Thread-19::DEBUG::2014-08-11 17:56:11,195::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543676) Building response >Thread-19::DEBUG::2014-08-11 17:56:11,195::__init__::225::IOProcess::(_processLogs) (543676) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:11,196::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:56:11,196::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-19::DEBUG::2014-08-11 17:56:11,199::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543677) Building response >Thread-19::DEBUG::2014-08-11 17:56:11,199::__init__::225::IOProcess::(_processLogs) (543677) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:11,199::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:56:11,200::__init__::225::IOProcess::(_processLogs) Sending response sized 186 >Thread-27::DEBUG::2014-08-11 17:56:11,203::fileSD::150::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f >Thread-19::DEBUG::2014-08-11 17:56:11,203::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) Message size is 191 >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) (543678) Finding callback 'touch'... >Thread-19::DEBUG::2014-08-11 17:56:11,204::__init__::225::IOProcess::(_processLogs) (543678) Got request for method 'touch' >GuestMonitor-vm::DEBUG::2014-08-11 17:56:11,230::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:11,233::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:11,236::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:56:11,238::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543678) Building response >Thread-19::DEBUG::2014-08-11 17:56:11,239::__init__::225::IOProcess::(_processLogs) (543678) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:11,240::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:11,241::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:56:11,241::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-27::DEBUG::2014-08-11 17:56:11,242::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-10237::DEBUG::2014-08-11 17:56:11,243::task::595::Storage.TaskManager.Task::(_updateState) Task=`f18997bf-7575-4b00-b5a0-15dbbb1a0866`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:56:11,244::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-19::DEBUG::2014-08-11 17:56:11,244::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:11,245::__init__::225::IOProcess::(_processLogs) Message size is 215 >Thread-19::DEBUG::2014-08-11 17:56:11,245::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:11,246::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:11,247::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,247::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,248::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,248::__init__::225::IOProcess::(_processLogs) (543679) Finding callback 'readfile'... >Thread-19::DEBUG::2014-08-11 17:56:11,249::__init__::225::IOProcess::(_processLogs) (543679) Got request for method 'readfile' >Thread-19::DEBUG::2014-08-11 17:56:11,250::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543679) Building response >Thread-27::DEBUG::2014-08-11 17:56:11,250::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=sd35_1', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=00000002-0002-0002-0002-00000000037f', 'REMOTE_PATH=multipass.eng.lab.tlv.redhat.com:/export/images/rnd/vered/abc5', 'ROLE=Regular', 'SDUUID=7158eae9-4886-4af7-af0b-d668ecee9e4f', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=51d8f5eb4b5290a155497f16331f56aef8e2cd5e'] >Thread-19::DEBUG::2014-08-11 17:56:11,251::__init__::225::IOProcess::(_processLogs) (543679) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:11,252::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:11,252::__init__::225::IOProcess::(_processLogs) Sending response sized 544 >Thread-19::DEBUG::2014-08-11 17:56:11,253::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:11,254::__init__::225::IOProcess::(_processLogs) Message size is 208 >Thread-19::DEBUG::2014-08-11 17:56:11,254::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:11,255::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:11,255::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,256::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,257::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,257::__init__::225::IOProcess::(_processLogs) (543680) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:11,258::__init__::225::IOProcess::(_processLogs) (543680) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:11,258::__init__::225::IOProcess::(_processLogs) (543680) Building response >Thread-19::DEBUG::2014-08-11 17:56:11,259::__init__::225::IOProcess::(_processLogs) (543680) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:11,259::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10237::INFO::2014-08-11 17:56:11,260::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-19::DEBUG::2014-08-11 17:56:11,260::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10237::DEBUG::2014-08-11 17:56:11,261::task::1191::Storage.TaskManager.Task::(prepare) Task=`f18997bf-7575-4b00-b5a0-15dbbb1a0866`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:11,261::task::595::Storage.TaskManager.Task::(_updateState) Task=`f18997bf-7575-4b00-b5a0-15dbbb1a0866`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:56:11,262::__init__::225::IOProcess::(_processLogs) Message size is 202 >Thread-10237::DEBUG::2014-08-11 17:56:11,262::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-19::DEBUG::2014-08-11 17:56:11,262::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10237::DEBUG::2014-08-11 17:56:11,263::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:56:11,263::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10237::DEBUG::2014-08-11 17:56:11,264::task::993::Storage.TaskManager.Task::(_decref) Task=`f18997bf-7575-4b00-b5a0-15dbbb1a0866`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:56:11,264::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,265::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,266::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,267::__init__::225::IOProcess::(_processLogs) (543681) Finding callback 'glob'... >Thread-19::DEBUG::2014-08-11 17:56:11,267::__init__::225::IOProcess::(_processLogs) (543681) Got request for method 'glob' >Thread-27::DEBUG::2014-08-11 17:56:11,268::fileSD::608::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-08-11 17:56:11,268::__init__::225::IOProcess::(_processLogs) (543681) Queuing response >Thread-27::INFO::2014-08-11 17:56:11,268::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_imageNS already registered >Thread-19::DEBUG::2014-08-11 17:56:11,269::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-27::INFO::2014-08-11 17:56:11,269::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 7158eae9-4886-4af7-af0b-d668ecee9e4f_volumeNS already registered >Thread-19::DEBUG::2014-08-11 17:56:11,270::__init__::225::IOProcess::(_processLogs) Sending response sized 56 >Thread-19::DEBUG::2014-08-11 17:56:11,271::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:11,272::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:11,272::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:11,272::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:11,273::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,274::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:11,274::__init__::225::IOProcess::(_processLogs) (543682) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:11,275::__init__::225::IOProcess::(_processLogs) (543682) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:11,276::__init__::225::IOProcess::(_processLogs) (543682) Queuing response >Thread-27::DEBUG::2014-08-11 17:56:11,277::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:56:11,277::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-10197::DEBUG::2014-08-11 17:56:11,277::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-19::DEBUG::2014-08-11 17:56:11,337::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10197::DEBUG::2014-08-11 17:56:11,339::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c75bc15-e187-44fb-8750-601b5b03f09a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:56:11,341::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-27::DEBUG::2014-08-11 17:56:11,341::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00262768 s, 139 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:11,345::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-10197::DEBUG::2014-08-11 17:56:11,346::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`99128ec5-dea0-45c2-9421-44c22e765e33`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-19::DEBUG::2014-08-11 17:56:11,346::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10197::DEBUG::2014-08-11 17:56:11,347::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-19::DEBUG::2014-08-11 17:56:11,348::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-10197::DEBUG::2014-08-11 17:56:11,349::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-19::DEBUG::2014-08-11 17:56:11,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10197::DEBUG::2014-08-11 17:56:11,351::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`99128ec5-dea0-45c2-9421-44c22e765e33`::Granted request >Thread-19::DEBUG::2014-08-11 17:56:11,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:11,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10197::DEBUG::2014-08-11 17:56:11,356::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c75bc15-e187-44fb-8750-601b5b03f09a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-19::DEBUG::2014-08-11 17:56:11,356::__init__::225::IOProcess::(_processLogs) (543683) Finding callback 'statvfs'... >Thread-10197::DEBUG::2014-08-11 17:56:11,358::task::993::Storage.TaskManager.Task::(_decref) Task=`9c75bc15-e187-44fb-8750-601b5b03f09a`::ref 1 aborting False >Thread-19::DEBUG::2014-08-11 17:56:11,359::__init__::225::IOProcess::(_processLogs) (543683) Got request for method 'statvfs' >Thread-10017::DEBUG::2014-08-11 17:56:11,361::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:56:11,363::__init__::225::IOProcess::(_processLogs) (543683) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:11,365::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:11,366::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10197::INFO::2014-08-11 17:56:11,492::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:11,492::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c75bc15-e187-44fb-8750-601b5b03f09a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:11,492::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c75bc15-e187-44fb-8750-601b5b03f09a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:56:11,492::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:56:11,492::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:56:11,492::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:56:11,492::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:56:11,492::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:56:11,492::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:56:11,493::task::993::Storage.TaskManager.Task::(_decref) Task=`9c75bc15-e187-44fb-8750-601b5b03f09a`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:56:12,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e88ed30-9b26-470b-8a47-ac9ebf525964`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:56:12,471::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:56:12,471::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00262768', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756901', 'lastCheck': '5.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:56:12,471::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e88ed30-9b26-470b-8a47-ac9ebf525964`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00262768', 'lastCheck': '1.1', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000756901', 'lastCheck': '5.2', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:56:12,471::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e88ed30-9b26-470b-8a47-ac9ebf525964`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:56:12,471::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:56:12,471::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:56:12,471::task::993::Storage.TaskManager.Task::(_decref) Task=`0e88ed30-9b26-470b-8a47-ac9ebf525964`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:56:12,509::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:12,621::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530821 s, 19.3 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:56:12,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:56:12,685::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Thread-10256::DEBUG::2014-08-11 17:56:12,736::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:13,146::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:13,147::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:13,147::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:14,628::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:14,712::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0247424 s, 41.4 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:16,239::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:16,240::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:16,240::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:16,721::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:16,837::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0579936 s, 17.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:17,284::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:17,285::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:17,285::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:17,285::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:17,285::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:17,285::__init__::225::IOProcess::(_processLogs) (543684) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:17,285::__init__::225::IOProcess::(_processLogs) (543684) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:17,286::__init__::225::IOProcess::(_processLogs) (543684) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:17,286::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-28::DEBUG::2014-08-11 17:56:17,287::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-28::DEBUG::2014-08-11 17:56:17,347::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00138513 s, 357 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:17,347::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:17,347::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:17,348::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:17,348::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:17,348::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:17,348::__init__::225::IOProcess::(_processLogs) (543685) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:17,348::__init__::225::IOProcess::(_processLogs) (543685) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:17,348::__init__::225::IOProcess::(_processLogs) (543685) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) (543686) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:17,349::__init__::225::IOProcess::(_processLogs) (543686) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:17,350::__init__::225::IOProcess::(_processLogs) (543686) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:17,350::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:17,350::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:56:17,350::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:17,350::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) (543687) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) (543687) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) (543687) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:17,351::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) (543688) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) (543688) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) (543688) Building response >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) (543688) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:17,352::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:17,353::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:18,153::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:18,153::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:18,154::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:18,845::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:18,924::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0142397 s, 71.9 MB/s\n'; <rc> = 0 >Dummy-51::DEBUG::2014-08-11 17:56:20,933::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:21,052::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0605744 s, 16.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:21,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:21,246::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:21,247::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) (543689) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:21,365::__init__::225::IOProcess::(_processLogs) (543689) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:21,366::__init__::225::IOProcess::(_processLogs) (543689) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:21,366::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:56:21,367::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:56:21,426::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.000325108 s, 1.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:21,429::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:21,430::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:21,431::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:21,432::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:21,433::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:21,434::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:21,436::__init__::225::IOProcess::(_processLogs) (543690) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:21,437::__init__::225::IOProcess::(_processLogs) (543690) Building response >Thread-19::DEBUG::2014-08-11 17:56:21,438::__init__::225::IOProcess::(_processLogs) (543690) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:21,439::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:21,441::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-10237::DEBUG::2014-08-11 17:56:21,572::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:56:21,573::task::595::Storage.TaskManager.Task::(_updateState) Task=`97c24356-dca0-49ea-b849-3d0d15847fb3`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:56:21,573::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:56:21,628::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:21,628::task::1191::Storage.TaskManager.Task::(prepare) Task=`97c24356-dca0-49ea-b849-3d0d15847fb3`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:21,628::task::595::Storage.TaskManager.Task::(_updateState) Task=`97c24356-dca0-49ea-b849-3d0d15847fb3`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:56:21,628::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:56:21,628::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:56:21,628::task::993::Storage.TaskManager.Task::(_decref) Task=`97c24356-dca0-49ea-b849-3d0d15847fb3`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:56:21,639::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:56:21,639::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b33c28d-e835-40b6-bd4a-5b4ea68ecd1a`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:56:21,639::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:56:21,639::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`34b803aa-1797-4713-bc8b-56c906b23a0c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:56:21,639::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:56:21,639::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:56:21,639::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`34b803aa-1797-4713-bc8b-56c906b23a0c`::Granted request >Thread-10197::DEBUG::2014-08-11 17:56:21,640::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2b33c28d-e835-40b6-bd4a-5b4ea68ecd1a`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:56:21,640::task::993::Storage.TaskManager.Task::(_decref) Task=`2b33c28d-e835-40b6-bd4a-5b4ea68ecd1a`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:56:21,656::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:21,656::task::1191::Storage.TaskManager.Task::(prepare) Task=`2b33c28d-e835-40b6-bd4a-5b4ea68ecd1a`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:21,656::task::595::Storage.TaskManager.Task::(_updateState) Task=`2b33c28d-e835-40b6-bd4a-5b4ea68ecd1a`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:56:21,656::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:56:21,656::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:56:21,656::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:56:21,656::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:56:21,656::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:56:21,657::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:56:21,657::task::993::Storage.TaskManager.Task::(_decref) Task=`2b33c28d-e835-40b6-bd4a-5b4ea68ecd1a`::ref 0 aborting False >Dummy-51::DEBUG::2014-08-11 17:56:23,060::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:23,152::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0319535 s, 32.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:23,160::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:23,160::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:23,160::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:25,160::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:25,276::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0549423 s, 18.6 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:26,251::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:26,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:26,252::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:56:26,364::task::595::Storage.TaskManager.Task::(_updateState) Task=`40bc3fd2-db16-4658-aefa-a45b7866ae08`::moving from state init -> state preparing >Thread-10017::INFO::2014-08-11 17:56:26,365::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='056639f7-5123-4146-b4f5-49c9284f7ff6', volUUID='eda52843-98a1-4b68-b5ea-033ed979b96a', options=None) >Thread-19::DEBUG::2014-08-11 17:56:26,365::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:56:26,365::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:26,365::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:26,365::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:26,365::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:26,366::__init__::225::IOProcess::(_processLogs) (543691) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:56:26,366::__init__::225::IOProcess::(_processLogs) (543691) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:56:26,369::__init__::225::IOProcess::(_processLogs) (543691) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:26,369::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-19::DEBUG::2014-08-11 17:56:26,370::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:56:26,370::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-10017::INFO::2014-08-11 17:56:26,370::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:56:26,370::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10017::DEBUG::2014-08-11 17:56:26,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`40bc3fd2-db16-4658-aefa-a45b7866ae08`::finished: {'truesize': '512', 'apparentsize': '1073741824'} >Thread-19::DEBUG::2014-08-11 17:56:26,371::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10017::DEBUG::2014-08-11 17:56:26,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`40bc3fd2-db16-4658-aefa-a45b7866ae08`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:56:26,371::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10017::DEBUG::2014-08-11 17:56:26,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10017::DEBUG::2014-08-11 17:56:26,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:56:26,372::__init__::225::IOProcess::(_processLogs) (543692) Finding callback 'stat'... >Thread-10017::DEBUG::2014-08-11 17:56:26,372::task::993::Storage.TaskManager.Task::(_decref) Task=`40bc3fd2-db16-4658-aefa-a45b7866ae08`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:56:26,373::__init__::225::IOProcess::(_processLogs) (543692) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:56:26,373::__init__::225::IOProcess::(_processLogs) (543692) Building response >Thread-19::DEBUG::2014-08-11 17:56:26,373::__init__::225::IOProcess::(_processLogs) (543692) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:26,373::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:26,373::__init__::225::IOProcess::(_processLogs) Sending response sized 242 >Thread-10017::DEBUG::2014-08-11 17:56:26,395::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Dummy-51::DEBUG::2014-08-11 17:56:27,284::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Thread-19::DEBUG::2014-08-11 17:56:27,353::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:27,354::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,354::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:27,354::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:27,354::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:27,354::__init__::225::IOProcess::(_processLogs) (543693) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:27,355::__init__::225::IOProcess::(_processLogs) (543693) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:27,356::__init__::225::IOProcess::(_processLogs) (543693) Queuing response >Thread-28::DEBUG::2014-08-11 17:56:27,357::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:56:27,357::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,417::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:56:27,418::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.000341372 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:27,420::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:27,420::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,421::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:27,421::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:27,422::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:27,422::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:27,423::__init__::225::IOProcess::(_processLogs) (543694) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:27,423::__init__::225::IOProcess::(_processLogs) (543694) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:27,424::__init__::225::IOProcess::(_processLogs) (543694) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:27,425::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,426::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:56:27,426::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0822235 s, 12.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:27,427::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:56:27,427::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,428::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:27,428::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:27,429::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:27,430::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:27,430::__init__::225::IOProcess::(_processLogs) (543695) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:27,430::__init__::225::IOProcess::(_processLogs) (543695) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:27,431::__init__::225::IOProcess::(_processLogs) (543695) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:27,432::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,432::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:27,433::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:56:27,434::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,434::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:27,435::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:27,435::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:27,436::__init__::225::IOProcess::(_processLogs) (543696) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:27,437::__init__::225::IOProcess::(_processLogs) (543696) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:27,437::__init__::225::IOProcess::(_processLogs) (543696) Building response >Thread-19::DEBUG::2014-08-11 17:56:27,438::__init__::225::IOProcess::(_processLogs) (543696) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:27,438::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,438::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:27,439::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:56:27,439::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,440::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:27,440::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:27,440::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:27,441::__init__::225::IOProcess::(_processLogs) (543697) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:27,442::__init__::225::IOProcess::(_processLogs) (543697) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:27,442::__init__::225::IOProcess::(_processLogs) (543697) Building response >Thread-19::DEBUG::2014-08-11 17:56:27,443::__init__::225::IOProcess::(_processLogs) (543697) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:27,443::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,444::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-10256::DEBUG::2014-08-11 17:56:27,738::task::595::Storage.TaskManager.Task::(_updateState) Task=`460b38b0-679f-4fc0-bc6a-2aea8275d6c4`::moving from state init -> state preparing >Thread-10256::INFO::2014-08-11 17:56:27,738::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumeSize(sdUUID='7158eae9-4886-4af7-af0b-d668ecee9e4f', spUUID='00000002-0002-0002-0002-00000000037f', imgUUID='99e5cda5-262b-4469-b336-04e3f0cf7c38', volUUID='3f8b5bbe-741b-4a4f-9397-84123d530772', options=None) >Thread-19::DEBUG::2014-08-11 17:56:27,738::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:56:27,738::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,738::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:27,739::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:27,739::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:27,739::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:27,739::__init__::225::IOProcess::(_processLogs) (543698) Finding callback 'stat'... >Thread-19::DEBUG::2014-08-11 17:56:27,739::__init__::225::IOProcess::(_processLogs) (543698) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:56:27,739::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543698) Building response >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) (543698) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) Message size is 260 >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:27,740::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-10256::INFO::2014-08-11 17:56:27,740::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumeSize, Return response: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:56:27,741::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-10256::DEBUG::2014-08-11 17:56:27,741::task::1191::Storage.TaskManager.Task::(prepare) Task=`460b38b0-679f-4fc0-bc6a-2aea8275d6c4`::finished: {'truesize': '512', 'apparentsize': '10737418240'} >Thread-19::DEBUG::2014-08-11 17:56:27,741::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-10256::DEBUG::2014-08-11 17:56:27,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`460b38b0-679f-4fc0-bc6a-2aea8275d6c4`::moving from state preparing -> state finished >Thread-19::DEBUG::2014-08-11 17:56:27,742::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-10256::DEBUG::2014-08-11 17:56:27,742::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10256::DEBUG::2014-08-11 17:56:27,742::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-19::DEBUG::2014-08-11 17:56:27,742::__init__::225::IOProcess::(_processLogs) (543699) Finding callback 'stat'... >Thread-10256::DEBUG::2014-08-11 17:56:27,743::task::993::Storage.TaskManager.Task::(_decref) Task=`460b38b0-679f-4fc0-bc6a-2aea8275d6c4`::ref 0 aborting False >Thread-19::DEBUG::2014-08-11 17:56:27,743::__init__::225::IOProcess::(_processLogs) (543699) Got request for method 'stat' >Thread-19::DEBUG::2014-08-11 17:56:27,744::__init__::225::IOProcess::(_processLogs) (543699) Building response >Thread-19::DEBUG::2014-08-11 17:56:27,744::__init__::225::IOProcess::(_processLogs) (543699) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:27,744::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:27,744::__init__::225::IOProcess::(_processLogs) Sending response sized 243 >Thread-10256::DEBUG::2014-08-11 17:56:27,765::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-10237::DEBUG::2014-08-11 17:56:27,856::task::595::Storage.TaskManager.Task::(_updateState) Task=`0db4252e-225f-4201-b191-6f6951f15ff5`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:56:27,857::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-10237::INFO::2014-08-11 17:56:27,857::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325108', 'lastCheck': '6.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341372', 'lastCheck': '0.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:56:27,858::task::1191::Storage.TaskManager.Task::(prepare) Task=`0db4252e-225f-4201-b191-6f6951f15ff5`::finished: {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000325108', 'lastCheck': '6.4', 'valid': True}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341372', 'lastCheck': '0.4', 'valid': True}} >Thread-10237::DEBUG::2014-08-11 17:56:27,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`0db4252e-225f-4201-b191-6f6951f15ff5`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:56:27,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:56:27,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:56:27,858::task::993::Storage.TaskManager.Task::(_decref) Task=`0db4252e-225f-4201-b191-6f6951f15ff5`::ref 0 aborting False >Thread-10237::DEBUG::2014-08-11 17:56:27,876::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10237::DEBUG::2014-08-11 17:56:27,877::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:28,161::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:28,162::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:28,162::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >VM Channels Listener::DEBUG::2014-08-11 17:56:28,501::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 50. >Dummy-51::DEBUG::2014-08-11 17:56:29,451::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:29,581::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0133913 s, 76.5 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:31,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:31,258::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:31,259::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:31,438::__init__::225::IOProcess::(_processLogs) (543700) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:31,439::__init__::225::IOProcess::(_processLogs) (543700) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:31,440::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543700) Building response >Thread-19::DEBUG::2014-08-11 17:56:31,440::__init__::225::IOProcess::(_processLogs) (543700) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:31,440::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:31,441::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:56:31,441::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:56:31,503::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.00154698 s, 237 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:31,504::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:31,505::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:31,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:31,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:31,507::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:31,507::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:31,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:31,508::__init__::225::IOProcess::(_processLogs) (543701) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:31,509::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543701) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:31,510::__init__::225::IOProcess::(_processLogs) (543701) Building response >Thread-19::DEBUG::2014-08-11 17:56:31,511::__init__::225::IOProcess::(_processLogs) (543701) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:31,511::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:31,512::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Dummy-51::DEBUG::2014-08-11 17:56:31,589::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:31,703::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0551264 s, 18.6 MB/s\n'; <rc> = 0 >Thread-10237::DEBUG::2014-08-11 17:56:31,736::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10237::DEBUG::2014-08-11 17:56:31,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`6db0f505-bd50-4bc6-bf19-a492a28197c1`::moving from state init -> state preparing >Thread-10237::INFO::2014-08-11 17:56:31,737::logUtils::44::dispatcher::(wrapper) Run and protect: getSpmStatus(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10237::INFO::2014-08-11 17:56:31,791::logUtils::47::dispatcher::(wrapper) Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:31,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`6db0f505-bd50-4bc6-bf19-a492a28197c1`::finished: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 4L}} >Thread-10237::DEBUG::2014-08-11 17:56:31,792::task::595::Storage.TaskManager.Task::(_updateState) Task=`6db0f505-bd50-4bc6-bf19-a492a28197c1`::moving from state preparing -> state finished >Thread-10237::DEBUG::2014-08-11 17:56:31,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-10237::DEBUG::2014-08-11 17:56:31,793::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10237::DEBUG::2014-08-11 17:56:31,793::task::993::Storage.TaskManager.Task::(_decref) Task=`6db0f505-bd50-4bc6-bf19-a492a28197c1`::ref 0 aborting False >Thread-10197::DEBUG::2014-08-11 17:56:31,806::BindingXMLRPC::318::vds::(wrapper) client [10.35.1.234] >Thread-10197::DEBUG::2014-08-11 17:56:31,807::task::595::Storage.TaskManager.Task::(_updateState) Task=`39a07510-82b7-4bc0-ae9b-299c8c695e60`::moving from state init -> state preparing >Thread-10197::INFO::2014-08-11 17:56:31,808::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='00000002-0002-0002-0002-00000000037f', options=None) >Thread-10197::DEBUG::2014-08-11 17:56:31,810::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8b71ba9a-e564-4d4d-af28-e71e728daef2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2610' at 'getStoragePoolInfo' >Thread-10197::DEBUG::2014-08-11 17:56:31,810::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.00000002-0002-0002-0002-00000000037f' for lock type 'shared' >Thread-10197::DEBUG::2014-08-11 17:56:31,811::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free. Now locking as 'shared' (1 active user) >Thread-10197::DEBUG::2014-08-11 17:56:31,812::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.00000002-0002-0002-0002-00000000037f`ReqID=`8b71ba9a-e564-4d4d-af28-e71e728daef2`::Granted request >Thread-10197::DEBUG::2014-08-11 17:56:31,813::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`39a07510-82b7-4bc0-ae9b-299c8c695e60`::_resourcesAcquired: Storage.00000002-0002-0002-0002-00000000037f (shared) >Thread-10197::DEBUG::2014-08-11 17:56:31,814::task::993::Storage.TaskManager.Task::(_decref) Task=`39a07510-82b7-4bc0-ae9b-299c8c695e60`::ref 1 aborting False >Thread-10197::INFO::2014-08-11 17:56:31,857::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:31,857::task::1191::Storage.TaskManager.Task::(prepare) Task=`39a07510-82b7-4bc0-ae9b-299c8c695e60`::finished: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 4L, 'domains': '7158eae9-4886-4af7-af0b-d668ecee9e4f:Active,d54e6e6c-81f2-41f2-90ab-7e3c2457938a:Active', 'master_uuid': u'd54e6e6c-81f2-41f2-90ab-7e3c2457938a', 'version': '3', 'spm_id': 1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'7158eae9-4886-4af7-af0b-d668ecee9e4f': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}, 'd54e6e6c-81f2-41f2-90ab-7e3c2457938a': {'status': 'Active', 'diskfree': '55987666944', 'isoprefix': '', 'alerts': [], 'disktotal': '620959367168', 'version': 3}}} >Thread-10197::DEBUG::2014-08-11 17:56:31,858::task::595::Storage.TaskManager.Task::(_updateState) Task=`39a07510-82b7-4bc0-ae9b-299c8c695e60`::moving from state preparing -> state finished >Thread-10197::DEBUG::2014-08-11 17:56:31,858::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.00000002-0002-0002-0002-00000000037f': < ResourceRef 'Storage.00000002-0002-0002-0002-00000000037f', isValid: 'True' obj: 'None'>} >Thread-10197::DEBUG::2014-08-11 17:56:31,858::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-10197::DEBUG::2014-08-11 17:56:31,859::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.00000002-0002-0002-0002-00000000037f' >Thread-10197::DEBUG::2014-08-11 17:56:31,859::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.00000002-0002-0002-0002-00000000037f' (0 active users) >Thread-10197::DEBUG::2014-08-11 17:56:31,860::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.00000002-0002-0002-0002-00000000037f' is free, finding out if anyone is waiting for it. >Thread-10197::DEBUG::2014-08-11 17:56:31,860::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.00000002-0002-0002-0002-00000000037f', Clearing records. >Thread-10197::DEBUG::2014-08-11 17:56:31,861::task::993::Storage.TaskManager.Task::(_decref) Task=`39a07510-82b7-4bc0-ae9b-299c8c695e60`::ref 0 aborting False >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:33,165::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:33,166::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:33,166::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:33,711::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:33,810::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0401842 s, 25.5 MB/s\n'; <rc> = 0 >VM Channels Listener::DEBUG::2014-08-11 17:56:35,574::vmchannels::96::vds::(_handle_timeouts) Timeout on fileno 41. >Dummy-51::DEBUG::2014-08-11 17:56:35,819::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:35,922::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0443369 s, 23.1 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:36,264::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:36,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:36,265::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-19::DEBUG::2014-08-11 17:56:37,442::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:37,442::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:37,442::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) (543702) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) (543702) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:37,443::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543702) Building response >Thread-19::DEBUG::2014-08-11 17:56:37,444::__init__::225::IOProcess::(_processLogs) (543702) Queuing response >Thread-28::DEBUG::2014-08-11 17:56:37,444::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc4/d54e6e6c-81f2-41f2-90ab-7e3c2457938a/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-08-11 17:56:37,444::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:37,503::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-28::DEBUG::2014-08-11 17:56:37,505::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n495 bytes (495 B) copied, 0.00107707 s, 460 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:37,505::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:37,505::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) (543703) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) (543703) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|(543703) Building response >Thread-19::DEBUG::2014-08-11 17:56:37,506::__init__::225::IOProcess::(_processLogs) (543703) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:37,507::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Generating json... >Thread-19::DEBUG::2014-08-11 17:56:37,507::__init__::225::IOProcess::(_processLogs) Sending response sized 247 >Thread-19::DEBUG::2014-08-11 17:56:37,507::__init__::225::IOProcess::(_processLogs) Marshaling message...DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:37,507::__init__::225::IOProcess::(_processLogs) Message size is 199 >Thread-19::DEBUG::2014-08-11 17:56:37,507::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) (543704) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) (543704) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) (543704) Building response >Thread-19::DEBUG::2014-08-11 17:56:37,508::__init__::225::IOProcess::(_processLogs) (543704) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Message size is 203 >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:37,509::__init__::225::IOProcess::(_processLogs) DEBUG|Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) (543705) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) (543705) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) (543705) Building response >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) (543705) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) Message size is 205 >Thread-19::DEBUG::2014-08-11 17:56:37,510::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:37,511::__init__::225::IOProcess::(_processLogs) Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:37,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:37,511::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:37,511::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:37,511::__init__::225::IOProcess::(_processLogs) (543706) Finding callback 'access'... >Thread-19::DEBUG::2014-08-11 17:56:37,511::__init__::225::IOProcess::(_processLogs) (543706) Got request for method 'access' >Thread-19::DEBUG::2014-08-11 17:56:37,512::__init__::225::IOProcess::(_processLogs) (543706) Building response >Thread-19::DEBUG::2014-08-11 17:56:37,512::__init__::225::IOProcess::(_processLogs) (543706) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:37,512::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:37,512::__init__::225::IOProcess::(_processLogs) Sending response sized 58 >Dummy-51::DEBUG::2014-08-11 17:56:37,929::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:38,008::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0200664 s, 51.0 MB/s\n'; <rc> = 0 >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:38,172::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:38,173::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >GuestMonitor-vm111::DEBUG::2014-08-11 17:56:38,173::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`2e77d03b-978a-41d9-a9e9-a43c7035366b`::Domain Metadata is not set >Dummy-51::DEBUG::2014-08-11 17:56:40,015::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) dd if=/rhev/data-center/00000002-0002-0002-0002-00000000037f/mastersd/dom_md/inbox iflag=direct,fullblock count=1 bs=1024000 (cwd None) >Dummy-51::DEBUG::2014-08-11 17:56:40,085::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail) SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0123584 s, 82.9 MB/s\n'; <rc> = 0 >GuestMonitor-vm::DEBUG::2014-08-11 17:56:41,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:41,271::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >GuestMonitor-vm::DEBUG::2014-08-11 17:56:41,272::vm::444::vm.Vm::(_getUserCpuTuneInfo) vmId=`14c0fa91-1814-438b-8d7a-4e7de1e1da25`::Domain Metadata is not set >Thread-10017::DEBUG::2014-08-11 17:56:41,403::libvirtconnection::143::root::(wrapper) Unknown libvirterror: ecode: 80 edom: 20 level: 2 message: metadata not found: Requested metadata element is not present >Thread-19::DEBUG::2014-08-11 17:56:41,511::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:41,511::__init__::225::IOProcess::(_processLogs) Message size is 182 >Thread-19::DEBUG::2014-08-11 17:56:41,511::__init__::225::IOProcess::(_processLogs) Marshaling message... >Thread-19::DEBUG::2014-08-11 17:56:41,511::__init__::225::IOProcess::(_processLogs) DEBUG|Queuing request... >Thread-19::DEBUG::2014-08-11 17:56:41,511::__init__::225::IOProcess::(_processLogs) Waiting for next request... >Thread-19::DEBUG::2014-08-11 17:56:41,512::__init__::225::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-08-11 17:56:41,512::__init__::225::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-08-11 17:56:41,512::__init__::225::IOProcess::(_processLogs) (543707) Finding callback 'statvfs'... >Thread-19::DEBUG::2014-08-11 17:56:41,512::__init__::225::IOProcess::(_processLogs) (543707) Got request for method 'statvfs' >Thread-19::DEBUG::2014-08-11 17:56:41,515::__init__::225::IOProcess::(_processLogs) DEBUG|(543707) Building response >Thread-19::DEBUG::2014-08-11 17:56:41,515::__init__::225::IOProcess::(_processLogs) (543707) Queuing response >Thread-19::DEBUG::2014-08-11 17:56:41,515::__init__::225::IOProcess::(_processLogs) Generating json... >Thread-19::DEBUG::2014-08-11 17:56:41,515::__init__::225::IOProcess::(_processLogs) DEBUG|Sending response sized 247 >Thread-27::DEBUG::2014-08-11 17:56:41,516::fileSD::259::Storage.Misc.excCmd::(getReadDelay) /usr/bin/dd if=/rhev/data-center/mnt/multipass.eng.lab.tlv.redhat.com:_export_images_rnd_vered_abc5/7158eae9-4886-4af7-af0b-d668ecee9e4f/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-27::DEBUG::2014-08-11 17:56:41,608::fileSD::259::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n366 bytes (366 B) copied, 0.0101854 s, 35.9 kB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-08-11 17:56:41,608::__init__::225::IOProcess::(_processLogs) DEBUG|Receiving request... >Thread-19::DEBUG::2014-08-11 17:56:41,608::__init__::225::IOProcess::(_processLogs) Message size is 182 >